2024-09-21T00:38:18.686 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T00:38:18.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:38:18.813 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913346' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request - SLOW_OPS - slow request sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.dir_split install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIvCXAwaI235cYHdR0H3dYG38SJFVzU6OC4F7VHf19xCWw3ClsXjGPNbcC/1u0+X3CZT226L/k1vfa30z+f00PQ= smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPhrIn7kdHkpkRiq6fQ1o4X7cJOiqElW0ciP4TQc5xZaYJRhfeUgk+wNT7Y0s0gT4nNKrFiqGij6CHDyGMZ2ebg= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGwx1J+12YWGPnnHSr+lv9BFVsSzK0QkRek2nIBgqbulu4lVp2gi7Pypmx3ZQcuQV+BPC68AInFiQU8T1nrRfw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T00:38:18.814 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T00:38:18.814 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T00:38:18.815 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T00:38:18.816 INFO:teuthology.task.internal:Checking packages... 2024-09-21T00:38:18.838 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T00:38:18.838 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:38:18.838 INFO:teuthology.packaging:ref: None 2024-09-21T00:38:18.838 INFO:teuthology.packaging:tag: None 2024-09-21T00:38:18.838 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:38:18.839 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:38:18.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:38:18.985 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T00:38:18.987 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T00:38:18.995 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T00:38:18.995 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T00:38:19.031 INFO:teuthology.task.internal:Saving configuration 2024-09-21T00:38:19.052 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T00:38:19.059 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T00:38:19.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:33:20.722049', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIvCXAwaI235cYHdR0H3dYG38SJFVzU6OC4F7VHf19xCWw3ClsXjGPNbcC/1u0+X3CZT226L/k1vfa30z+f00PQ='} 2024-09-21T00:38:19.106 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:33:20.719413', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPhrIn7kdHkpkRiq6fQ1o4X7cJOiqElW0ciP4TQc5xZaYJRhfeUgk+wNT7Y0s0gT4nNKrFiqGij6CHDyGMZ2ebg='} 2024-09-21T00:38:19.134 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:33:20.720927', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGwx1J+12YWGPnnHSr+lv9BFVsSzK0QkRek2nIBgqbulu4lVp2gi7Pypmx3ZQcuQV+BPC68AInFiQU8T1nrRfw='} 2024-09-21T00:38:19.134 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T00:38:19.140 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T00:38:19.140 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T00:38:19.141 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T00:38:19.141 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T00:38:19.226 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ca80c4160>, signals=[15]) 2024-09-21T00:38:19.226 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T00:38:19.232 INFO:teuthology.task.internal:Opening connections... 2024-09-21T00:38:19.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-09-21T00:38:19.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:38:19.315 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-09-21T00:38:19.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:38:19.390 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T00:38:19.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:38:19.465 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T00:38:19.471 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-09-21T00:38:19.489 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-09-21T00:38:19.489 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-09-21T00:38:19.547 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-09-21T00:38:19.547 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:38:19.548 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:38:19.549 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-09-21T00:38:19.575 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-09-21T00:38:19.593 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-09-21T00:38:19.593 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-09-21T00:38:19.651 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-09-21T00:38:19.651 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-09-21T00:38:19.651 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-09-21T00:38:19.651 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:38:19.651 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-09-21T00:38:19.651 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:38:19.651 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:38:19.652 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-09-21T00:38:19.652 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:38:19.652 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:38:19.652 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:38:19.652 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:38:19.652 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:38:19.652 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:38:19.652 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-09-21T00:38:19.674 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-21T00:38:19.692 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-21T00:38:19.692 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-21T00:38:19.750 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:38:19.751 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:38:19.752 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:38:19.752 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-21T00:38:19.774 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T00:38:19.783 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T00:38:19.853 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T00:38:19.853 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:38:19.856 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:38:19.858 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:38:19.874 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T00:38:19.911 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T00:38:19.912 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:38:19.914 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:38:19.916 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:38:20.012 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T00:38:20.090 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T00:38:20.104 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T00:38:20.104 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T00:38:20.104 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T00:38:20.105 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:38:20.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:38:20.122 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-21T00:38:20.179 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:38:20.179 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-503.el9.x86_64 2024-09-21T00:38:20.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-09-21T00:38:24.007 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.3 MB 00:02 2024-09-21T00:38:29.658 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-21T00:38:38.158 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.5 MB 00:04 2024-09-21T00:38:40.775 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-21T00:38:41.562 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T00:38:47.210 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T00:38:49.194 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T00:38:49.194 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T00:38:49.301 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-21T00:38:49.319 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-21T00:38:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-21T00:38:49.319 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-21T00:38:49.319 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-21T00:38:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T00:38:49.319 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-21T00:38:49.319 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T00:38:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T00:38:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T00:38:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:38:49.320 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-21T00:38:49.320 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-21T00:38:49.320 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-21T00:38:49.320 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:38:49.320 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 79 M 2024-09-21T00:38:49.321 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 126 M 2024-09-21T00:38:49.321 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-21T00:38:49.745 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 247 kB/s | 36 kB 00:00 2024-09-21T00:38:50.020 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-21T00:38:50.487 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 39 MB/s | 35 MB 00:00 2024-09-21T00:38:50.887 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-21T00:38:50.887 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:38:50.887 INFO:teuthology.orchestra.run.smithi047.stdout:Total 50 MB/s | 79 MB 00:01 2024-09-21T00:38:51.601 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-21T00:38:51.979 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-21T00:38:51.979 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-21T00:38:52.954 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-21T00:38:52.954 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-21T00:38:55.556 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-21T00:38:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:38:56.297 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:38:59.038 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:38:59.173 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:39:04.296 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:39:04.391 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:39:09.537 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:39:48.240 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:39:48.281 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:39:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:39:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:39:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:39:48.638 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:39:49.459 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-21T00:39:49.791 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:39:49.883 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:39:49.883 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:39:49.883 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T00:39:49.883 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T00:39:49.883 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T00:39:49.883 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T00:39:49.883 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T00:39:49.884 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:39:49.942 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:39:49.942 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:39:49.942 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 82.el9 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8274670 2024-09-21T00:39:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:39:49.986 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:39:49.987 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-09-21T00:39:49.987 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:39:49.987 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:39:49.987 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:39:49.988 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-508.el9.x86_64 2024-09-21T00:39:49.988 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:39:50.650 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-09-21T00:39:51.931 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:39:51.959 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-09-21T00:39:51.970 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-21T00:39:51.985 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.JTIRDouLlm 2024-09-21T00:39:51.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JTIRDouLlm 2024-09-21T00:39:52.052 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.JTIRDouLlm 2024-09-21T00:39:52.193 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.JTIRDouLlm is 6KB 2024-09-21T00:39:52.242 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.JTIRDouLlm 2024-09-21T00:39:52.257 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:39:52.318 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:39:52.318 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:39:52.319 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:39:52.319 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T00:39:52.320 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T00:39:52.474 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-09-21T00:40:22.478 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T00:40:22.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-21T00:40:22.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:41:22.482 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T00:41:31.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-21T00:41:31.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:41:31.927 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-21T00:41:32.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-21T00:41:32.338 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T00:41:32.338 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-21T00:41:32.354 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-508.el9.x86_64 2024-09-21T00:41:32.354 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T00:41:32.354 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:41:32.354 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:41:33.355 DEBUG:teuthology.parallel:result is None 2024-09-21T00:41:33.355 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T00:41:33.362 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T00:41:33.363 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:41:33.365 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:41:33.370 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:41:33.388 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T00:41:33.434 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T00:41:33.541 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T00:41:33.541 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:41:33.543 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:41:33.546 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:41:33.601 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T00:41:33.691 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T00:41:33.691 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:41:33.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:41:33.709 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:41:33.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:41:33.726 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:41:33.729 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:41:33.752 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:41:33.810 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:41:33.825 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:41:33.832 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:41:33.842 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:41:33.845 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:41:33.880 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:41:33.882 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T00:41:33.889 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T00:41:33.889 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:41:33.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:41:33.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:41:33.922 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T00:41:33.964 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T00:41:33.964 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:41:33.967 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:41:33.969 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:41:33.986 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:41:34.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:41:34.109 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:41:34.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:41:34.228 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:41:34.228 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:41:34.291 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:41:34.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:41:34.392 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:41:34.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:41:34.522 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:41:34.522 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:41:34.591 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:41:34.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:41:34.694 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:41:34.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:41:34.820 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:41:34.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:41:34.887 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-09-21T00:41:34.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-09-21T00:41:34.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-21T00:41:34.940 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:41:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:41:34.971 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:41:35.452 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T00:41:35.461 INFO:teuthology.task.internal:Starting timer... 2024-09-21T00:41:35.461 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T00:41:35.537 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T00:41:35.586 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T00:41:35.586 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-09-21T00:41:35.650 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-09-21T00:41:35.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2024-09-21T00:41:35.717 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2024-09-21T00:41:35.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-21T00:41:35.777 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-21T00:41:35.779 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T00:41:35.779 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-09-21T00:41:35.800 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-09-21T00:41:35.800 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2024-09-21T00:41:35.824 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2024-09-21T00:41:35.824 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-21T00:41:35.844 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-21T00:41:35.844 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi114.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-09-21T00:41:35.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:41:35.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:41:35.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:41:35.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:41:35.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:41:35.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:41:35.928 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T00:41:35.928 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:41:35.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:41:35.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:41:36.022 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T00:41:36.031 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T00:41:36.034 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T00:41:36.142 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T00:41:36.152 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T00:41:36.153 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi114.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T00:45:36.243 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-09-21T00:45:36.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-21T00:45:36.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:45:36.322 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-21T00:45:36.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-21T00:45:36.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:45:36.480 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-21T00:45:36.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-21T00:45:36.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T00:45:36.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:45:36.636 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-21T00:45:36.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T00:45:36.676 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T00:45:36.686 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T00:45:36.686 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:45:36.687 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:45:36.689 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:45:36.690 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:45:36.692 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T00:45:36.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T00:45:36.718 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:45:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:45:36.732 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:45:36.739 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:45:36.747 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T00:45:36.756 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2024-09-21T00:45:36.762 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T00:45:36.766 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-09-21T00:45:36.767 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2024-09-21T00:45:36.779 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-09-21T00:45:36.781 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:45:36.787 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-21T00:45:36.794 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:45:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:45:36.798 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-21T00:45:36.810 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:45:36.813 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T00:45:36.828 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T00:45:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:45:36.857 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:45:36.857 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-09-21T00:45:36.857 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.857 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.857 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.857 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.866 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:45:36.869 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:45:36.869 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-21T00:45:36.869 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.869 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.869 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.869 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.883 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-21T00:45:36.886 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T00:45:36.886 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-21T00:45:36.886 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.887 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.887 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.887 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T00:45:36.887 INFO:teuthology.run_tasks:Running task install... 2024-09-21T00:45:36.895 DEBUG:teuthology.task.install:project ceph 2024-09-21T00:45:36.895 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T00:45:36.895 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T00:45:36.895 INFO:teuthology.task.install:Using flavor: default 2024-09-21T00:45:36.900 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T00:45:36.900 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T00:45:36.900 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:45:36.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:36.902 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:45:36.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:36.903 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T00:45:36.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:45:37.054 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:45:37.054 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:45:37.057 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:45:37.057 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:45:37.063 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T00:45:37.063 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T00:45:37.163 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:45:37.164 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:45:37.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:45:37.179 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:45:37.179 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:45:37.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:45:37.181 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T00:45:37.181 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:45:37.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T00:45:37.191 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:45:37.191 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:45:37.207 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:45:37.207 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:45:37.208 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T00:45:37.208 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T00:45:37.260 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:45:37.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:45:37.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T00:45:37.338 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:45:37.348 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:45:37.349 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T00:45:37.405 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-09-21T00:45:37.406 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-09-21T00:45:37.412 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2024-09-21T00:45:37.414 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2024-09-21T00:45:37.414 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-21T00:45:37.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-21T00:45:37.638 INFO:teuthology.orchestra.run.smithi114.stdout:45 files removed 2024-09-21T00:45:37.639 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-21T00:45:37.643 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-09-21T00:45:37.665 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:45:37.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:45:37.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T00:45:38.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-21T00:45:38.221 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-21T00:45:38.237 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-21T00:45:38.505 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-21T00:45:38.529 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T00:45:38.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 69 kB/s | 24 kB 00:00 2024-09-21T00:45:38.772 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T00:45:38.804 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-21T00:45:38.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T00:45:39.421 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T00:45:40.397 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.3 MB 00:01 2024-09-21T00:45:40.421 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.3 MB 00:01 2024-09-21T00:45:42.156 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-21T00:45:46.189 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-09-21T00:45:47.965 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-21T00:45:49.263 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 20 MB 00:08 2024-09-21T00:45:49.533 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 19 kB 00:00 2024-09-21T00:45:50.729 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-21T00:45:51.640 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-21T00:45:53.191 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-21T00:45:55.081 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 13 MB/s | 23 MB 00:01 2024-09-21T00:45:55.089 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-21T00:45:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T00:45:56.832 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-21T00:45:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:45:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:45:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:45:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:45:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:45:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:45:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:45:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:45:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:45:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:45:58.464 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:45:58.465 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:45:58.466 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:45:58.467 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:45:58.468 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:45:58.469 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:45:58.470 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:45:58.471 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:45:58.472 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:45:58.473 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:45:58.474 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:45:58.475 INFO:teuthology.orchestra.run.smithi114.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:Installing weak dependencies: 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:======================================================================================= 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:Install 149 Packages 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 8 Packages 2024-09-21T00:45:58.476 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:45:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 228 M 2024-09-21T00:45:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-21T00:45:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-21T00:45:59.306 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 23 MB 00:02 2024-09-21T00:45:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 873 kB 00:00 2024-09-21T00:45:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T00:45:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T00:45:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-09-21T00:45:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-21T00:46:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-21T00:46:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T00:46:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 609 kB/s | 25 kB 00:00 2024-09-21T00:46:00.601 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 6.4 kB/s | 1.7 kB 00:00 2024-09-21T00:46:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 16 MB/s | 18 MB 00:01 2024-09-21T00:46:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T00:46:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 463 kB/s | 27 kB 00:00 2024-09-21T00:46:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:(13/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.4 MB/s | 226 kB 00:00 2024-09-21T00:46:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 543 kB/s | 32 kB 00:00 2024-09-21T00:46:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T00:46:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.9 MB/s | 766 kB 00:00 2024-09-21T00:46:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T00:46:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T00:46:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 602 kB/s | 45 kB 00:00 2024-09-21T00:46:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T00:46:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T00:46:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-21T00:46:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.7 MB/s | 321 kB 00:00 2024-09-21T00:46:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T00:46:01.627 INFO:teuthology.orchestra.run.smithi114.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T00:46:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T00:46:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T00:46:01.828 INFO:teuthology.orchestra.run.smithi114.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 15 MB/s | 3.1 MB 00:00 2024-09-21T00:46:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 274 kB/s | 34 kB 00:00 2024-09-21T00:46:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T00:46:02.246 INFO:teuthology.orchestra.run.smithi114.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 21 MB/s | 40 MB 00:01 2024-09-21T00:46:02.296 INFO:teuthology.orchestra.run.smithi114.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.8 MB/s | 292 kB 00:00 2024-09-21T00:46:02.372 INFO:teuthology.orchestra.run.smithi114.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 653 kB/s | 49 kB 00:00 2024-09-21T00:46:02.472 INFO:teuthology.orchestra.run.smithi114.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T00:46:02.497 INFO:teuthology.orchestra.run.smithi114.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 132 kB/s | 16 kB 00:00 2024-09-21T00:46:02.531 INFO:teuthology.orchestra.run.smithi114.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T00:46:02.598 INFO:teuthology.orchestra.run.smithi114.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T00:46:02.631 INFO:teuthology.orchestra.run.smithi114.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 5.7 MB/s | 784 kB 00:00 2024-09-21T00:46:02.721 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:46:02.722 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:46:02.735 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:46:02.737 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:46:02.738 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:46:02.739 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:46:02.741 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:46:02.743 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:46:02.744 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:46:02.773 INFO:teuthology.orchestra.run.smithi114.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T00:46:02.809 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:46:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:46:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:46:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:46:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:46:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:46:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:46:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:46:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:46:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:46:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:46:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:46:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-21T00:46:02.842 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-09-21T00:46:02.843 INFO:teuthology.orchestra.run.smithi134.stdout:Install 149 Packages 2024-09-21T00:46:02.843 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 8 Packages 2024-09-21T00:46:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:46:02.843 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 228 M 2024-09-21T00:46:02.843 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-21T00:46:02.865 INFO:teuthology.orchestra.run.smithi114.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 299 kB/s | 80 kB 00:00 2024-09-21T00:46:02.924 INFO:teuthology.orchestra.run.smithi114.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T00:46:02.983 INFO:teuthology.orchestra.run.smithi114.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T00:46:03.016 INFO:teuthology.orchestra.run.smithi114.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-21T00:46:03.058 INFO:teuthology.orchestra.run.smithi114.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 9.1 MB/s | 1.2 MB 00:00 2024-09-21T00:46:03.084 INFO:teuthology.orchestra.run.smithi114.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-21T00:46:03.109 INFO:teuthology.orchestra.run.smithi114.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-21T00:46:03.134 INFO:teuthology.orchestra.run.smithi114.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-21T00:46:03.168 INFO:teuthology.orchestra.run.smithi114.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T00:46:03.469 INFO:teuthology.orchestra.run.smithi134.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-21T00:46:03.736 INFO:teuthology.orchestra.run.smithi134.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.2 MB/s | 873 kB 00:00 2024-09-21T00:46:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T00:46:03.843 INFO:teuthology.orchestra.run.smithi114.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-09-21T00:46:03.853 INFO:teuthology.orchestra.run.smithi134.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.2 MB/s | 148 kB 00:00 2024-09-21T00:46:03.993 INFO:teuthology.orchestra.run.smithi114.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 779 kB/s | 689 kB 00:00 2024-09-21T00:46:04.003 INFO:teuthology.orchestra.run.smithi134.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 13 MB/s | 2.3 MB 00:00 2024-09-21T00:46:04.035 INFO:teuthology.orchestra.run.smithi114.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-21T00:46:04.179 INFO:teuthology.orchestra.run.smithi134.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 4.7 MB/s | 1.5 MB 00:00 2024-09-21T00:46:04.385 INFO:teuthology.orchestra.run.smithi114.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-09-21T00:46:04.396 INFO:teuthology.orchestra.run.smithi134.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 19 MB/s | 20 MB 00:01 2024-09-21T00:46:04.471 INFO:teuthology.orchestra.run.smithi134.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-21T00:46:04.521 INFO:teuthology.orchestra.run.smithi134.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 505 kB/s | 25 kB 00:00 2024-09-21T00:46:04.577 INFO:teuthology.orchestra.run.smithi114.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 60 kB/s | 33 kB 00:00 2024-09-21T00:46:04.769 INFO:teuthology.orchestra.run.smithi114.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 404 kB/s | 313 kB 00:00 2024-09-21T00:46:04.830 INFO:teuthology.orchestra.run.smithi134.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 24 MB/s | 10 MB 00:00 2024-09-21T00:46:04.880 INFO:teuthology.orchestra.run.smithi134.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T00:46:04.947 INFO:teuthology.orchestra.run.smithi134.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 406 kB/s | 27 kB 00:00 2024-09-21T00:46:04.983 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-21T00:46:05.014 INFO:teuthology.orchestra.run.smithi134.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 478 kB/s | 32 kB 00:00 2024-09-21T00:46:05.103 INFO:teuthology.orchestra.run.smithi114.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-09-21T00:46:05.105 INFO:teuthology.orchestra.run.smithi134.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T00:46:05.181 INFO:teuthology.orchestra.run.smithi134.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T00:46:05.236 INFO:teuthology.orchestra.run.smithi114.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-21T00:46:05.273 INFO:teuthology.orchestra.run.smithi134.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.4 MB/s | 127 kB 00:00 2024-09-21T00:46:05.390 INFO:teuthology.orchestra.run.smithi134.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 4.2 MB/s | 507 kB 00:00 2024-09-21T00:46:05.445 INFO:teuthology.orchestra.run.smithi114.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-21T00:46:05.623 INFO:teuthology.orchestra.run.smithi134.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T00:46:05.674 INFO:teuthology.orchestra.run.smithi134.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 908 kB/s | 45 kB 00:00 2024-09-21T00:46:05.782 INFO:teuthology.orchestra.run.smithi134.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.3 MB 00:00 2024-09-21T00:46:05.807 INFO:teuthology.orchestra.run.smithi134.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.1 MB/s | 148 kB 00:00 2024-09-21T00:46:05.833 INFO:teuthology.orchestra.run.smithi134.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T00:46:05.858 INFO:teuthology.orchestra.run.smithi134.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.2 MB/s | 321 kB 00:00 2024-09-21T00:46:05.882 INFO:teuthology.orchestra.run.smithi134.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.1 MB/s | 307 kB 00:00 2024-09-21T00:46:05.907 INFO:teuthology.orchestra.run.smithi134.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 2.0 MB/s | 99 kB 00:00 2024-09-21T00:46:05.928 INFO:teuthology.orchestra.run.smithi114.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 207 kB/s | 171 kB 00:00 2024-09-21T00:46:05.932 INFO:teuthology.orchestra.run.smithi134.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T00:46:05.992 INFO:teuthology.orchestra.run.smithi134.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T00:46:06.029 INFO:teuthology.orchestra.run.smithi114.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 202 kB/s | 160 kB 00:00 2024-09-21T00:46:06.062 INFO:teuthology.orchestra.run.smithi114.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-09-21T00:46:06.334 INFO:teuthology.orchestra.run.smithi134.stdout:(28/157): ceph-test-19.3.0-5120.g18432218.el9.x 22 MB/s | 40 MB 00:01 2024-09-21T00:46:06.359 INFO:teuthology.orchestra.run.smithi134.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 93 kB/s | 34 kB 00:00 2024-09-21T00:46:06.384 INFO:teuthology.orchestra.run.smithi134.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T00:46:06.442 INFO:teuthology.orchestra.run.smithi134.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 5.8 MB/s | 3.1 MB 00:00 2024-09-21T00:46:06.518 INFO:teuthology.orchestra.run.smithi134.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.8 MB/s | 292 kB 00:00 2024-09-21T00:46:06.576 INFO:teuthology.orchestra.run.smithi134.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 851 kB/s | 49 kB 00:00 2024-09-21T00:46:06.596 INFO:teuthology.orchestra.run.smithi114.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-21T00:46:06.635 INFO:teuthology.orchestra.run.smithi134.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 282 kB/s | 16 kB 00:00 2024-09-21T00:46:06.744 INFO:teuthology.orchestra.run.smithi134.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 21 MB/s | 7.4 MB 00:00 2024-09-21T00:46:06.769 INFO:teuthology.orchestra.run.smithi134.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.1 MB/s | 285 kB 00:00 2024-09-21T00:46:06.811 INFO:teuthology.orchestra.run.smithi134.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T00:46:06.836 INFO:teuthology.orchestra.run.smithi134.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T00:46:07.112 INFO:teuthology.orchestra.run.smithi134.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 19 MB/s | 14 MB 00:00 2024-09-21T00:46:07.171 INFO:teuthology.orchestra.run.smithi114.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 83 kB/s | 47 kB 00:00 2024-09-21T00:46:07.228 INFO:teuthology.orchestra.run.smithi134.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 191 kB/s | 80 kB 00:00 2024-09-21T00:46:07.235 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:46:07.236 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T00:46:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 506 kB/s | 662 kB 00:01 2024-09-21T00:46:07.248 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T00:46:07.249 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T00:46:07.250 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T00:46:07.250 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T00:46:07.252 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T00:46:07.255 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T00:46:07.255 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T00:46:07.322 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-21T00:46:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 441 kB/s | 581 kB 00:01 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T00:46:07.349 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T00:46:07.350 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T00:46:07.351 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T00:46:07.352 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T00:46:07.353 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T00:46:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T00:46:07.355 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T00:46:07.356 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T00:46:07.357 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T00:46:07.358 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T00:46:07.359 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T00:46:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-21T00:46:07.361 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-21T00:46:07.362 INFO:teuthology.orchestra.run.smithi047.stdout:Install 149 Packages 2024-09-21T00:46:07.362 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 8 Packages 2024-09-21T00:46:07.362 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:46:07.362 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 228 M 2024-09-21T00:46:07.362 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-21T00:46:07.603 INFO:teuthology.orchestra.run.smithi134.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-21T00:46:07.637 INFO:teuthology.orchestra.run.smithi134.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 619 kB/s | 253 kB 00:00 2024-09-21T00:46:07.679 INFO:teuthology.orchestra.run.smithi134.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 337 kB/s | 191 kB 00:00 2024-09-21T00:46:07.746 INFO:teuthology.orchestra.run.smithi134.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-09-21T00:46:07.821 INFO:teuthology.orchestra.run.smithi134.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 952 kB/s | 135 kB 00:00 2024-09-21T00:46:07.859 INFO:teuthology.orchestra.run.smithi134.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-21T00:46:07.905 INFO:teuthology.orchestra.run.smithi114.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-21T00:46:07.997 INFO:teuthology.orchestra.run.smithi134.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-21T00:46:08.031 INFO:teuthology.orchestra.run.smithi134.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.0 MB/s | 215 kB 00:00 2024-09-21T00:46:08.064 INFO:teuthology.orchestra.run.smithi114.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 228 kB/s | 188 kB 00:00 2024-09-21T00:46:08.089 INFO:teuthology.orchestra.run.smithi114.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 319 kB/s | 292 kB 00:00 2024-09-21T00:46:08.093 INFO:teuthology.orchestra.run.smithi047.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 55 kB/s | 6.6 kB 00:00 2024-09-21T00:46:08.164 INFO:teuthology.orchestra.run.smithi134.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-21T00:46:08.206 INFO:teuthology.orchestra.run.smithi134.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 610 kB/s | 107 kB 00:00 2024-09-21T00:46:08.231 INFO:teuthology.orchestra.run.smithi134.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-21T00:46:08.268 INFO:teuthology.orchestra.run.smithi047.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-21T00:46:08.281 INFO:teuthology.orchestra.run.smithi134.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-21T00:46:08.307 INFO:teuthology.orchestra.run.smithi134.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-21T00:46:08.332 INFO:teuthology.orchestra.run.smithi134.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-21T00:46:08.335 INFO:teuthology.orchestra.run.smithi047.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T00:46:08.357 INFO:teuthology.orchestra.run.smithi134.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-21T00:46:08.383 INFO:teuthology.orchestra.run.smithi134.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-21T00:46:08.408 INFO:teuthology.orchestra.run.smithi134.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T00:46:08.427 INFO:teuthology.orchestra.run.smithi047.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-21T00:46:08.433 INFO:teuthology.orchestra.run.smithi134.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T00:46:08.450 INFO:teuthology.orchestra.run.smithi134.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T00:46:08.544 INFO:teuthology.orchestra.run.smithi047.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T00:46:08.575 INFO:teuthology.orchestra.run.smithi134.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-21T00:46:08.586 INFO:teuthology.orchestra.run.smithi047.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-09-21T00:46:08.600 INFO:teuthology.orchestra.run.smithi134.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-21T00:46:08.617 INFO:teuthology.orchestra.run.smithi134.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 586 kB/s | 24 kB 00:00 2024-09-21T00:46:08.726 INFO:teuthology.orchestra.run.smithi134.stdout:(63/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T00:46:08.768 INFO:teuthology.orchestra.run.smithi134.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 284 kB/s | 47 kB 00:00 2024-09-21T00:46:08.835 INFO:teuthology.orchestra.run.smithi134.stdout:(65/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.4 MB/s | 3.0 MB 00:00 2024-09-21T00:46:08.860 INFO:teuthology.orchestra.run.smithi134.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-21T00:46:08.885 INFO:teuthology.orchestra.run.smithi134.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-21T00:46:08.886 INFO:teuthology.orchestra.run.smithi047.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.0 MB 00:00 2024-09-21T00:46:09.081 INFO:teuthology.orchestra.run.smithi114.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-21T00:46:09.170 INFO:teuthology.orchestra.run.smithi047.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T00:46:09.212 INFO:teuthology.orchestra.run.smithi047.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 607 kB/s | 25 kB 00:00 2024-09-21T00:46:09.214 INFO:teuthology.orchestra.run.smithi114.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-21T00:46:09.282 INFO:teuthology.orchestra.run.smithi114.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-09-21T00:46:09.303 INFO:teuthology.orchestra.run.smithi134.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.8 MB/s | 1.6 MB 00:00 2024-09-21T00:46:09.586 INFO:teuthology.orchestra.run.smithi134.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.1 MB/s | 910 kB 00:00 2024-09-21T00:46:09.620 INFO:teuthology.orchestra.run.smithi047.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T00:46:09.678 INFO:teuthology.orchestra.run.smithi134.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T00:46:09.736 INFO:teuthology.orchestra.run.smithi134.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-09-21T00:46:09.737 INFO:teuthology.orchestra.run.smithi047.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T00:46:09.763 INFO:teuthology.orchestra.run.smithi047.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T00:46:09.788 INFO:teuthology.orchestra.run.smithi047.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 537 kB/s | 27 kB 00:00 2024-09-21T00:46:09.805 INFO:teuthology.orchestra.run.smithi047.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 757 kB/s | 32 kB 00:00 2024-09-21T00:46:09.855 INFO:teuthology.orchestra.run.smithi047.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T00:46:09.889 INFO:teuthology.orchestra.run.smithi047.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 766 kB 00:00 2024-09-21T00:46:09.914 INFO:teuthology.orchestra.run.smithi047.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T00:46:09.932 INFO:teuthology.orchestra.run.smithi114.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 192 kB/s | 137 kB 00:00 2024-09-21T00:46:09.945 INFO:teuthology.orchestra.run.smithi134.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-09-21T00:46:09.956 INFO:teuthology.orchestra.run.smithi047.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T00:46:10.004 INFO:teuthology.orchestra.run.smithi134.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T00:46:10.023 INFO:teuthology.orchestra.run.smithi047.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 678 kB/s | 45 kB 00:00 2024-09-21T00:46:10.049 INFO:teuthology.orchestra.run.smithi114.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 940 kB/s | 910 kB 00:00 2024-09-21T00:46:10.090 INFO:teuthology.orchestra.run.smithi047.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T00:46:10.157 INFO:teuthology.orchestra.run.smithi047.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T00:46:10.265 INFO:teuthology.orchestra.run.smithi047.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-21T00:46:10.291 INFO:teuthology.orchestra.run.smithi047.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.4 MB/s | 321 kB 00:00 2024-09-21T00:46:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T00:46:10.350 INFO:teuthology.orchestra.run.smithi047.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T00:46:10.375 INFO:teuthology.orchestra.run.smithi047.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T00:46:10.416 INFO:teuthology.orchestra.run.smithi114.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-09-21T00:46:10.425 INFO:teuthology.orchestra.run.smithi047.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T00:46:10.484 INFO:teuthology.orchestra.run.smithi047.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 588 kB/s | 34 kB 00:00 2024-09-21T00:46:10.551 INFO:teuthology.orchestra.run.smithi047.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T00:46:10.609 INFO:teuthology.orchestra.run.smithi047.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T00:46:10.679 INFO:teuthology.orchestra.run.smithi134.stdout:(74/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.7 MB/s | 4.9 MB 00:01 2024-09-21T00:46:10.699 INFO:teuthology.orchestra.run.smithi114.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 135 kB/s | 87 kB 00:00 2024-09-21T00:46:10.729 INFO:teuthology.orchestra.run.smithi134.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T00:46:10.871 INFO:teuthology.orchestra.run.smithi134.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T00:46:10.883 INFO:teuthology.orchestra.run.smithi114.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-21T00:46:11.080 INFO:teuthology.orchestra.run.smithi134.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.5 MB/s | 6.0 MB 00:01 2024-09-21T00:46:11.085 INFO:teuthology.orchestra.run.smithi047.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 21 MB/s | 40 MB 00:01 2024-09-21T00:46:11.105 INFO:teuthology.orchestra.run.smithi134.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.0 MB/s | 248 kB 00:00 2024-09-21T00:46:11.135 INFO:teuthology.orchestra.run.smithi047.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T00:46:11.138 INFO:teuthology.orchestra.run.smithi134.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-21T00:46:11.155 INFO:teuthology.orchestra.run.smithi134.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T00:46:11.193 INFO:teuthology.orchestra.run.smithi047.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 850 kB/s | 49 kB 00:00 2024-09-21T00:46:11.197 INFO:teuthology.orchestra.run.smithi134.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-09-21T00:46:11.223 INFO:teuthology.orchestra.run.smithi134.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T00:46:11.244 INFO:teuthology.orchestra.run.smithi047.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 330 kB/s | 16 kB 00:00 2024-09-21T00:46:11.298 INFO:teuthology.orchestra.run.smithi134.stdout:(83/157): postgresql-server-13.16-1.el9.x86_64. 3.6 MB/s | 5.8 MB 00:01 2024-09-21T00:46:11.336 INFO:teuthology.orchestra.run.smithi047.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-21T00:46:11.340 INFO:teuthology.orchestra.run.smithi134.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T00:46:11.350 INFO:teuthology.orchestra.run.smithi114.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 94 kB/s | 61 kB 00:00 2024-09-21T00:46:11.361 INFO:teuthology.orchestra.run.smithi047.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.4 MB/s | 285 kB 00:00 2024-09-21T00:46:11.398 INFO:teuthology.orchestra.run.smithi134.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-21T00:46:11.424 INFO:teuthology.orchestra.run.smithi134.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 925 kB/s | 77 kB 00:00 2024-09-21T00:46:11.449 INFO:teuthology.orchestra.run.smithi134.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-21T00:46:11.508 INFO:teuthology.orchestra.run.smithi134.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-21T00:46:11.511 INFO:teuthology.orchestra.run.smithi047.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T00:46:11.536 INFO:teuthology.orchestra.run.smithi047.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 105 kB/s | 18 kB 00:00 2024-09-21T00:46:11.550 INFO:teuthology.orchestra.run.smithi134.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-21T00:46:11.562 INFO:teuthology.orchestra.run.smithi047.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.4 MB/s | 784 kB 00:00 2024-09-21T00:46:11.600 INFO:teuthology.orchestra.run.smithi114.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-21T00:46:11.608 INFO:teuthology.orchestra.run.smithi134.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-21T00:46:11.633 INFO:teuthology.orchestra.run.smithi134.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 611 kB/s | 51 kB 00:00 2024-09-21T00:46:11.667 INFO:teuthology.orchestra.run.smithi134.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 917 kB/s | 54 kB 00:00 2024-09-21T00:46:11.725 INFO:teuthology.orchestra.run.smithi114.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 291 kB/s | 245 kB 00:00 2024-09-21T00:46:11.726 INFO:teuthology.orchestra.run.smithi134.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 715 kB/s | 42 kB 00:00 2024-09-21T00:46:11.776 INFO:teuthology.orchestra.run.smithi134.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 888 kB/s | 44 kB 00:00 2024-09-21T00:46:11.851 INFO:teuthology.orchestra.run.smithi134.stdout:(95/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.8 MB/s | 5.1 MB 00:00 2024-09-21T00:46:11.901 INFO:teuthology.orchestra.run.smithi134.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-21T00:46:11.927 INFO:teuthology.orchestra.run.smithi134.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-09-21T00:46:11.960 INFO:teuthology.orchestra.run.smithi134.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-21T00:46:11.985 INFO:teuthology.orchestra.run.smithi134.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T00:46:12.011 INFO:teuthology.orchestra.run.smithi134.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T00:46:12.012 INFO:teuthology.orchestra.run.smithi047.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 160 kB/s | 80 kB 00:00 2024-09-21T00:46:12.036 INFO:teuthology.orchestra.run.smithi134.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T00:46:12.070 INFO:teuthology.orchestra.run.smithi134.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T00:46:12.095 INFO:teuthology.orchestra.run.smithi134.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-21T00:46:12.142 INFO:teuthology.orchestra.run.smithi114.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 313 kB/s | 248 kB 00:00 2024-09-21T00:46:12.167 INFO:teuthology.orchestra.run.smithi114.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-09-21T00:46:12.170 INFO:teuthology.orchestra.run.smithi134.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-21T00:46:12.171 INFO:teuthology.orchestra.run.smithi047.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 314 kB/s | 191 kB 00:00 2024-09-21T00:46:12.201 INFO:teuthology.orchestra.run.smithi114.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-21T00:46:12.229 INFO:teuthology.orchestra.run.smithi134.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T00:46:12.271 INFO:teuthology.orchestra.run.smithi134.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-21T00:46:12.304 INFO:teuthology.orchestra.run.smithi134.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 4.0 MB/s | 308 kB 00:00 2024-09-21T00:46:12.330 INFO:teuthology.orchestra.run.smithi134.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-21T00:46:12.355 INFO:teuthology.orchestra.run.smithi134.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T00:46:12.380 INFO:teuthology.orchestra.run.smithi134.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T00:46:12.387 INFO:teuthology.orchestra.run.smithi047.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 942 kB/s | 801 kB 00:00 2024-09-21T00:46:12.405 INFO:teuthology.orchestra.run.smithi134.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T00:46:12.439 INFO:teuthology.orchestra.run.smithi134.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T00:46:12.449 INFO:teuthology.orchestra.run.smithi047.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 580 kB/s | 253 kB 00:00 2024-09-21T00:46:12.498 INFO:teuthology.orchestra.run.smithi134.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T00:46:12.505 INFO:teuthology.orchestra.run.smithi047.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 909 kB/s | 106 kB 00:00 2024-09-21T00:46:12.563 INFO:teuthology.orchestra.run.smithi047.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-21T00:46:12.573 INFO:teuthology.orchestra.run.smithi134.stdout:(114/157): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-21T00:46:12.598 INFO:teuthology.orchestra.run.smithi134.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-21T00:46:12.614 INFO:teuthology.orchestra.run.smithi047.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-21T00:46:12.623 INFO:teuthology.orchestra.run.smithi134.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-09-21T00:46:12.649 INFO:teuthology.orchestra.run.smithi134.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-21T00:46:12.664 INFO:teuthology.orchestra.run.smithi047.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-09-21T00:46:12.674 INFO:teuthology.orchestra.run.smithi134.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T00:46:12.689 INFO:teuthology.orchestra.run.smithi047.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-21T00:46:12.699 INFO:teuthology.orchestra.run.smithi134.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T00:46:12.718 INFO:teuthology.orchestra.run.smithi114.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-21T00:46:12.733 INFO:teuthology.orchestra.run.smithi134.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T00:46:12.758 INFO:teuthology.orchestra.run.smithi134.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T00:46:12.784 INFO:teuthology.orchestra.run.smithi134.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T00:46:12.798 INFO:teuthology.orchestra.run.smithi047.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-21T00:46:12.817 INFO:teuthology.orchestra.run.smithi134.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-21T00:46:12.823 INFO:teuthology.orchestra.run.smithi047.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 800 kB/s | 107 kB 00:00 2024-09-21T00:46:12.842 INFO:teuthology.orchestra.run.smithi134.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T00:46:12.848 INFO:teuthology.orchestra.run.smithi047.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-21T00:46:12.860 INFO:teuthology.orchestra.run.smithi114.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 240 kB/s | 172 kB 00:00 2024-09-21T00:46:12.868 INFO:teuthology.orchestra.run.smithi134.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-21T00:46:12.882 INFO:teuthology.orchestra.run.smithi047.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-21T00:46:12.893 INFO:teuthology.orchestra.run.smithi134.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-09-21T00:46:12.907 INFO:teuthology.orchestra.run.smithi047.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-21T00:46:12.918 INFO:teuthology.orchestra.run.smithi134.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-21T00:46:12.935 INFO:teuthology.orchestra.run.smithi134.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T00:46:12.992 INFO:teuthology.orchestra.run.smithi047.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-21T00:46:13.016 INFO:teuthology.orchestra.run.smithi047.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-21T00:46:13.035 INFO:teuthology.orchestra.run.smithi134.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.4 MB/s | 2.0 MB 00:00 2024-09-21T00:46:13.041 INFO:teuthology.orchestra.run.smithi047.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 228 kB/s | 11 kB 00:00 2024-09-21T00:46:13.052 INFO:teuthology.orchestra.run.smithi134.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T00:46:13.067 INFO:teuthology.orchestra.run.smithi047.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T00:46:13.078 INFO:teuthology.orchestra.run.smithi134.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:46:13.092 INFO:teuthology.orchestra.run.smithi047.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T00:46:13.112 INFO:teuthology.orchestra.run.smithi134.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T00:46:13.117 INFO:teuthology.orchestra.run.smithi047.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-21T00:46:13.137 INFO:teuthology.orchestra.run.smithi134.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 982 kB/s | 58 kB 00:00 2024-09-21T00:46:13.162 INFO:teuthology.orchestra.run.smithi134.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T00:46:13.176 INFO:teuthology.orchestra.run.smithi047.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-09-21T00:46:13.196 INFO:teuthology.orchestra.run.smithi134.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-21T00:46:13.209 INFO:teuthology.orchestra.run.smithi047.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-21T00:46:13.230 INFO:teuthology.orchestra.run.smithi134.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-21T00:46:13.235 INFO:teuthology.orchestra.run.smithi047.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T00:46:13.255 INFO:teuthology.orchestra.run.smithi134.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 484 kB/s | 28 kB 00:00 2024-09-21T00:46:13.268 INFO:teuthology.orchestra.run.smithi047.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-09-21T00:46:13.280 INFO:teuthology.orchestra.run.smithi134.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T00:46:13.293 INFO:teuthology.orchestra.run.smithi047.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-21T00:46:13.319 INFO:teuthology.orchestra.run.smithi047.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T00:46:13.330 INFO:teuthology.orchestra.run.smithi134.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T00:46:13.344 INFO:teuthology.orchestra.run.smithi047.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-21T00:46:13.356 INFO:teuthology.orchestra.run.smithi134.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T00:46:13.369 INFO:teuthology.orchestra.run.smithi047.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T00:46:13.377 INFO:teuthology.orchestra.run.smithi114.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-09-21T00:46:13.389 INFO:teuthology.orchestra.run.smithi134.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-21T00:46:13.414 INFO:teuthology.orchestra.run.smithi134.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-21T00:46:13.440 INFO:teuthology.orchestra.run.smithi134.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T00:46:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T00:46:13.478 INFO:teuthology.orchestra.run.smithi047.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-21T00:46:13.490 INFO:teuthology.orchestra.run.smithi134.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-21T00:46:13.494 INFO:teuthology.orchestra.run.smithi114.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 323 kB/s | 250 kB 00:00 2024-09-21T00:46:13.516 INFO:teuthology.orchestra.run.smithi134.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T00:46:13.520 INFO:teuthology.orchestra.run.smithi047.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T00:46:13.549 INFO:teuthology.orchestra.run.smithi134.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-21T00:46:13.553 INFO:teuthology.orchestra.run.smithi047.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T00:46:13.570 INFO:teuthology.orchestra.run.smithi047.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-21T00:46:13.608 INFO:teuthology.orchestra.run.smithi134.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T00:46:13.669 INFO:teuthology.orchestra.run.smithi114.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 275 kB/s | 222 kB 00:00 2024-09-21T00:46:13.687 INFO:teuthology.orchestra.run.smithi047.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.7 MB/s | 1.0 MB 00:00 2024-09-21T00:46:13.771 INFO:teuthology.orchestra.run.smithi047.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-21T00:46:13.796 INFO:teuthology.orchestra.run.smithi047.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 804 kB/s | 87 kB 00:00 2024-09-21T00:46:13.800 INFO:teuthology.orchestra.run.smithi134.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T00:46:13.863 INFO:teuthology.orchestra.run.smithi047.stdout:(75/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-09-21T00:46:13.889 INFO:teuthology.orchestra.run.smithi047.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 666 kB/s | 61 kB 00:00 2024-09-21T00:46:13.914 INFO:teuthology.orchestra.run.smithi047.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-21T00:46:13.939 INFO:teuthology.orchestra.run.smithi047.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T00:46:13.950 INFO:teuthology.orchestra.run.smithi134.stdout:(150/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.0 MB/s | 16 MB 00:02 2024-09-21T00:46:13.964 INFO:teuthology.orchestra.run.smithi047.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-21T00:46:13.981 INFO:teuthology.orchestra.run.smithi047.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 458 kB/s | 19 kB 00:00 2024-09-21T00:46:14.006 INFO:teuthology.orchestra.run.smithi047.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-21T00:46:14.017 INFO:teuthology.orchestra.run.smithi134.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.7 MB/s | 3.2 MB 00:00 2024-09-21T00:46:14.020 INFO:teuthology.orchestra.run.smithi114.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-09-21T00:46:14.023 INFO:teuthology.orchestra.run.smithi047.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 829 kB/s | 35 kB 00:00 2024-09-21T00:46:14.074 INFO:teuthology.orchestra.run.smithi047.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-21T00:46:14.103 INFO:teuthology.orchestra.run.smithi114.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 69 kB/s | 42 kB 00:00 2024-09-21T00:46:14.166 INFO:teuthology.orchestra.run.smithi047.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T00:46:14.191 INFO:teuthology.orchestra.run.smithi047.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T00:46:14.216 INFO:teuthology.orchestra.run.smithi047.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T00:46:14.242 INFO:teuthology.orchestra.run.smithi047.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-21T00:46:14.267 INFO:teuthology.orchestra.run.smithi047.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T00:46:14.292 INFO:teuthology.orchestra.run.smithi047.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T00:46:14.317 INFO:teuthology.orchestra.run.smithi047.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T00:46:14.343 INFO:teuthology.orchestra.run.smithi047.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T00:46:14.368 INFO:teuthology.orchestra.run.smithi047.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T00:46:14.392 INFO:teuthology.orchestra.run.smithi134.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 109 kB/s | 41 kB 00:00 2024-09-21T00:46:14.445 INFO:teuthology.orchestra.run.smithi114.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 348 kB/s | 269 kB 00:00 2024-09-21T00:46:14.451 INFO:teuthology.orchestra.run.smithi047.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-21T00:46:14.477 INFO:teuthology.orchestra.run.smithi047.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-21T00:46:14.502 INFO:teuthology.orchestra.run.smithi047.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-21T00:46:14.527 INFO:teuthology.orchestra.run.smithi047.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T00:46:14.552 INFO:teuthology.orchestra.run.smithi047.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-21T00:46:14.578 INFO:teuthology.orchestra.run.smithi047.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-21T00:46:14.603 INFO:teuthology.orchestra.run.smithi047.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T00:46:14.628 INFO:teuthology.orchestra.run.smithi047.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T00:46:14.654 INFO:teuthology.orchestra.run.smithi047.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T00:46:14.679 INFO:teuthology.orchestra.run.smithi047.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T00:46:14.704 INFO:teuthology.orchestra.run.smithi047.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-21T00:46:14.745 INFO:teuthology.orchestra.run.smithi114.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 219 kB/s | 159 kB 00:00 2024-09-21T00:46:14.776 INFO:teuthology.orchestra.run.smithi134.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 649 kB/s | 249 kB 00:00 2024-09-21T00:46:14.805 INFO:teuthology.orchestra.run.smithi047.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-21T00:46:14.856 INFO:teuthology.orchestra.run.smithi047.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T00:46:14.880 INFO:teuthology.orchestra.run.smithi114.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 360 kB/s | 279 kB 00:00 2024-09-21T00:46:14.888 INFO:teuthology.orchestra.run.smithi047.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T00:46:14.914 INFO:teuthology.orchestra.run.smithi047.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T00:46:14.948 INFO:teuthology.orchestra.run.smithi047.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-21T00:46:14.951 INFO:teuthology.orchestra.run.smithi134.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2024-09-21T00:46:15.068 INFO:teuthology.orchestra.run.smithi134.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.6 MB/s | 1.8 MB 00:01 2024-09-21T00:46:15.082 INFO:teuthology.orchestra.run.smithi047.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-09-21T00:46:15.087 INFO:teuthology.orchestra.run.smithi114.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-09-21T00:46:15.106 INFO:teuthology.orchestra.run.smithi047.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T00:46:15.227 INFO:teuthology.orchestra.run.smithi134.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 3.0 MB/s | 1.4 MB 00:00 2024-09-21T00:46:15.266 INFO:teuthology.orchestra.run.smithi047.stdout:(111/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-21T00:46:15.291 INFO:teuthology.orchestra.run.smithi047.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 367 kB/s | 67 kB 00:00 2024-09-21T00:46:15.302 INFO:teuthology.orchestra.run.smithi134.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.8 MB/s | 2.4 MB 00:00 2024-09-21T00:46:15.307 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:15.307 INFO:teuthology.orchestra.run.smithi134.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-21T00:46:15.341 INFO:teuthology.orchestra.run.smithi047.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-21T00:46:15.346 INFO:teuthology.orchestra.run.smithi114.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-09-21T00:46:15.375 INFO:teuthology.orchestra.run.smithi047.stdout:(114/157): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-21T00:46:15.401 INFO:teuthology.orchestra.run.smithi047.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T00:46:15.425 INFO:teuthology.orchestra.run.smithi047.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T00:46:15.450 INFO:teuthology.orchestra.run.smithi047.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-21T00:46:15.477 INFO:teuthology.orchestra.run.smithi047.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-21T00:46:15.501 INFO:teuthology.orchestra.run.smithi047.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T00:46:15.568 INFO:teuthology.orchestra.run.smithi047.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-21T00:46:15.593 INFO:teuthology.orchestra.run.smithi047.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-21T00:46:15.618 INFO:teuthology.orchestra.run.smithi047.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T00:46:15.644 INFO:teuthology.orchestra.run.smithi047.stdout:(123/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-09-21T00:46:15.646 INFO:teuthology.orchestra.run.smithi114.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-21T00:46:15.661 INFO:teuthology.orchestra.run.smithi047.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-21T00:46:15.686 INFO:teuthology.orchestra.run.smithi047.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-09-21T00:46:15.711 INFO:teuthology.orchestra.run.smithi047.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-21T00:46:15.736 INFO:teuthology.orchestra.run.smithi047.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-21T00:46:15.761 INFO:teuthology.orchestra.run.smithi047.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T00:46:15.787 INFO:teuthology.orchestra.run.smithi047.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-21T00:46:15.812 INFO:teuthology.orchestra.run.smithi047.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T00:46:15.837 INFO:teuthology.orchestra.run.smithi047.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:46:15.863 INFO:teuthology.orchestra.run.smithi047.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T00:46:15.896 INFO:teuthology.orchestra.run.smithi047.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T00:46:15.922 INFO:teuthology.orchestra.run.smithi114.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 77 kB/s | 44 kB 00:00 2024-09-21T00:46:15.924 INFO:teuthology.orchestra.run.smithi047.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 653 kB/s | 16 kB 00:00 2024-09-21T00:46:15.955 INFO:teuthology.orchestra.run.smithi047.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T00:46:15.980 INFO:teuthology.orchestra.run.smithi047.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T00:46:16.006 INFO:teuthology.orchestra.run.smithi047.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-21T00:46:16.023 INFO:teuthology.orchestra.run.smithi047.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 736 kB/s | 31 kB 00:00 2024-09-21T00:46:16.040 INFO:teuthology.orchestra.run.smithi047.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-21T00:46:16.057 INFO:teuthology.orchestra.run.smithi047.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-21T00:46:16.082 INFO:teuthology.orchestra.run.smithi047.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T00:46:16.107 INFO:teuthology.orchestra.run.smithi047.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T00:46:16.133 INFO:teuthology.orchestra.run.smithi047.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T00:46:16.159 INFO:teuthology.orchestra.run.smithi047.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T00:46:16.208 INFO:teuthology.orchestra.run.smithi047.stdout:(145/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-21T00:46:16.233 INFO:teuthology.orchestra.run.smithi047.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-09-21T00:46:16.259 INFO:teuthology.orchestra.run.smithi047.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T00:46:16.284 INFO:teuthology.orchestra.run.smithi047.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T00:46:16.326 INFO:teuthology.orchestra.run.smithi047.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T00:46:16.498 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-21T00:46:16.538 INFO:teuthology.orchestra.run.smithi114.stdout:(96/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.8 MB/s | 16 MB 00:01 2024-09-21T00:46:16.559 INFO:teuthology.orchestra.run.smithi047.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 11 MB/s | 3.4 MB 00:00 2024-09-21T00:46:16.563 INFO:teuthology.orchestra.run.smithi114.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 241 kB/s | 221 kB 00:00 2024-09-21T00:46:16.650 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-21T00:46:16.650 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-21T00:46:16.701 INFO:teuthology.orchestra.run.smithi047.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.6 MB/s | 3.2 MB 00:00 2024-09-21T00:46:16.755 INFO:teuthology.orchestra.run.smithi114.stdout:(98/157): qatlib-service-24.02.0-1.el9.x86_64.r 43 kB/s | 36 kB 00:00 2024-09-21T00:46:17.077 INFO:teuthology.orchestra.run.smithi047.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 109 kB/s | 41 kB 00:00 2024-09-21T00:46:17.122 INFO:teuthology.orchestra.run.smithi114.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-21T00:46:17.356 INFO:teuthology.orchestra.run.smithi114.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 384 kB/s | 304 kB 00:00 2024-09-21T00:46:17.377 INFO:teuthology.orchestra.run.smithi047.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-09-21T00:46:17.398 INFO:teuthology.orchestra.run.smithi114.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 91 kB/s | 58 kB 00:00 2024-09-21T00:46:17.419 INFO:teuthology.orchestra.run.smithi047.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 2.1 MB/s | 1.8 MB 00:00 2024-09-21T00:46:17.485 INFO:teuthology.orchestra.run.smithi047.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 609 kB/s | 249 kB 00:00 2024-09-21T00:46:17.527 INFO:teuthology.orchestra.run.smithi047.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-21T00:46:17.807 INFO:teuthology.orchestra.run.smithi114.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-09-21T00:46:17.890 INFO:teuthology.orchestra.run.smithi114.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 269 kB/s | 22 kB 00:00 2024-09-21T00:46:17.965 INFO:teuthology.orchestra.run.smithi114.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-21T00:46:17.991 INFO:teuthology.orchestra.run.smithi114.stdout:(105/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-21T00:46:18.066 INFO:teuthology.orchestra.run.smithi114.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-21T00:46:18.100 INFO:teuthology.orchestra.run.smithi114.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-21T00:46:18.133 INFO:teuthology.orchestra.run.smithi114.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-21T00:46:18.158 INFO:teuthology.orchestra.run.smithi114.stdout:(109/157): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-09-21T00:46:18.184 INFO:teuthology.orchestra.run.smithi114.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T00:46:18.217 INFO:teuthology.orchestra.run.smithi114.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T00:46:18.251 INFO:teuthology.orchestra.run.smithi114.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-21T00:46:18.276 INFO:teuthology.orchestra.run.smithi114.stdout:(113/157): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-09-21T00:46:18.326 INFO:teuthology.orchestra.run.smithi114.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T00:46:18.352 INFO:teuthology.orchestra.run.smithi114.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T00:46:18.464 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-21T00:46:18.465 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-21T00:46:18.469 INFO:teuthology.orchestra.run.smithi047.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-21T00:46:18.476 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:18.476 INFO:teuthology.orchestra.run.smithi047.stdout:Total 21 MB/s | 228 MB 00:11 2024-09-21T00:46:18.494 INFO:teuthology.orchestra.run.smithi114.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 227 kB/s | 32 kB 00:00 2024-09-21T00:46:18.519 INFO:teuthology.orchestra.run.smithi114.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-09-21T00:46:18.536 INFO:teuthology.orchestra.run.smithi114.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-21T00:46:18.586 INFO:teuthology.orchestra.run.smithi114.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-21T00:46:18.611 INFO:teuthology.orchestra.run.smithi114.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-21T00:46:18.637 INFO:teuthology.orchestra.run.smithi114.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T00:46:18.662 INFO:teuthology.orchestra.run.smithi114.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T00:46:18.687 INFO:teuthology.orchestra.run.smithi114.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T00:46:18.704 INFO:teuthology.orchestra.run.smithi114.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 643 kB/s | 11 kB 00:00 2024-09-21T00:46:18.729 INFO:teuthology.orchestra.run.smithi114.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-21T00:46:18.747 INFO:teuthology.orchestra.run.smithi114.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T00:46:18.763 INFO:teuthology.orchestra.run.smithi114.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-21T00:46:18.789 INFO:teuthology.orchestra.run.smithi114.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-21T00:46:18.848 INFO:teuthology.orchestra.run.smithi114.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-09-21T00:46:18.873 INFO:teuthology.orchestra.run.smithi114.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T00:46:18.898 INFO:teuthology.orchestra.run.smithi114.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T00:46:18.924 INFO:teuthology.orchestra.run.smithi114.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T00:46:18.957 INFO:teuthology.orchestra.run.smithi114.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T00:46:18.983 INFO:teuthology.orchestra.run.smithi114.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T00:46:19.025 INFO:teuthology.orchestra.run.smithi114.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-09-21T00:46:19.058 INFO:teuthology.orchestra.run.smithi114.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-09-21T00:46:19.083 INFO:teuthology.orchestra.run.smithi114.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-21T00:46:19.109 INFO:teuthology.orchestra.run.smithi114.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 715 kB/s | 90 kB 00:00 2024-09-21T00:46:19.134 INFO:teuthology.orchestra.run.smithi114.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-21T00:46:19.159 INFO:teuthology.orchestra.run.smithi114.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T00:46:19.184 INFO:teuthology.orchestra.run.smithi114.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T00:46:19.210 INFO:teuthology.orchestra.run.smithi114.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T00:46:19.235 INFO:teuthology.orchestra.run.smithi114.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T00:46:19.260 INFO:teuthology.orchestra.run.smithi114.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T00:46:19.285 INFO:teuthology.orchestra.run.smithi114.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T00:46:19.302 INFO:teuthology.orchestra.run.smithi114.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-21T00:46:19.336 INFO:teuthology.orchestra.run.smithi114.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T00:46:19.370 INFO:teuthology.orchestra.run.smithi114.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T00:46:19.420 INFO:teuthology.orchestra.run.smithi114.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T00:46:19.629 INFO:teuthology.orchestra.run.smithi114.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T00:46:19.696 INFO:teuthology.orchestra.run.smithi114.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 9.4 MB/s | 3.4 MB 00:00 2024-09-21T00:46:19.754 INFO:teuthology.orchestra.run.smithi114.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 703 kB/s | 41 kB 00:00 2024-09-21T00:46:19.759 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-21T00:46:19.830 INFO:teuthology.orchestra.run.smithi114.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-21T00:46:19.871 INFO:teuthology.orchestra.run.smithi114.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 7.5 MB/s | 1.8 MB 00:00 2024-09-21T00:46:19.921 INFO:teuthology.orchestra.run.smithi114.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-21T00:46:19.929 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-21T00:46:19.929 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-21T00:46:20.022 INFO:teuthology.orchestra.run.smithi114.stdout:(156/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.9 MB/s | 2.3 MB 00:00 2024-09-21T00:46:20.114 INFO:teuthology.orchestra.run.smithi114.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-09-21T00:46:20.120 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:46:20.120 INFO:teuthology.orchestra.run.smithi114.stdout:Total 11 MB/s | 228 MB 00:21 2024-09-21T00:46:21.356 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-21T00:46:21.507 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-21T00:46:21.507 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-21T00:46:22.323 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-21T00:46:22.326 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-21T00:46:23.316 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-21T00:46:23.316 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-21T00:46:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-21T00:46:24.855 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:46:24.978 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:46:25.132 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:46:25.182 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:46:25.207 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:46:25.250 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:46:25.708 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:46:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:46:25.957 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:46:25.992 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:46:26.083 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:46:26.112 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:46:26.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:46:26.307 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:46:26.351 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:46:26.380 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:46:26.485 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:46:26.514 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:46:26.560 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:46:26.581 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:46:26.602 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:46:26.758 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:46:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:46:27.013 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:46:27.115 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:27.201 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:27.426 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:27.539 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:46:27.572 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:46:27.615 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:46:27.689 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:46:27.756 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:46:27.797 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:46:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:46:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:46:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:46:28.048 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:46:28.125 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:46:28.157 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:46:28.208 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:46:28.309 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:46:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:46:28.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:46:28.414 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:46:28.484 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:46:28.537 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:46:28.611 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:46:28.745 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:46:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:46:29.111 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-21T00:46:29.207 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:46:29.258 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:46:29.318 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:46:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:46:29.359 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:46:29.384 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:46:29.417 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:46:29.434 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:46:29.446 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:46:29.489 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:46:29.527 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:46:29.569 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:46:29.733 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-21T00:46:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:46:29.786 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:46:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:46:29.851 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T00:46:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:46:29.889 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T00:46:29.901 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:46:29.950 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T00:46:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:46:29.985 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T00:46:30.019 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T00:46:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:46:30.031 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:46:30.052 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:46:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:46:30.069 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T00:46:30.101 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:46:30.145 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:46:30.148 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:46:30.174 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:46:30.184 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:46:30.203 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:46:30.227 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:46:30.269 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:46:30.381 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:46:30.402 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T00:46:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:46:30.456 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:46:30.483 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:46:30.598 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:46:30.625 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:46:30.628 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:46:30.682 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:46:30.688 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:46:30.717 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:46:30.724 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:46:30.740 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:46:30.829 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:46:30.873 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:46:30.881 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:46:30.921 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:46:30.941 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:46:30.956 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:46:31.013 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:46:31.059 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:46:31.089 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:46:31.096 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T00:46:31.138 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:46:31.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:46:31.249 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:46:31.259 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T00:46:31.315 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T00:46:31.343 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:46:31.378 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:31.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:46:31.448 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:46:31.459 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:31.477 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:46:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:46:31.523 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T00:46:31.545 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:46:31.562 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:46:31.571 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T00:46:31.590 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:46:31.624 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:46:31.663 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:46:31.682 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:31.695 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:46:31.725 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:46:31.763 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:46:31.767 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:46:31.794 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:46:31.800 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:46:31.831 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:46:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:46:31.874 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:46:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:46:31.889 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T00:46:31.963 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:46:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T00:46:32.015 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:46:32.047 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:46:32.102 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:32.126 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:46:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:46:32.170 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:32.206 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:46:32.217 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:46:32.257 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:46:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:46:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:46:32.385 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:46:32.407 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T00:46:32.457 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:46:32.518 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:46:32.521 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T00:46:32.547 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:46:32.552 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T00:46:32.582 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:46:32.588 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T00:46:32.662 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T00:46:32.666 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:46:32.709 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:46:32.714 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T00:46:32.753 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:46:32.762 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T00:46:32.773 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:46:32.814 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T00:46:32.845 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:46:32.846 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T00:46:32.874 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T00:46:32.896 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:46:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:46:32.943 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T00:46:32.974 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:46:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:46:32.997 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T00:46:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:46:33.027 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T00:46:33.062 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T00:46:33.111 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:46:33.123 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:46:33.145 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T00:46:33.166 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:46:33.176 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:46:33.190 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T00:46:33.220 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:46:33.233 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T00:46:33.262 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T00:46:33.314 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:46:33.330 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T00:46:33.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:46:33.377 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T00:46:33.451 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T00:46:33.530 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:46:33.562 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:46:33.583 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T00:46:33.637 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T00:46:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:46:33.732 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:46:33.823 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:46:33.856 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:46:33.899 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:46:33.937 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:46:33.980 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:46:34.158 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:46:34.169 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T00:46:34.216 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:46:34.249 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T00:46:34.279 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T00:46:34.284 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:46:34.312 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:46:34.321 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T00:46:34.368 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T00:46:34.372 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:46:34.402 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:46:34.417 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T00:46:34.447 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:46:34.599 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T00:46:34.655 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T00:46:34.659 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:46:34.696 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:46:34.744 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:46:34.746 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T00:46:34.778 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:46:34.803 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T00:46:34.822 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:46:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:46:34.875 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T00:46:34.915 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T00:46:34.959 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T00:46:35.006 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T00:46:35.009 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:46:35.042 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T00:46:35.048 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:46:35.085 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T00:46:35.090 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:46:35.128 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T00:46:35.197 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:46:35.240 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:46:35.263 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T00:46:35.280 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:46:35.313 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:46:35.338 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:46:35.346 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T00:46:35.387 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T00:46:35.431 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:46:35.498 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T00:46:35.538 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T00:46:35.577 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T00:46:35.603 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T00:46:35.603 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:46:35.628 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T00:46:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:46:35.645 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:46:35.676 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:46:35.702 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T00:46:35.711 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:46:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:46:35.750 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:46:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:46:35.790 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:46:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:46:35.820 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:46:35.829 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T00:46:35.855 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:46:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T00:46:35.888 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T00:46:35.896 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:46:35.922 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T00:46:35.938 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:46:35.970 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T00:46:35.985 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:46:36.001 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T00:46:36.032 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T00:46:36.066 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T00:46:36.071 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:46:36.099 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T00:46:36.120 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:46:36.137 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:46:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T00:46:36.151 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:46:36.180 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:46:36.183 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T00:46:36.253 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:46:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:46:36.271 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T00:46:36.284 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:46:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:46:36.313 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T00:46:36.320 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:46:36.354 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T00:46:36.456 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T00:46:36.504 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T00:46:36.820 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:46:36.849 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:46:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:46:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:46:37.079 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:46:37.132 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:46:37.166 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:46:37.228 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T00:46:37.269 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:46:37.285 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T00:46:37.321 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:46:37.336 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T00:46:37.367 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:46:37.441 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T00:46:37.457 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:46:37.490 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T00:46:37.493 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:46:37.534 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T00:46:37.613 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T00:46:37.655 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T00:46:37.674 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:46:37.715 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:46:37.795 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:46:37.837 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T00:46:37.860 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T00:46:37.945 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T00:46:38.494 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:46:38.589 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T00:46:38.614 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:46:38.701 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T00:46:39.209 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:39.238 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:39.807 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:39.842 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:46:39.923 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:46:39.935 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:46:39.935 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:46:39.935 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:46:39.936 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:46:39.962 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T00:46:39.968 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:46:40.023 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:46:40.050 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:46:40.056 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T00:46:40.100 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:46:40.201 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T00:46:40.234 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T00:46:40.426 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:46:40.480 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:46:40.577 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T00:46:40.579 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:46:40.609 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:46:40.621 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:46:40.645 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:46:40.722 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T00:46:40.752 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T00:46:40.787 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T00:46:41.145 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:46:41.174 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:46:41.237 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:46:41.259 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:46:41.322 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T00:46:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:46:41.420 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T00:46:41.451 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T00:46:43.511 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:43.817 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:43.874 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:43.905 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:44.390 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:44.426 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:46:44.519 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:46:44.519 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:46:44.519 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:46:44.519 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:46:44.523 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T00:46:44.552 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:46:44.558 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:46:44.652 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T00:46:44.652 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T00:46:44.652 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T00:46:44.652 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:46:44.710 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:46:51.584 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:46:51.584 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-21T00:46:51.584 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-21T00:46:51.585 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-21T00:46:51.585 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-21T00:46:51.585 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-21T00:46:51.585 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-21T00:46:51.585 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-21T00:46:51.585 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:46:51.769 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:46:51.784 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:46:51.784 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:51.785 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:46:51.785 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:46:53.339 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:46:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:46:53.365 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:53.365 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:46:53.365 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:46:53.365 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:46:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:46:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:46:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:46:53.614 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:53.614 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:46:53.614 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:46:53.614 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:46:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:46:54.073 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:46:54.096 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:46:54.096 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:54.096 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:46:54.096 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:46:54.097 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:46:54.097 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:46:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:46:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:46:54.333 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:46:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:46:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:46:54.661 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:46:54.758 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:46:54.915 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:46:54.957 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:46:54.989 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:46:55.016 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:46:55.451 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:46:55.481 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:46:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:46:55.580 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:46:55.605 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:46:56.407 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:46:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2024-09-21T00:46:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2024-09-21T00:46:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2024-09-21T00:46:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2024-09-21T00:46:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2024-09-21T00:46:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /root 2024-09-21T00:46:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2024-09-21T00:46:56.408 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:46:56.582 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:46:56.598 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:46:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:46:56.599 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-09-21T00:46:57.043 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-09-21T00:46:57.044 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-09-21T00:46:57.044 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:46:57.239 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:46:57.256 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T00:46:57.256 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:57.257 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T00:46:57.257 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:46:58.293 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:46:58.320 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:46:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:46:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:46:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:46:58.320 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:46:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:46:58.567 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:46:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:46:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:46:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:46:58.568 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:46:58.807 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:46:58.869 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:46:58.908 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:46:58.938 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T00:46:58.938 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:58.938 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T00:46:58.938 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:46:58.938 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T00:46:58.938 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:46:59.036 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:46:59.059 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:46:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:46:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:46:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:46:59.060 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:46:59.158 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:46:59.176 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:46:59.201 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T00:46:59.201 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:59.201 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T00:46:59.201 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:46:59.201 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T00:46:59.202 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:46:59.206 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:46:59.270 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:46:59.466 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:46:59.512 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:46:59.590 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:46:59.678 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:46:59.693 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:46:59.718 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T00:46:59.719 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:46:59.719 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T00:46:59.719 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:46:59.719 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T00:46:59.719 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:46:59.810 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:46:59.828 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:46:59.833 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T00:46:59.852 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:46:59.854 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:46:59.886 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:46:59.891 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T00:46:59.922 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:46:59.955 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T00:46:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:47:00.135 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:47:00.152 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T00:47:00.162 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:47:00.186 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:47:00.186 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:00.186 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:47:00.186 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:47:00.186 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:47:00.186 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:47:00.203 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T00:47:00.230 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:47:00.241 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:47:00.285 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T00:47:00.289 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:47:00.320 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:47:00.341 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:47:00.352 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:47:00.381 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T00:47:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:47:00.419 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:47:00.443 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:47:00.526 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T00:47:00.570 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T00:47:00.602 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T00:47:00.629 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T00:47:01.050 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:47:01.078 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T00:47:01.118 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T00:47:01.196 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T00:47:01.225 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:47:01.363 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:47:01.391 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:47:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:47:01.415 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:01.415 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:47:01.415 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:47:01.415 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:47:01.415 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:47:01.458 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:47:01.481 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:47:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:47:01.481 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:47:01.526 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:47:01.548 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:47:01.548 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:01.549 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:47:01.549 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:47:01.549 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:47:01.549 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:47:01.876 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:47:01.902 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:47:01.902 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:01.902 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:47:01.902 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:47:01.902 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:47:01.902 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:47:03.670 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:47:03.724 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:47:04.630 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T00:47:04.691 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:47:04.698 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:47:04.724 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:47:04.841 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:47:05.008 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:47:05.044 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:47:05.068 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:47:05.068 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:05.068 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:47:05.068 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:47:05.068 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:47:05.068 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:47:05.119 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:47:05.131 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:47:05.229 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:47:05.275 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:47:05.716 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T00:47:05.748 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:47:05.870 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T00:47:05.888 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:47:05.929 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:47:05.970 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:47:06.002 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:47:06.029 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:47:06.040 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T00:47:06.067 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:47:06.093 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T00:47:06.093 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:06.093 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T00:47:06.093 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:47:06.093 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T00:47:06.093 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:47:06.143 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:47:06.156 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T00:47:06.216 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:47:06.235 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:47:06.258 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T00:47:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:47:06.272 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:47:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:47:06.296 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:47:06.296 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:06.296 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:47:06.296 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:47:06.296 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:47:06.296 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:47:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:47:06.325 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T00:47:06.347 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:47:06.365 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:47:06.370 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:47:06.370 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:06.371 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:47:06.371 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:47:06.423 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:47:06.446 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:47:06.447 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:06.447 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:47:06.447 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:47:06.447 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:47:06.447 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:47:06.765 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:47:06.789 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:47:06.789 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:06.789 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:47:06.789 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:47:06.789 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:47:06.789 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:47:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:06.982 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:07.354 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T00:47:07.387 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:47:07.413 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T00:47:07.413 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:07.413 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T00:47:07.413 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:47:07.413 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T00:47:07.413 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:47:07.454 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:47:07.479 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T00:47:07.479 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:07.479 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T00:47:07.479 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:47:07.530 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:47:07.555 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T00:47:07.555 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:07.555 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T00:47:07.556 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:47:07.556 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T00:47:07.556 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:47:07.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:47:07.891 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:47:07.897 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:47:07.923 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T00:47:07.923 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T00:47:07.923 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T00:47:07.923 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:47:07.923 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T00:47:07.923 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:47:07.932 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:47:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:47:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:47:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:47:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:47:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:47:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:47:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:47:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:47:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:47:08.302 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:08.302 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:08.490 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:08.490 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:47:08.574 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:47:08.637 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:10.761 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:47:10.810 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:47:10.851 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:47:10.883 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:47:10.911 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:47:11.096 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:47:11.141 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:47:11.171 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:47:11.201 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:47:11.247 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:47:11.783 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:11.828 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:11.849 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:12.200 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T00:47:12.253 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T00:47:12.293 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T00:47:12.339 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T00:47:12.368 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T00:47:12.587 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T00:47:12.632 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T00:47:12.662 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T00:47:12.692 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T00:47:12.694 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:47:12.738 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T00:47:12.783 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:47:12.823 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:47:12.905 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:47:12.944 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:47:12.969 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:47:12.996 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:47:12.996 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:47:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:47:13.071 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:47:13.147 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:47:13.172 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:47:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:13.178 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:13.357 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:13.357 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:47:13.393 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:13.433 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:47:13.496 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:13.677 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:13.700 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T00:47:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T00:47:14.724 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T00:47:14.776 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T00:47:14.869 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T00:47:14.902 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T00:47:14.927 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T00:47:14.953 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T00:47:14.954 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:47:15.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:47:15.011 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:47:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:47:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:47:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:47:15.012 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:47:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:47:15.022 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:47:15.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:47:15.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:47:15.025 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:47:15.026 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:47:15.028 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:47:15.029 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:47:15.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:47:15.031 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:47:15.032 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:47:15.037 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T00:47:15.038 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:47:15.121 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T00:47:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T00:47:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T00:47:15.340 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:47:15.424 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T00:47:15.493 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:17.322 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:17.322 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:47:17.322 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-21T00:47:17.322 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:17.322 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:17.322 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.323 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:47:17.325 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:47:17.326 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:47:17.327 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:47:17.328 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:47:17.329 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:47:17.330 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:47:17.331 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:47:17.332 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:47:17.333 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.334 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:17.335 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:47:17.335 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:47:17.335 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:47:17.335 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:47:17.335 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:47:17.335 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:47:17.335 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:47:17.336 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:47:17.336 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-21T00:47:17.744 DEBUG:teuthology.parallel:result is None 2024-09-21T00:47:19.661 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:19.661 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:47:19.661 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:47:19.661 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:47:19.661 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:47:19.661 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:47:19.662 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:47:19.663 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:47:19.664 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:47:19.665 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:47:19.666 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:47:19.667 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:47:19.668 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:47:19.669 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:47:19.670 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:47:19.671 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:47:19.672 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:47:19.673 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:47:19.674 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:47:19.674 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:47:19.674 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:47:19.674 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:47:19.674 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:47:19.674 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:47:21.415 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:21.415 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T00:47:21.415 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T00:47:21.415 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T00:47:21.415 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T00:47:21.415 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T00:47:21.416 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T00:47:21.417 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T00:47:21.428 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T00:47:21.429 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T00:47:21.430 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T00:47:21.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T00:47:21.432 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T00:47:21.433 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T00:47:21.434 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T00:47:21.435 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T00:47:21.436 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T00:47:21.437 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T00:47:21.438 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T00:47:22.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-21T00:47:22.319 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.320 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.321 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.322 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:47:22.323 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:47:22.324 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:47:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:47:22.326 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:47:22.327 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:47:22.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:47:22.330 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:47:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:47:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:47:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:47:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:47:22.331 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:47:22.332 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:47:22.332 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-21T00:47:22.746 DEBUG:teuthology.parallel:result is None 2024-09-21T00:47:24.233 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T00:47:24.233 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T00:47:24.234 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.235 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T00:47:24.236 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T00:47:24.237 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T00:47:24.238 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T00:47:24.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T00:47:24.240 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T00:47:24.241 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T00:47:24.242 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T00:47:24.243 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T00:47:24.244 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T00:47:24.245 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T00:47:24.245 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:47:24.245 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-21T00:47:24.642 DEBUG:teuthology.parallel:result is None 2024-09-21T00:47:24.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:47:24.781 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:47:24.805 INFO:teuthology.orchestra.run.smithi047.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:47:24.805 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:47:24.806 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:47:24.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:47:24.941 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:47:24.968 INFO:teuthology.orchestra.run.smithi114.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:47:24.968 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:47:24.968 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:47:24.970 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:47:25.118 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T00:47:25.144 INFO:teuthology.orchestra.run.smithi134.stdout:19.3.0-5120.g18432218.el9 2024-09-21T00:47:25.144 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T00:47:25.144 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T00:47:25.146 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T00:47:25.146 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:47:25.146 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:47:25.180 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:47:25.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:47:25.212 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:47:25.212 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T00:47:25.245 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T00:47:25.245 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:47:25.245 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:47:25.275 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:47:25.345 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:47:25.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:47:25.373 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:47:25.441 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:47:25.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T00:47:25.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T00:47:25.540 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T00:47:25.540 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:47:25.541 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:47:25.572 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:47:25.642 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:47:25.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:47:25.669 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:47:25.734 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:47:25.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T00:47:25.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T00:47:25.832 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T00:47:25.832 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:47:25.832 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:47:25.863 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:47:25.933 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:47:25.933 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:47:25.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:47:26.027 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:47:26.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T00:47:26.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T00:47:26.121 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T00:47:26.225 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request', 'SLOW_OPS', 'slow request'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T00:47:26.225 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:47:26.225 INFO:tasks.cephadm:Cluster fsid is 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:47:26.225 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T00:47:26.226 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.47', 'mon.b': '172.21.15.114', 'mon.c': '172.21.15.134'} 2024-09-21T00:47:26.226 INFO:tasks.cephadm:First mon is mon.a on smithi047 2024-09-21T00:47:26.226 INFO:tasks.cephadm:First mgr is x 2024-09-21T00:47:26.226 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T00:47:26.226 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-09-21T00:47:26.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname $(hostname -s) 2024-09-21T00:47:26.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-09-21T00:47:26.313 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T00:47:26.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:47:26.456 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T00:47:26.594 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:47:26.596 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T00:47:26.596 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T00:47:26.596 DEBUG:teuthology.orchestra.run.smithi047:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:27.246 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:47 /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:27.246 DEBUG:teuthology.orchestra.run.smithi114:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:27.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:47 /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:27.781 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 00:47 /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:28.330 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:28.350 DEBUG:teuthology.orchestra.run.smithi114:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:28.370 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T00:47:28.405 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T00:47:28.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:47:28.408 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:47:28.413 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T00:47:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:47:29.992 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:47:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:48:04.023 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:48:04.023 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:48:04.023 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:48:04.023 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-09-21T00:48:04.024 INFO:teuthology.orchestra.run.smithi047.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:48:04.024 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T00:48:04.024 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:48:22.022 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T00:48:22.022 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:48:22.022 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:48:22.023 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-09-21T00:48:22.023 INFO:teuthology.orchestra.run.smithi134.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:48:22.023 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T00:48:22.023 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T00:48:26.804 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-21T00:48:26.805 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T00:48:26.805 INFO:teuthology.orchestra.run.smithi114.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T00:48:26.805 INFO:teuthology.orchestra.run.smithi114.stdout: "repo_digests": [ 2024-09-21T00:48:26.805 INFO:teuthology.orchestra.run.smithi114.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T00:48:26.805 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-21T00:48:26.805 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-21T00:48:26.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-09-21T00:48:26.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph 2024-09-21T00:48:26.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-09-21T00:48:26.926 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-09-21T00:48:26.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /etc/ceph 2024-09-21T00:48:26.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-09-21T00:48:27.008 INFO:tasks.cephadm:Writing seed config... 2024-09-21T00:48:27.009 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T00:48:27.009 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T00:48:27.010 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T00:48:27.011 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T00:48:27.012 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:48:27.012 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T00:48:27.030 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1256112e-77b3-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T00:48:27.030 DEBUG:teuthology.orchestra.run.smithi047:mon.a> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T00:48:27.072 DEBUG:teuthology.orchestra.run.smithi047:mgr.x> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T00:48:27.115 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T00:48:27.116 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 1256112e-77b3-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.47 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:27.331 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:48:27.331 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.47', '--skip-admin-label'] 2024-09-21T00:48:27.332 INFO:teuthology.orchestra.run.smithi047.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T00:48:27.332 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying podman|docker is present... 2024-09-21T00:48:27.356 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 5.2.2 2024-09-21T00:48:27.356 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying lvm2 is present... 2024-09-21T00:48:27.356 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying time synchronization is in place... 2024-09-21T00:48:27.364 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T00:48:27.364 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T00:48:27.371 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T00:48:27.371 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-21T00:48:27.378 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-09-21T00:48:27.384 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-09-21T00:48:27.385 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-09-21T00:48:27.385 INFO:teuthology.orchestra.run.smithi047.stdout:Repeating the final host check... 2024-09-21T00:48:27.408 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout 5.2.2 2024-09-21T00:48:27.408 INFO:teuthology.orchestra.run.smithi047.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T00:48:27.408 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl is present 2024-09-21T00:48:27.408 INFO:teuthology.orchestra.run.smithi047.stdout:lvcreate is present 2024-09-21T00:48:27.415 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T00:48:27.415 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T00:48:27.421 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T00:48:27.421 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-21T00:48:27.428 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-09-21T00:48:27.435 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-09-21T00:48:27.435 INFO:teuthology.orchestra.run.smithi047.stdout:Unit chronyd.service is enabled and running 2024-09-21T00:48:27.435 INFO:teuthology.orchestra.run.smithi047.stdout:Host looks OK 2024-09-21T00:48:27.435 INFO:teuthology.orchestra.run.smithi047.stdout:Cluster fsid: 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:27.435 INFO:teuthology.orchestra.run.smithi047.stdout:Acquiring lock 140194343537008 on /run/cephadm/1256112e-77b3-11ef-baf5-efdc52797490.lock 2024-09-21T00:48:27.435 INFO:teuthology.orchestra.run.smithi047.stdout:Lock 140194343537008 acquired on /run/cephadm/1256112e-77b3-11ef-baf5-efdc52797490.lock 2024-09-21T00:48:27.436 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 3300 ... 2024-09-21T00:48:27.436 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 6789 ... 2024-09-21T00:48:27.436 INFO:teuthology.orchestra.run.smithi047.stdout:Base mon IP(s) is [172.21.15.47:3300, 172.21.15.47:6789], mon addrv is [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-09-21T00:48:27.439 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.47 metric 100 2024-09-21T00:48:27.439 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.47 metric 100 2024-09-21T00:48:27.442 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T00:48:27.442 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T00:48:27.442 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2024-09-21T00:48:27.445 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T00:48:27.445 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T00:48:27.445 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T00:48:27.445 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T00:48:27.445 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-09-21T00:48:27.445 INFO:teuthology.orchestra.run.smithi047.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T00:48:27.445 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-09-21T00:48:27.446 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-09-21T00:48:27.446 INFO:teuthology.orchestra.run.smithi047.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T00:48:27.446 INFO:teuthology.orchestra.run.smithi047.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T00:48:27.447 INFO:teuthology.orchestra.run.smithi047.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:48:27.921 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T00:48:27.922 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T00:48:27.922 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T00:48:27.922 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T00:48:27.922 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T00:48:27.922 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T00:48:27.922 INFO:teuthology.orchestra.run.smithi047.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T00:48:29.211 INFO:teuthology.orchestra.run.smithi047.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T00:48:29.211 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T00:48:29.211 INFO:teuthology.orchestra.run.smithi047.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T00:48:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:stat: stdout 167 167 2024-09-21T00:48:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial keys... 2024-09-21T00:48:31.038 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQDeF+5mT8dgGxAAzFrf70WBEFQu23Xc7Jztvg== 2024-09-21T00:48:31.985 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQDfF+5mr5B9FhAA2M7kbpx3fYreEXwRHVznkw== 2024-09-21T00:48:32.933 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQDgF+5mUmu5EhAAC+GpdZVS38X95Dkkh7MfrA== 2024-09-21T00:48:32.934 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial monmap... 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool for a [v2:172.21.15.47:3300,v1:172.21.15.47:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: set fsid to 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T00:48:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:48:33.875 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mon... 2024-09-21T00:48:34.970 INFO:teuthology.orchestra.run.smithi047.stdout:create mon.a on 2024-09-21T00:48:35.196 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T00:48:35.339 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T00:48:35.523 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1256112e-77b3-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-1256112e-77b3-11ef-baf5-efdc52797490.target. 2024-09-21T00:48:35.523 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1256112e-77b3-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-1256112e-77b3-11ef-baf5-efdc52797490.target. 2024-09-21T00:48:35.765 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.a 2024-09-21T00:48:35.766 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T00:48:35.932 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1256112e-77b3-11ef-baf5-efdc52797490.target.wants/ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-1256112e-77b3-11ef-baf5-efdc52797490@.service. 2024-09-21T00:48:36.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:36 smithi047 podman[30575]: 2024-09-21 00:48:36.358224274 +0000 UTC m=+0.294586996 container start 58c7f997581586977c13fcfd15d90ca7d0c7db37ce413a469402e31b272b6ad4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:48:36.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:36 smithi047 ceph-mon[30594]: mkfs 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:36.470 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:48:36.470 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-09-21T00:48:36.478 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:48:36.478 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-21T00:48:36.478 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-09-21T00:48:36.478 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T00:48:36.478 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon to start... 2024-09-21T00:48:36.478 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon... 2024-09-21T00:48:36.700 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:36 smithi047 ceph-mon[30594]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:48:36.700 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:36 smithi047 bash[30575]: 58c7f997581586977c13fcfd15d90ca7d0c7db37ce413a469402e31b272b6ad4 2024-09-21T00:48:36.700 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:36 smithi047 systemd[1]: Started Ceph mon.a for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:48:37.522 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout id: 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout services: 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.571509s) 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout data: 2024-09-21T00:48:37.524 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T00:48:37.525 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T00:48:37.525 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T00:48:37.525 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T00:48:37.525 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:37.525 INFO:teuthology.orchestra.run.smithi047.stdout:mon is available 2024-09-21T00:48:37.525 INFO:teuthology.orchestra.run.smithi047.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T00:48:37.645 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: monmap epoch 1 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: last_changed 2024-09-21T00:48:33.302207+0000 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: min_mon_release 19 (squid) 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: election_strategy: 1 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: fsmap 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T00:48:37.646 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: mgrmap e1: no daemons active 2024-09-21T00:48:37.647 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:37 smithi047 ceph-mon[30594]: from='client.? 172.21.15.47:0/338511443' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T00:48:38.684 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:38 smithi047 ceph-mon[30594]: from='client.? 172.21.15.47:0/3919222199' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T00:48:38.684 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:38 smithi047 ceph-mon[30594]: from='client.? 172.21.15.47:0/3919222199' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T00:48:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T00:48:38.690 INFO:teuthology.orchestra.run.smithi047.stdout:Generating new minimal ceph.conf... 2024-09-21T00:48:39.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:39 smithi047 ceph-mon[30594]: from='client.? 172.21.15.47:0/1755014037' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:48:39.761 INFO:teuthology.orchestra.run.smithi047.stdout:Restarting the monitor... 2024-09-21T00:48:40.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:39 smithi047 systemd[1]: Stopping Ceph mon.a for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:48:40.435 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a[30590]: 2024-09-21T00:48:40.059+0000 7fdb3aea7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T00:48:40.435 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a[30590]: 2024-09-21T00:48:40.059+0000 7fdb3aea7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T00:48:40.435 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 podman[30836]: 2024-09-21 00:48:40.183585919 +0000 UTC m=+0.242417831 container died 58c7f997581586977c13fcfd15d90ca7d0c7db37ce413a469402e31b272b6ad4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:48:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 podman[30836]: 2024-09-21 00:48:40.534323575 +0000 UTC m=+0.593155476 container cleanup 58c7f997581586977c13fcfd15d90ca7d0c7db37ce413a469402e31b272b6ad4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T00:48:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 bash[30836]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a 2024-09-21T00:48:41.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 podman[30850]: 2024-09-21 00:48:40.802240988 +0000 UTC m=+0.611200162 container remove 58c7f997581586977c13fcfd15d90ca7d0c7db37ce413a469402e31b272b6ad4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:48:41.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 systemd[1]: ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T00:48:41.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 systemd[1]: Stopped Ceph mon.a for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:48:41.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:40 smithi047 systemd[1]: Starting Ceph mon.a for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:48:41.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 podman[30940]: 2024-09-21 00:48:41.161355889 +0000 UTC m=+0.100367524 container create 8538b21c152b1ece3fd2e6c53f57fb4a31f2004b874028996975a70560875fb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T00:48:41.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 podman[30940]: 2024-09-21 00:48:41.077334172 +0000 UTC m=+0.016345820 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:48:41.459 INFO:teuthology.orchestra.run.smithi047.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T00:48:41.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 podman[30940]: 2024-09-21 00:48:41.346990683 +0000 UTC m=+0.286002328 container init 8538b21c152b1ece3fd2e6c53f57fb4a31f2004b874028996975a70560875fb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T00:48:41.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 podman[30940]: 2024-09-21 00:48:41.350156956 +0000 UTC m=+0.289168599 container start 8538b21c152b1ece3fd2e6c53f57fb4a31f2004b874028996975a70560875fb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:48:41.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:48:41.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T00:48:41.671 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: pidfile_write: ignore empty --pid-file 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: load: jerasure load: lrc 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Git sha 0 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: DB SUMMARY 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: DB Session ID: ECMGF8Z1M2P0HKB0DGTU 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95044 ; 2024-09-21T00:48:41.672 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.env: 0x559738ac6d60 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.info_log: 0x55973dc39360 2024-09-21T00:48:41.673 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.statistics: (nil) 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.use_fsync: 0 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:48:41.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.db_log_dir: 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.wal_dir: 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:48:41.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.write_buffer_manager: 0x55973dc3dd60 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.unordered_write: 0 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:48:41.677 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.row_cache: None 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.wal_filter: None 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.wal_compression: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:48:41.678 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:48:41.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:48:41.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:48:41.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:48:41.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:48:41.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:48:41.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:48:41.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:48:41.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_open_files: -1 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:48:41.680 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Compression algorithms supported: 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: kZSTD supported: 0 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:48:41.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.merge_operator: 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_filter: None 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55973dc38fa0) 2024-09-21T00:48:41.682 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_type: 0 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_index_type: 0 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_shortening: 1 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: checksum: 4 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: no_block_cache: 0 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache: 0x559739bfd610 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_options: 2024-09-21T00:48:41.683 INFO:journalctl@ceph.mon.a.smithi047.stdout: capacity : 536870912 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_shard_bits : 4 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: strict_capacity_limit : 0 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_cache_compressed: (nil) 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: persistent_cache: (nil) 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size: 4096 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_size_deviation: 10 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_restart_interval: 16 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: index_block_restart_interval: 1 2024-09-21T00:48:41.684 INFO:journalctl@ceph.mon.a.smithi047.stdout: metadata_block_size: 4096 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: partition_filters: 0 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: use_delta_encoding: 1 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: filter_policy: bloomfilter 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: whole_key_filtering: 1 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: verify_compression: 0 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: format_version: 5 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_index_compression: 1 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: block_align: 0 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: max_auto_readahead_size: 262144 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: prepopulate_block_cache: 0 2024-09-21T00:48:41.685 INFO:journalctl@ceph.mon.a.smithi047.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression: NoCompression 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.num_levels: 7 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:48:41.686 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:48:41.687 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:48:41.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:48:41.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:48:41.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:48:41.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.ttl: 2592000 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:48:41.692 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 68a3da32-f28c-464d-a3c7-e611ad14d3e3 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879721386849, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879721388015, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91223, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89271, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11684, "raw_average_key_size": 47, "raw_value_size": 82667, "raw_average_value_size": 338, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726879721, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "68a3da32-f28c-464d-a3c7-e611ad14d3e3", "db_session_id": "ECMGF8Z1M2P0HKB0DGTU", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879721388114, "job": 1, "event": "recovery_finished"} 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T00:48:41.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55973dc5ca80 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: DB pointer 0x55973ea02000 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** DB Stats ** 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:48:41.694 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: L0 2/0 90.95 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: Sum 2/0 90.95 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** Compaction Stats [default] ** 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 123.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:48:41.695 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: Cumulative compaction: 0.00 GB write, 25.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: Interval compaction: 0.00 GB write, 25.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache BinnedLRUCache@0x559739bfd610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:48:41.696 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: starting mon.a rank 0 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: mon.a@-1(???) e1 preinit fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: mon.a@-1(???).mds e1 new map 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: mon.a@-1(???).mds e1 print_map 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout: e1 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout: btime 2024-09-21T00:48:36:406905+0000 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout: legacy client fscid: -1 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout: 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout: No filesystems configured 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:48:41.697 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 ceph-mon[30960]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T00:48:41.698 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 bash[30940]: 8538b21c152b1ece3fd2e6c53f57fb4a31f2004b874028996975a70560875fb4 2024-09-21T00:48:41.698 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:41 smithi047 systemd[1]: Started Ceph mon.a for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: monmap epoch 1 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: last_changed 2024-09-21T00:48:33.302207+0000 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: min_mon_release 19 (squid) 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: election_strategy: 1 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: fsmap 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T00:48:42.487 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: mgrmap e1: no daemons active 2024-09-21T00:48:42.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:42 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2415884574' entity='client.admin' 2024-09-21T00:48:42.489 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T00:48:42.511 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:48:42.511 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mgr... 2024-09-21T00:48:42.512 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T00:48:42.512 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T00:48:42.761 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.x 2024-09-21T00:48:42.761 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T00:48:42.918 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1256112e-77b3-11ef-baf5-efdc52797490.target.wants/ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-1256112e-77b3-11ef-baf5-efdc52797490@.service. 2024-09-21T00:48:43.139 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:42 smithi047 systemd[1]: Starting Ceph mgr.x for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:48:43.416 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:43 smithi047 podman[31172]: 2024-09-21 00:48:43.138589823 +0000 UTC m=+0.102200035 container create ad3984ea913e7ce2139f33edb7edd8d0f01cbb7fdb0c8154b7e0299a2537129e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:48:43.416 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:43 smithi047 podman[31172]: 2024-09-21 00:48:43.052362287 +0000 UTC m=+0.015972506 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:48:43.416 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:43 smithi047 podman[31172]: 2024-09-21 00:48:43.336405857 +0000 UTC m=+0.300016075 container init ad3984ea913e7ce2139f33edb7edd8d0f01cbb7fdb0c8154b7e0299a2537129e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T00:48:43.416 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:43 smithi047 podman[31172]: 2024-09-21 00:48:43.339497182 +0000 UTC m=+0.303107396 container start ad3984ea913e7ce2139f33edb7edd8d0f01cbb7fdb0c8154b7e0299a2537129e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T00:48:43.417 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:43 smithi047 bash[31172]: ad3984ea913e7ce2139f33edb7edd8d0f01cbb7fdb0c8154b7e0299a2537129e 2024-09-21T00:48:43.431 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:48:43.431 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-09-21T00:48:43.439 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:48:43.439 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-21T00:48:43.439 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-09-21T00:48:43.439 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T00:48:43.448 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:48:43.448 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-09-21T00:48:43.456 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:48:43.456 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-21T00:48:43.456 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-09-21T00:48:43.456 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T00:48:43.456 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr to start... 2024-09-21T00:48:43.456 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr... 2024-09-21T00:48:43.687 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:43 smithi047 systemd[1]: Started Ceph mgr.x for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:48:44.255 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:44 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/758029561' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T00:48:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:48:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "1256112e-77b3-11ef-baf5-efdc52797490", 2024-09-21T00:48:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:48:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:48:44.606 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:48:44.608 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:48:36:406905+0000", 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:48:44.609 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:48:36.407655+0000", 2024-09-21T00:48:44.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:48:44.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:44.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:48:44.611 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:48:44.611 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (1/15)... 2024-09-21T00:48:47.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:47 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/111666596' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "1256112e-77b3-11ef-baf5-efdc52797490", 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:48:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:48:47.752 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:48:47.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:48:47.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:48:47.753 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:48:47.756 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:48:36:406905+0000", 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:48:47.757 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:48:36.407655+0000", 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:48:47.758 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (2/15)... 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: Activating manager daemon x 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: mgrmap e2: x(active, starting, since 0.00386234s) 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: Manager daemon x is now available 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:48:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:48:48.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' 2024-09-21T00:48:48.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' 2024-09-21T00:48:48.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:48 smithi047 ceph-mon[30960]: from='mgr.14100 172.21.15.47:0/2381156513' entity='mgr.x' 2024-09-21T00:48:50.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:50 smithi047 ceph-mon[30960]: mgrmap e3: x(active, since 1.00842s) 2024-09-21T00:48:50.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:50 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3578675394' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T00:48:51.006 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:51.006 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:48:51.006 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "1256112e-77b3-11ef-baf5-efdc52797490", 2024-09-21T00:48:51.006 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T00:48:51.006 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:51.007 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T00:48:51.008 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T00:48:51.008 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:51.008 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T00:48:51.008 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:51.008 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T00:48:51.008 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T00:48:51.008 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T00:48:51.008 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T00:48:51.011 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T00:48:51.011 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T00:48:51.011 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:51.011 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T00:48:51.011 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T00:48:51.011 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T00:48:36:406905+0000", 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T00:48:51.012 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T00:48:36.407655+0000", 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T00:48:51.013 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:48:51.014 INFO:teuthology.orchestra.run.smithi047.stdout:mgr is available 2024-09-21T00:48:51.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:51 smithi047 ceph-mon[30960]: mgrmap e4: x(active, since 2s) 2024-09-21T00:48:52.190 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T00:48:52.191 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T00:48:52.192 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling cephadm module... 2024-09-21T00:48:52.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:52 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3372327606' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T00:48:53.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:53 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3991558328' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T00:48:53.941 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: ignoring --setuser ceph since I am not root 2024-09-21T00:48:53.941 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:48:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: ignoring --setgroup ceph since I am not root 2024-09-21T00:48:54.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:54 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3991558328' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T00:48:54.893 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:54 smithi047 ceph-mon[30960]: mgrmap e5: x(active, since 5s) 2024-09-21T00:48:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:48:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T00:48:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:48:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T00:48:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T00:48:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:48:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-09-21T00:48:55.517 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 5... 2024-09-21T00:48:55.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:55 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/122340378' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: Active manager daemon x restarted 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: Activating manager daemon x 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: mgrmap e6: x(active, starting, since 0.0038789s) 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:48:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:48:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:48:58 smithi047 ceph-mon[30960]: Manager daemon x is now available 2024-09-21T00:49:00.455 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:49:00.456 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T00:49:00.456 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T00:49:00.456 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:49:00.456 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 5 is available 2024-09-21T00:49:00.456 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying orchestrator module is enabled... 2024-09-21T00:49:01.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:00 smithi047 ceph-mon[30960]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T00:49:01.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:00 smithi047 ceph-mon[30960]: mgrmap e7: x(active, since 1.00547s) 2024-09-21T00:49:01.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:00 smithi047 ceph-mon[30960]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: Found migration_current of "None". Setting to last migration. 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:49:02.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:49:02.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:01 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3750528957' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T00:49:02.461 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T00:49:02.461 INFO:teuthology.orchestra.run.smithi047.stdout:Setting orchestrator backend to cephadm... 2024-09-21T00:49:03.086 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:02 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3750528957' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T00:49:03.086 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:02 smithi047 ceph-mon[30960]: mgrmap e8: x(active, since 3s) 2024-09-21T00:49:03.355 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:49:03.084+0000 7f61661e4640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:00:49:03] ENGINE Error in HTTPServer.serve 2024-09-21T00:49:03.355 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: Traceback (most recent call last): 2024-09-21T00:49:03.355 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: self._connections.run(self.expiration_interval) 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: self._run(expiration_interval) 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: s = self.context.wrap_socket( 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: return self.sslsocket_class._create( 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:49:03.356 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: self.do_handshake() 2024-09-21T00:49:03.357 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:49:03.357 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: self._sslobj.do_handshake() 2024-09-21T00:49:03.357 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:49:03.357 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:49:03.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:02] ENGINE Bus STARTING 2024-09-21T00:49:03.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: mgrmap e9: x(active, since 4s) 2024-09-21T00:49:03.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:02] ENGINE Serving on http://172.21.15.47:8765 2024-09-21T00:49:03.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:03.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:03.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:03] ENGINE Serving on https://172.21.15.47:7150 2024-09-21T00:49:03.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:03] ENGINE Bus STARTED 2024-09-21T00:49:03.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:03] ENGINE Error in HTTPServer.serve 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: Traceback (most recent call last): 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._run(expiration_interval) 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: s = self.context.wrap_socket( 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: return self.sslsocket_class._create( 2024-09-21T00:49:03.957 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:49:03.958 INFO:journalctl@ceph.mon.a.smithi047.stdout: self.do_handshake() 2024-09-21T00:49:03.958 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:49:03.958 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._sslobj.do_handshake() 2024-09-21T00:49:03.958 INFO:journalctl@ceph.mon.a.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:49:03.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:03 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:04.883 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T00:49:04.883 INFO:teuthology.orchestra.run.smithi047.stdout:Generating ssh key... 2024-09-21T00:49:05.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:04 smithi047 ceph-mon[30960]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-mon[30960]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-mon[30960]: Generating ssh key... 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: Generating public/private rsa key pair. 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: Your identification has been saved in /tmp/tmpp_o06hh9/key 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: Your public key has been saved in /tmp/tmpp_o06hh9/key.pub 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: The key fingerprint is: 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: SHA256:2C83bMp1ysijdIew/JrNCMtqcufLZHvMwKbLnQqY0Ro ceph-1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: The key's randomart image is: 2024-09-21T00:49:06.118 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: +---[RSA 3072]----+ 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: | | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: | | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: | | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: | . o | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: |E .. o S | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: |.= +. o + | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: |= o+++ + O . | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: |.o+*.*+X.X + | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: | +=*Xo=oO.o | 2024-09-21T00:49:06.119 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: +----[SHA256]-----+ 2024-09-21T00:49:07.645 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbdTUutK6fZP6UvNZurPf12JY8vY8yjpxZXIFRCS9f93Cz8CrER7bhlJE5wr4QSBovrkbkQx7FGrrxc+a9rBhMVO/+ub/Z4AH1qvNhK0zzFncQWPlRZfr8FDHbAIH/KYfK+QdSXnBYqYAgn96ZW6yMEOuJgULKShAegHz7phNrfOu14jRHavaWPMbqZ8PLyVK6yvXbQG0jIVqZIVWeOu9thbAJTlSUlqxXjpeRP+reYLnwEFE+DT+oY6gFFKH2RSMa7LN8kfv9OA4yjMwqZvnFrQxNESa1CKm6BrxdTlAOQUTch/fA1eLFp15wIjapojnbvnnSb/XofqNZU8Xxas3xAiGZQA/q6bfGI1E/RDQRY/VQZ+/izcC8IggpCbgutX7ieOuYObFrZ1Eno2gqPqrtvZ1I0C2e/r3YNE5TBRm7OapvZ9hdAZENZg9frw+Mqbg5kxbknBPil3AXmQv/L9yO0XK+V2jcEw8lM2+33wGggrE7auogmCQlZXXYF0J/K7s= ceph-1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:49:07.646 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T00:49:07.646 INFO:teuthology.orchestra.run.smithi047.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T00:49:07.649 INFO:teuthology.orchestra.run.smithi047.stdout:Adding host smithi047... 2024-09-21T00:49:07.903 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:07 smithi047 ceph-mon[30960]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:08.759 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:08 smithi047 ceph-mon[30960]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:09.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:09 smithi047 ceph-mon[30960]: Deploying cephadm binary to smithi047 2024-09-21T00:49:12.676 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Added host 'smithi047' with addr '172.21.15.47' 2024-09-21T00:49:12.677 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mon service... 2024-09-21T00:49:13.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:13 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:13.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:13 smithi047 ceph-mon[30960]: Added host smithi047 2024-09-21T00:49:13.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:13 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:14.069 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T00:49:14.070 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mgr service... 2024-09-21T00:49:14.628 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:14 smithi047 ceph-mon[30960]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:14.629 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:14 smithi047 ceph-mon[30960]: Saving service mon spec with placement count:5 2024-09-21T00:49:14.629 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:14 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:15.302 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T00:49:15.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:15 smithi047 ceph-mon[30960]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:15 smithi047 ceph-mon[30960]: Saving service mgr spec with placement count:2 2024-09-21T00:49:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:15 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:17.279 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:16 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/48491437' entity='client.admin' 2024-09-21T00:49:18.286 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling the dashboard module... 2024-09-21T00:49:18.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:18 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1373686728' entity='client.admin' 2024-09-21T00:49:18.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:18 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:18.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:18 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:20.206 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: ignoring --setuser ceph since I am not root 2024-09-21T00:49:20.225 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: ignoring --setgroup ceph since I am not root 2024-09-21T00:49:20.225 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:19 smithi047 ceph-mon[30960]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:20.225 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:19 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3907340653' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T00:49:20.225 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:19 smithi047 ceph-mon[30960]: from='mgr.14118 172.21.15.47:0/1268932240' entity='mgr.x' 2024-09-21T00:49:21.178 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:20 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3907340653' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T00:49:21.179 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:20 smithi047 ceph-mon[30960]: mgrmap e10: x(active, since 21s) 2024-09-21T00:49:21.892 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:21 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3720915075' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T00:49:21.894 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:49:21.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T00:49:21.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T00:49:21.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T00:49:21.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T00:49:21.895 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:49:21.895 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-09-21T00:49:21.895 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 10... 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: Active manager daemon x restarted 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: Activating manager daemon x 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: mgrmap e11: x(active, starting, since 0.0039966s) 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T00:49:25.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:25 smithi047 ceph-mon[30960]: Manager daemon x is now available 2024-09-21T00:49:26.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T00:49:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T00:49:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-mon[30960]: mgrmap e12: x(active, since 1.00732s) 2024-09-21T00:49:26.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-21T00:49:26.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T00:49:26.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T00:49:26.944 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-21T00:49:26.944 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 10 is available 2024-09-21T00:49:26.944 INFO:teuthology.orchestra.run.smithi047.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T00:49:27.206 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:49:26.934+0000 7f64294b9640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:00:49:26] ENGINE Error in HTTPServer.serve 2024-09-21T00:49:27.206 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: Traceback (most recent call last): 2024-09-21T00:49:27.206 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: self._connections.run(self.expiration_interval) 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: self._run(expiration_interval) 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: s = self.context.wrap_socket( 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: return self.sslsocket_class._create( 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: self.do_handshake() 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:49:27.207 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: self._sslobj.do_handshake() 2024-09-21T00:49:27.208 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:49:27.208 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:49:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:49:27.631 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:27 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:26] ENGINE Bus STARTING 2024-09-21T00:49:27.631 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:27 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:26] ENGINE Serving on https://172.21.15.47:7150 2024-09-21T00:49:27.631 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:27 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:26] ENGINE Error in HTTPServer.serve 2024-09-21T00:49:27.631 INFO:journalctl@ceph.mon.a.smithi047.stdout: Traceback (most recent call last): 2024-09-21T00:49:27.631 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T00:49:27.631 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-09-21T00:49:27.631 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T00:49:27.631 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._run(expiration_interval) 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: s = self.context.wrap_socket( 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: return self.sslsocket_class._create( 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: self.do_handshake() 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: self._sslobj.do_handshake() 2024-09-21T00:49:27.632 INFO:journalctl@ceph.mon.a.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T00:49:28.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:28 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:27] ENGINE Serving on http://172.21.15.47:8765 2024-09-21T00:49:28.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:28 smithi047 ceph-mon[30960]: [21/Sep/2024:00:49:27] ENGINE Bus STARTED 2024-09-21T00:49:28.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:28 smithi047 ceph-mon[30960]: mgrmap e13: x(active, since 2s) 2024-09-21T00:49:28.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:28 smithi047 ceph-mon[30960]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:28.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:29.002 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUUE5P64IZ7z2/7KiiLR93zDmQQOMwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAwNDkyOFoXDTM0\nMDkyMjAwNDkyOFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjQ3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAoYZsw4yHydXJtujaWjIJHyFX8Zc1lyn8PE5D\njDtzaDBryHxM1w1sEhWQ5Lhi1g78LlUFXKbxhbkGhMTl/ZTYyqHqOObW6ZsJMCr7\n9nuTxT/2weI6L6kwBom11lIKEDrBMfv1b4D7MbJxhJ5hB4+vhyN8eKUEWrFTpK+X\n2FP4X+J+6OPf8mcoYAZMp8VA5+d/ROs/tVsQzpW5lVz2CWccsYd/lfGcpVtYy7u7\nwzsHBd2UxWE44gj5du96rOAGL6ipiN7jvzg2uaEYgV+uPwpDotgJ+G7Tj7PAAe2K\n6XPnRGKbNM3vWlEJfQXoWgYM+vkjhtmYl3ci7A1hmk7GkQd/u28e4MYW08Fb97Qq\n0Pj0iae77DSD2RAfvPb6HtPUMBw70u6Pb9si6ObrqgoCrqAacELdU+Y4mvravB6O\nmlJlvK3YtrJikQW//RE8q3iuBfbg9Xw27IwnMB2azeS8nJhFXRJxl1ncZSwyUqb7\nmTUmywLw69qV14VDRvLrpPFQxV1tVz3lCdafO/aXo2VSGTeTtb89IaI3NdcdgX7D\nU2sGYa2dQdugYpfWDr0awqhd67NuMheFrsNyvmI0Sxt05APZ2CgQUjEOlbfOMA85\nMoEVcZPY4FECABoe9a3kfNCwzEHINqzKx3D665bJlOTw8Eh4JwF6KTYc/KiEfiLX\n+hHhCI8CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDQ3ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPLzAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAT\n+i9h+v0ogxC7crcs2qmca5Av+uKtRX+xnsNN/FMyTLzpwFpfgpUWPsOOYUrjq5pM\nwnhfdjaBKUjjeicKJnLHjaLYdnWwOA/SqzsYwBCWqj0hZiS3XECdJPcJds+vup9X\nl37PKCYvkzejDdLFqq7Ae69k/uLemdYdE+GO7D8I6lxpK75brAcN4INS/iiui/Kx\nAEGcGM7St4yi6a68E6Tf6A0yzjkh+LmFqNvCNRH8211W7Daf6mgdbc122WJJVwd6\nZGDr2+o5PeZJab9Js3J1uWlgd/evGg1y/FX6q0UY93Nuamr8YpAhXmD9zG3UsClX\nqNpytVgrVrWAYa1mXCfrTKqhxLE79bd9w1HU24comQlASIuuNJDCYyBPRqmW+/zv\nm9pJRrCM5SEZx3PcRE1Acon21DrzEWFbzhseEaia0KrrE4egqEjvxSr2zldJQVks\nqmd8PVSzG62U2mWe4tjYw7UlLc6r4lfEbCrdMi2xU0E6DGerLtQPSpVVh7dMYHxU\nycD+G0i6xYzoXlq3h+6fFfV1rx3gEiuNlv3rR4fs9Pe6zRtWjCiUwwPJR99z/IOD\nVgHV/aRR/LEPm8kMPuyjy84YC7MO36QT9GGQHFDp81wWoGvcwTC+SuywpqXiglmF\nshOo+kAMIFBww5oJrZhBJbhwwo3g9xRN0jW0oMqb3A==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAoYZsw4yHydXJtujaWjIJHyFX8Zc1lyn8PE5DjDtzaDBryHxM\n1w1sEhWQ5Lhi1g78LlUFXKbxhbkGhMTl/ZTYyqHqOObW6ZsJMCr79nuTxT/2weI6\nL6kwBom11lIKEDrBMfv1b4D7MbJxhJ5hB4+vhyN8eKUEWrFTpK+X2FP4X+J+6OPf\n8mcoYAZMp8VA5+d/ROs/tVsQzpW5lVz2CWccsYd/lfGcpVtYy7u7wzsHBd2UxWE4\n4gj5du96rOAGL6ipiN7jvzg2uaEYgV+uPwpDotgJ+G7Tj7PAAe2K6XPnRGKbNM3v\nWlEJfQXoWgYM+vkjhtmYl3ci7A1hmk7GkQd/u28e4MYW08Fb97Qq0Pj0iae77DSD\n2RAfvPb6HtPUMBw70u6Pb9si6ObrqgoCrqAacELdU+Y4mvravB6OmlJlvK3YtrJi\nkQW//RE8q3iuBfbg9Xw27IwnMB2azeS8nJhFXRJxl1ncZSwyUqb7mTUmywLw69qV\n14VDRvLrpPFQxV1tVz3lCdafO/aXo2VSGTeTtb89IaI3NdcdgX7DU2sGYa2dQdug\nYpfWDr0awqhd67NuMheFrsNyvmI0Sxt05APZ2CgQUjEOlbfOMA85MoEVcZPY4FEC\nABoe9a3kfNCwzEHINqzKx3D665bJlOTw8Eh4JwF6KTYc/KiEfiLX+hHhCI8CAwEA\nAQKCAgBJ/Q1tNb4tkiRoCJmcnzbWb6udGqqNp8nGxgLjBYiDvUph964rBBbw4bgR\nTPTZINwbTQ67ti0EGBEIWDkRw1Da4PgtQHBJaZ731Xi9GzZBMF+TyFDm7BT3qbUF\ni2bYsFE22DdA8FAgH6EoInRHxmWc/YBSsyQfdwLdeSGREkW/hjyj6V3355DzC2+p\nmg11LPF7XFc+d4xnVOZBqOd6vyTBnVOwF5Ctnf46tK/5adx5r1oqX7Jyt7Gt7VzA\nO44Z3qRp8c9ZFCLdPRHAkVd7wPPicBuBFSMLvEbDm0/6SAEzrgdyVLLDKEO0ZTRd\nqE/h1qWTa7EeEJCKmEaRLGyAmnLDanlINjkiOvlRYxyyyWvir+cJ5sbpv2nAnBr5\nvVhPYvTeeVzxfqGfyfmTjT4erOXBcp8ysQRMwkZS/C4hdSfg5cuI98c2pFxqoyLY\nETWBpd41J1ZgDKOSK5xaqpXIiBKBK4RkixAJoAhtKzhbBZmJiBFFew67K4fJqoGx\na+4QSwWoEGBreJFjgmtWnydNUPDzWfp51wEu/U2ZJHBiVusCWcWeY5SN1JuUq2MA\nnayA7pDO6bh7RbomX0DqAC7KiICCDkJ5kmiv8ksIpZEKQoHkEsakMmJa4EJZC1GE\nGNZZ9wgrg4FJZqY0NcB1BF+/4CjEdUP1v/rvjHuTXHs5l1yOwQKCAQEAz6bpMpHN\nPYehEPxPgWatpyigKQW2ENquLTeJEw3cdkxTDaQWUDHIije8HWc1E9z1l05YcOUU\nYHz/DSIHQZrmKsixrlzQDZtgT6xWmqBV1vSygDmZ3rULA4Y1U9KgFWZQQqxE1CSx\nP7OtXpF+0mVulyn2yT9GHmI2XfvLssgkaEkjYMDL/HQoF4fuuNYcB4zHchSFIE12\npt3A2TTdMvZONVwhGFsLCZX52kHP+k5OswFfgyIAtAaD47y926hfDZLvXlPjchBd\n6HaPtLnCBwH8JVnucQhU+kFjDUZnhEIfZ7auM/mGv9mezZjeJugM0b5VfGAkxnUk\n5KYC1trOrZty1wKCAQEAxyIfN4vGhccQ+ty5+F33mXp7t00DUpsv01CJm189AUgS\nkbgxkZnZ0yhEgcr1GtGZ+v8gbq7tUngG7iTtoqNJR6NjTaGv0LgddY2B0x/prLLT\n6DWcVKjEIeeENgogRwPydgMyzdtGOTneUZx/2R1DKlz/IKbp3Y8NfgUiXREr6jWb\nVol7r7F5AsjzlijbhLRQANZww9tv/x/wyyIjEDXKoxA/AjbDx1bkA7Lhagjwgyf5\ni+an+D/iRaUUJbKSedDL8OP33PT88ZkX+WeY+FFqaIDdIH2hsApiCir/wTTEAEnL\nOqk7tlo0xb1LSXAsW+AV03v1DYN8JiYu9PNlbQUZCQKCAQAZ0EL/EVb1Ri4EoYj0\nqiH+PLOkRdx7PeQXJOc6Yie84QIWGQbZE0c9v234LcNQY9B37bpa1m9xCzjdlhRW\n2H2yZd6IsWr/tggD/4WIlVP2c9bYz9BL+i+TUZTBhdZ2spBZqXao9KLAK4Lq1aVx\nXECiNApEvEPoNQdTKaEJ6Y11FVp7hZwWFw6A1lobyioT2jFVAi4GdPrCBaEan1K8\nKhhQ09IdZ/v4RheYRUQodqGb6RjJgWma95BfuC/V5ZljY5e0HzOQE27JHiwBKHJx\nUpLYxdQ5YvLFZWl91fm6XEnxJ6mCNovEv7XZEx7SsVgens2bt4v6y8c5UVXbBbpZ\npJBjAoIBAQCfO1zE+OMNFCoyvw+CV/lmY7fL0ixHAMrUacEvWY+Zl70pgqU4bVLt\n83QcaWNnR5WeTCXt+7jPyiSYhzTyaSluvGrqp9DD0IXV+wqF/S3Ip9KlC0FvvOfg\nyJVC9QPsZW6bCWG1lJJprillDwR4Y1rS5DwqKu40+W/rhkV9L/7ysFz/bL5Xtk0y\neee1+gPW8KxMjyzqoGzFEBBnDmwFSU446APKTGpu2r9HaeGv/Wf9KJj2UsGb09Gm\nqSMcJdfUyq5ZeKE5sTkWI7o0968tWUUCPZEUqwEAmLzerpWGNCBKrrdwt+SEo0sx\nl3U9SxJdgSlSy/sfDDXY941y17IR5BKpAoIBADStJrJgn7xFqLFK0aEPE9sv4Wrv\nG40pZKTITrkB7d2M1Sxg5/1y+NIIksNqPcrrX5qeTXgHWMB62htmBgvaKmHQQMRO\nbQN76VwwlnLcglWoTkM73DMliMl+S+CzSKQK8U04K8pwczIa3BEEtB7RG5r2cuc8\nO2i8pLOJWylp10srhg8R5wo+O/HLjvsFvN+HV93aXtXO1jlz1/cuBwFrgMOS+mPO\nRsa4vuVm4eju1OzElnq4G/n9Dy4aon9+cUf9waeq2YvBbGr60i2N7i1sKGN6sIa0\nZDJ1PXpcoqH+BJMsEqADjNyU3CkjfkAHlswJ0Q0GL9q3XK4cKnQmLf9TeMA=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T00:49:29.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:29.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:30.327 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T00:49:30.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:30 smithi047 ceph-mon[30960]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:31.744 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T00:49:31.744 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial admin user... 2024-09-21T00:49:32.300 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:31 smithi047 ceph-mon[30960]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:32.300 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:33.391 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:32 smithi047 ceph-mon[30960]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:33.694 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4gOruD/rDq2kRcMNBt/p9Ok8S4zzviZPypfUM0fXziW48bttzQeqC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726879773, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T00:49:33.694 INFO:teuthology.orchestra.run.smithi047.stdout:Fetching dashboard port number... 2024-09-21T00:49:34.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:34.925 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T00:49:34.935 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T00:49:34.935 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout disabled 2024-09-21T00:49:34.943 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T00:49:34.943 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-21T00:49:34.943 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld.service is not enabled 2024-09-21T00:49:34.943 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T00:49:34.945 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph Dashboard is now available at: 2024-09-21T00:49:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: URL: https://smithi047.front.sepia.ceph.com:8443/ 2024-09-21T00:49:34.945 INFO:teuthology.orchestra.run.smithi047.stdout: User: admin 2024-09-21T00:49:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: Password: rk5jx86bli 2024-09-21T00:49:34.946 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:34.946 INFO:teuthology.orchestra.run.smithi047.stdout:Saving cluster configuration to /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config directory 2024-09-21T00:49:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:35 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2400281528' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T00:49:36.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: ceph telemetry on 2024-09-21T00:49:36.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:36.342 INFO:teuthology.orchestra.run.smithi047.stdout:For more information see: 2024-09-21T00:49:36.342 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:36.342 INFO:teuthology.orchestra.run.smithi047.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T00:49:36.342 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:36.342 INFO:teuthology.orchestra.run.smithi047.stdout:Bootstrap complete. 2024-09-21T00:49:36.382 INFO:tasks.cephadm:Fetching config... 2024-09-21T00:49:36.382 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:49:36.382 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T00:49:36.398 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T00:49:36.398 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:49:36.398 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T00:49:36.455 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T00:49:36.455 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:49:36.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T00:49:36.522 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T00:49:36.522 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:49:36.523 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T00:49:36.579 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T00:49:36.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbdTUutK6fZP6UvNZurPf12JY8vY8yjpxZXIFRCS9f93Cz8CrER7bhlJE5wr4QSBovrkbkQx7FGrrxc+a9rBhMVO/+ub/Z4AH1qvNhK0zzFncQWPlRZfr8FDHbAIH/KYfK+QdSXnBYqYAgn96ZW6yMEOuJgULKShAegHz7phNrfOu14jRHavaWPMbqZ8PLyVK6yvXbQG0jIVqZIVWeOu9thbAJTlSUlqxXjpeRP+reYLnwEFE+DT+oY6gFFKH2RSMa7LN8kfv9OA4yjMwqZvnFrQxNESa1CKm6BrxdTlAOQUTch/fA1eLFp15wIjapojnbvnnSb/XofqNZU8Xxas3xAiGZQA/q6bfGI1E/RDQRY/VQZ+/izcC8IggpCbgutX7ieOuYObFrZ1Eno2gqPqrtvZ1I0C2e/r3YNE5TBRm7OapvZ9hdAZENZg9frw+Mqbg5kxbknBPil3AXmQv/L9yO0XK+V2jcEw8lM2+33wGggrE7auogmCQlZXXYF0J/K7s= ceph-1256112e-77b3-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:49:36.654 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbdTUutK6fZP6UvNZurPf12JY8vY8yjpxZXIFRCS9f93Cz8CrER7bhlJE5wr4QSBovrkbkQx7FGrrxc+a9rBhMVO/+ub/Z4AH1qvNhK0zzFncQWPlRZfr8FDHbAIH/KYfK+QdSXnBYqYAgn96ZW6yMEOuJgULKShAegHz7phNrfOu14jRHavaWPMbqZ8PLyVK6yvXbQG0jIVqZIVWeOu9thbAJTlSUlqxXjpeRP+reYLnwEFE+DT+oY6gFFKH2RSMa7LN8kfv9OA4yjMwqZvnFrQxNESa1CKm6BrxdTlAOQUTch/fA1eLFp15wIjapojnbvnnSb/XofqNZU8Xxas3xAiGZQA/q6bfGI1E/RDQRY/VQZ+/izcC8IggpCbgutX7ieOuYObFrZ1Eno2gqPqrtvZ1I0C2e/r3YNE5TBRm7OapvZ9hdAZENZg9frw+Mqbg5kxbknBPil3AXmQv/L9yO0XK+V2jcEw8lM2+33wGggrE7auogmCQlZXXYF0J/K7s= ceph-1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:49:36.665 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbdTUutK6fZP6UvNZurPf12JY8vY8yjpxZXIFRCS9f93Cz8CrER7bhlJE5wr4QSBovrkbkQx7FGrrxc+a9rBhMVO/+ub/Z4AH1qvNhK0zzFncQWPlRZfr8FDHbAIH/KYfK+QdSXnBYqYAgn96ZW6yMEOuJgULKShAegHz7phNrfOu14jRHavaWPMbqZ8PLyVK6yvXbQG0jIVqZIVWeOu9thbAJTlSUlqxXjpeRP+reYLnwEFE+DT+oY6gFFKH2RSMa7LN8kfv9OA4yjMwqZvnFrQxNESa1CKm6BrxdTlAOQUTch/fA1eLFp15wIjapojnbvnnSb/XofqNZU8Xxas3xAiGZQA/q6bfGI1E/RDQRY/VQZ+/izcC8IggpCbgutX7ieOuYObFrZ1Eno2gqPqrtvZ1I0C2e/r3YNE5TBRm7OapvZ9hdAZENZg9frw+Mqbg5kxbknBPil3AXmQv/L9yO0XK+V2jcEw8lM2+33wGggrE7auogmCQlZXXYF0J/K7s= ceph-1256112e-77b3-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:49:36.706 INFO:teuthology.orchestra.run.smithi114.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbdTUutK6fZP6UvNZurPf12JY8vY8yjpxZXIFRCS9f93Cz8CrER7bhlJE5wr4QSBovrkbkQx7FGrrxc+a9rBhMVO/+ub/Z4AH1qvNhK0zzFncQWPlRZfr8FDHbAIH/KYfK+QdSXnBYqYAgn96ZW6yMEOuJgULKShAegHz7phNrfOu14jRHavaWPMbqZ8PLyVK6yvXbQG0jIVqZIVWeOu9thbAJTlSUlqxXjpeRP+reYLnwEFE+DT+oY6gFFKH2RSMa7LN8kfv9OA4yjMwqZvnFrQxNESa1CKm6BrxdTlAOQUTch/fA1eLFp15wIjapojnbvnnSb/XofqNZU8Xxas3xAiGZQA/q6bfGI1E/RDQRY/VQZ+/izcC8IggpCbgutX7ieOuYObFrZ1Eno2gqPqrtvZ1I0C2e/r3YNE5TBRm7OapvZ9hdAZENZg9frw+Mqbg5kxbknBPil3AXmQv/L9yO0XK+V2jcEw8lM2+33wGggrE7auogmCQlZXXYF0J/K7s= ceph-1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:49:36.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbdTUutK6fZP6UvNZurPf12JY8vY8yjpxZXIFRCS9f93Cz8CrER7bhlJE5wr4QSBovrkbkQx7FGrrxc+a9rBhMVO/+ub/Z4AH1qvNhK0zzFncQWPlRZfr8FDHbAIH/KYfK+QdSXnBYqYAgn96ZW6yMEOuJgULKShAegHz7phNrfOu14jRHavaWPMbqZ8PLyVK6yvXbQG0jIVqZIVWeOu9thbAJTlSUlqxXjpeRP+reYLnwEFE+DT+oY6gFFKH2RSMa7LN8kfv9OA4yjMwqZvnFrQxNESa1CKm6BrxdTlAOQUTch/fA1eLFp15wIjapojnbvnnSb/XofqNZU8Xxas3xAiGZQA/q6bfGI1E/RDQRY/VQZ+/izcC8IggpCbgutX7ieOuYObFrZ1Eno2gqPqrtvZ1I0C2e/r3YNE5TBRm7OapvZ9hdAZENZg9frw+Mqbg5kxbknBPil3AXmQv/L9yO0XK+V2jcEw8lM2+33wGggrE7auogmCQlZXXYF0J/K7s= ceph-1256112e-77b3-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T00:49:36.760 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbdTUutK6fZP6UvNZurPf12JY8vY8yjpxZXIFRCS9f93Cz8CrER7bhlJE5wr4QSBovrkbkQx7FGrrxc+a9rBhMVO/+ub/Z4AH1qvNhK0zzFncQWPlRZfr8FDHbAIH/KYfK+QdSXnBYqYAgn96ZW6yMEOuJgULKShAegHz7phNrfOu14jRHavaWPMbqZ8PLyVK6yvXbQG0jIVqZIVWeOu9thbAJTlSUlqxXjpeRP+reYLnwEFE+DT+oY6gFFKH2RSMa7LN8kfv9OA4yjMwqZvnFrQxNESa1CKm6BrxdTlAOQUTch/fA1eLFp15wIjapojnbvnnSb/XofqNZU8Xxas3xAiGZQA/q6bfGI1E/RDQRY/VQZ+/izcC8IggpCbgutX7ieOuYObFrZ1Eno2gqPqrtvZ1I0C2e/r3YNE5TBRm7OapvZ9hdAZENZg9frw+Mqbg5kxbknBPil3AXmQv/L9yO0XK+V2jcEw8lM2+33wGggrE7auogmCQlZXXYF0J/K7s= ceph-1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:49:36.773 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T00:49:36.924 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:36 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2859250723' entity='client.admin' 2024-09-21T00:49:37.033 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:49:38.279 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T00:49:38.279 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T00:49:38.862 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:49:38.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:38 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3717377190' entity='client.admin' 2024-09-21T00:49:38.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:38 smithi047 ceph-mon[30960]: mgrmap e14: x(active, since 12s) 2024-09-21T00:49:39.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:40.347 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi114 2024-09-21T00:49:40.347 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:49:40.347 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/etc/ceph/ceph.conf 2024-09-21T00:49:40.366 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:49:40.367 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:40.425 INFO:tasks.cephadm:Adding host smithi114 to orchestrator... 2024-09-21T00:49:40.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch host add smithi114 2024-09-21T00:49:40.676 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:49:41.014 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:40 smithi047 ceph-mon[30960]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:41.014 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:40 smithi047 ceph-mon[30960]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-21T00:49:41.014 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:40 smithi047 ceph-mon[30960]: Updating smithi047:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:41.014 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:40 smithi047 ceph-mon[30960]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:41.014 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:40 smithi047 ceph-mon[30960]: Updating smithi047:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:49:41.014 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:41.014 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:41.014 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:42.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:42 smithi047 ceph-mon[30960]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi114", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:43.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:43 smithi047 ceph-mon[30960]: Deploying cephadm binary to smithi114 2024-09-21T00:49:45.117 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi114' with addr '172.21.15.114' 2024-09-21T00:49:45.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T00:49:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:49:46.378 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:46.378 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:46 smithi047 ceph-mon[30960]: Added host smithi114 2024-09-21T00:49:46.378 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:46.379 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:46 smithi047 ceph-mon[30960]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:46.379 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:46.379 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:46.676 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:46.676 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.114", "hostname": "smithi114", "labels": [], "status": ""}] 2024-09-21T00:49:47.257 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-09-21T00:49:47.257 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:49:47.257 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-09-21T00:49:47.277 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:49:47.277 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:47.335 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-09-21T00:49:47.335 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch host add smithi134 2024-09-21T00:49:47.595 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:49:47.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:47.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:47 smithi047 ceph-mon[30960]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:49:48.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:48 smithi047 ceph-mon[30960]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:49.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:49 smithi047 ceph-mon[30960]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:49.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:49.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:49.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:49.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:49.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:49.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:49.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:50.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-21T00:49:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: Deploying cephadm binary to smithi134 2024-09-21T00:49:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:49:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:50 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:52.099 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-09-21T00:49:52.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:52 smithi047 ceph-mon[30960]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:52.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:52 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:52.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:52 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:52.688 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:52 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:52.717 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T00:49:52.967 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:49:53.597 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:49:53.597 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.114", "hostname": "smithi114", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-09-21T00:49:53.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:53 smithi047 ceph-mon[30960]: Added host smithi134 2024-09-21T00:49:53.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:53 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:53.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:53 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:54.192 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T00:49:54.192 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T00:49:54.444 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:49:54.863 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:54 smithi047 ceph-mon[30960]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:54.864 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:54 smithi047 ceph-mon[30960]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:49:55.617 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-09-21T00:49:55.925 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:55 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4161149803' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T00:49:56.268 INFO:tasks.cephadm:Adding mon.a on smithi047 2024-09-21T00:49:56.268 INFO:tasks.cephadm:Adding mon.b on smithi114 2024-09-21T00:49:56.268 INFO:tasks.cephadm:Adding mon.c on smithi134 2024-09-21T00:49:56.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi047:172.21.15.47=a;smithi114:172.21.15.114=b;smithi134:172.21.15.134=c' 2024-09-21T00:49:56.527 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4161149803' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"} : dispatch 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:57.152 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mon update... 2024-09-21T00:49:57.838 DEBUG:teuthology.orchestra.run.smithi114:mon.b> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T00:49:57.841 DEBUG:teuthology.orchestra.run.smithi134:mon.c> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T00:49:57.843 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:49:57.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:49:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-21T00:49:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:49:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:49:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:49:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:57.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:57.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:49:57.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:57.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:49:57.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:49:57.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:49:57.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:49:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:58 smithi047 ceph-mon[30960]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi114:172.21.15.114=b;smithi134:172.21.15.134=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:49:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:58 smithi047 ceph-mon[30960]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi114:172.21.15.114=b;smithi134:172.21.15.134=c;count:3 2024-09-21T00:49:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:58 smithi047 ceph-mon[30960]: Deploying daemon mon.c on smithi134 2024-09-21T00:49:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:49:58 smithi047 ceph-mon[30960]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:49:59.825 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:50:00.618 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:50:00.618 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","modified":"2024-09-21T00:48:33.302207Z","created":"2024-09-21T00:48:33.302207Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T00:50:00.619 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-09-21T00:50:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:00 smithi047 ceph-mon[30960]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:00 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/1632029631' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:00.979 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:00 smithi134 systemd[1]: Starting Ceph mon.c for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:50:01.775 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 podman[34766]: 2024-09-21 00:50:01.513379271 +0000 UTC m=+0.111268242 container create 12b713ce9ec33063d5651978d803d9d933e697d49767989a8718631b4b7c81c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T00:50:01.775 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 podman[34766]: 2024-09-21 00:50:01.418470791 +0000 UTC m=+0.016359776 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:50:01.776 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 podman[34766]: 2024-09-21 00:50:01.740946896 +0000 UTC m=+0.338835866 container init 12b713ce9ec33063d5651978d803d9d933e697d49767989a8718631b4b7c81c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T00:50:01.776 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 podman[34766]: 2024-09-21 00:50:01.744076025 +0000 UTC m=+0.341964996 container start 12b713ce9ec33063d5651978d803d9d933e697d49767989a8718631b4b7c81c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:50:02.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T00:50:02.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T00:50:02.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: pidfile_write: ignore empty --pid-file 2024-09-21T00:50:02.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: load: jerasure load: lrc 2024-09-21T00:50:02.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: RocksDB version: 7.9.2 2024-09-21T00:50:02.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Git sha 0 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: DB SUMMARY 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: DB Session ID: RNQ500974Q9OSSMBD968 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: CURRENT file: CURRENT 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.error_if_exists: 0 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.create_if_missing: 0 2024-09-21T00:50:02.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.paranoid_checks: 1 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.env: 0x55a873077d60 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.info_log: 0x55a87940d360 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.statistics: (nil) 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.use_fsync: 0 2024-09-21T00:50:02.097 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_log_file_size: 0 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.allow_fallocate: 1 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.use_direct_reads: 0 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T00:50:02.098 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.db_log_dir: 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.wal_dir: 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.write_buffer_manager: 0x55a879411d60 2024-09-21T00:50:02.099 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.unordered_write: 0 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T00:50:02.100 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.row_cache: None 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.wal_filter: None 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.two_write_queues: 0 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.wal_compression: 0 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.atomic_flush: 0 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T00:50:02.101 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T00:50:02.102 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.log_readahead_size: 0 2024-09-21T00:50:02.102 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T00:50:02.102 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T00:50:02.102 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T00:50:02.102 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T00:50:02.102 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T00:50:02.102 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T00:50:02.102 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_background_jobs: 2 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_background_compactions: -1 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_subcompactions: 1 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T00:50:02.104 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_open_files: -1 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_background_flushes: -1 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Compression algorithms supported: 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: kZSTD supported: 0 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: kXpressCompression supported: 0 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: kBZip2Compression supported: 0 2024-09-21T00:50:02.105 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: kLZ4Compression supported: 1 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: kZlibCompression supported: 1 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: kSnappyCompression supported: 1 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T00:50:02.106 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.merge_operator: 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_filter: None 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a87940cfa0) 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T00:50:02.107 INFO:journalctl@ceph.mon.c.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_type: 0 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: data_block_index_type: 0 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_shortening: 1 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: checksum: 4 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: no_block_cache: 0 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache: 0x55a8753d1610 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_options: 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: capacity : 536870912 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: num_shard_bits : 4 2024-09-21T00:50:02.108 INFO:journalctl@ceph.mon.c.smithi134.stdout: strict_capacity_limit : 0 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_cache_compressed: (nil) 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: persistent_cache: (nil) 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_size: 4096 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_size_deviation: 10 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_restart_interval: 16 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: index_block_restart_interval: 1 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: metadata_block_size: 4096 2024-09-21T00:50:02.109 INFO:journalctl@ceph.mon.c.smithi134.stdout: partition_filters: 0 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: use_delta_encoding: 1 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: filter_policy: bloomfilter 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: whole_key_filtering: 1 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: verify_compression: 0 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: format_version: 5 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: enable_index_compression: 1 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: block_align: 0 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: max_auto_readahead_size: 262144 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: prepopulate_block_cache: 0 2024-09-21T00:50:02.110 INFO:journalctl@ceph.mon.c.smithi134.stdout: initial_auto_readahead_size: 8192 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression: NoCompression 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.num_levels: 7 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T00:50:02.111 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T00:50:02.112 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T00:50:02.113 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T00:50:02.114 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T00:50:02.115 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T00:50:02.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T00:50:02.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T00:50:02.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T00:50:02.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T00:50:02.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T00:50:02.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T00:50:02.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T00:50:02.116 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.inplace_update_support: 0 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.bloom_locality: 0 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.max_successive_merges: 0 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.ttl: 2592000 2024-09-21T00:50:02.117 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.enable_blob_files: false 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.min_blob_size: 0 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T00:50:02.118 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d8ec6de3-b994-4373-b247-fc895a1e4fed 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879801780552, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879801780977, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726879801, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d8ec6de3-b994-4373-b247-fc895a1e4fed", "db_session_id": "RNQ500974Q9OSSMBD968", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726879801781080, "job": 1, "event": "recovery_finished"} 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T00:50:02.119 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a879430a80 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: DB pointer 0x55a87a1d6000 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** DB Stats ** 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T00:50:02.120 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** Compaction Stats [default] ** 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** Compaction Stats [default] ** 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-21T00:50:02.121 INFO:journalctl@ceph.mon.c.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: Interval compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T00:50:02.122 INFO:journalctl@ceph.mon.c.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout: Block cache BinnedLRUCache@0x55a8753d1610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: using public_addr v2:172.21.15.134:0/0 -> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: starting mon.c rank -1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(???) e0 preinit fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 bash[34766]: 12b713ce9ec33063d5651978d803d9d933e697d49767989a8718631b4b7c81c2 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 systemd[1]: Started Ceph mon.c for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T00:50:02.123 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout: e1 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout: btime 2024-09-21T00:48:36:406905+0000 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout: legacy client fscid: -1 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout: 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout: No filesystems configured 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T00:50:02.124 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.125 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Deploying cephadm binary to smithi134 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.126 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Added host smithi134 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4161149803' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T00:50:02.127 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4161149803' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-21T00:50:02.128 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:02.129 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:02.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:02.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi114:172.21.15.114=b;smithi134:172.21.15.134=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:02.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi114:172.21.15.114=b;smithi134:172.21.15.134=c;count:3 2024-09-21T00:50:02.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: Deploying daemon mon.c on smithi134 2024-09-21T00:50:02.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:02.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:02.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/1632029631' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:02.130 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:01 smithi134 ceph-mon[34785]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T00:50:02.275 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:50:02.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:50:02.525 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:50:07.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:07.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:07.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: mon.a calling monitor election 2024-09-21T00:50:07.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:07.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: mon.c calling monitor election 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: monmap epoch 2 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: last_changed 2024-09-21T00:50:01.809668+0000 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: min_mon_release 19 (squid) 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: election_strategy: 1 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:07.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: fsmap 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: mgrmap e14: x(active, since 41s) 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: overall HEALTH_OK 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:07.208 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: mon.a calling monitor election 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: mon.c calling monitor election 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: monmap epoch 2 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:07.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: last_changed 2024-09-21T00:50:01.809668+0000 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: min_mon_release 19 (squid) 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: election_strategy: 1 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: fsmap 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: mgrmap e14: x(active, since 41s) 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: overall HEALTH_OK 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:07.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:50:07.664 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","modified":"2024-09-21T00:50:01.809668Z","created":"2024-09-21T00:48:33.302207Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:50:07.664 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2024-09-21T00:50:07.988 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:07 smithi134 ceph-mon[34785]: Deploying daemon mon.b on smithi114 2024-09-21T00:50:07.988 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:07 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/1853020223' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:07.988 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:07 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:08.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:07 smithi047 ceph-mon[30960]: Deploying daemon mon.b on smithi114 2024-09-21T00:50:08.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:07 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/1853020223' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:08.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:07 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:09.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:08 smithi047 ceph-mon[30960]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:09.292 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:50:09.292 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:50:09.313 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:08 smithi134 ceph-mon[34785]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:09.546 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:50:10.293 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:50:10.294 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","modified":"2024-09-21T00:50:01.809668Z","created":"2024-09-21T00:48:33.302207Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:50:10.294 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout: e1 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout: btime 2024-09-21T00:48:36:406905+0000 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout: legacy client fscid: -1 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout: 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout: No filesystems configured 2024-09-21T00:50:10.564 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T00:50:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T00:50:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T00:50:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T00:50:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T00:50:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T00:50:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-21T00:50:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Deploying cephadm binary to smithi134 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Added host smithi134 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4161149803' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4161149803' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"} : dispatch 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:10.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:10.914 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi114:172.21.15.114=b;smithi134:172.21.15.134=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Saving service mon spec with placement smithi047:172.21.15.47=a;smithi114:172.21.15.114=b;smithi134:172.21.15.134=c;count:3 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Deploying daemon mon.c on smithi134 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/1632029631' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:10.915 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.a calling monitor election 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.c calling monitor election 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: monmap epoch 2 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:10.916 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: last_changed 2024-09-21T00:50:01.809668+0000 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: min_mon_release 19 (squid) 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: election_strategy: 1 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: fsmap 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mgrmap e14: x(active, since 41s) 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: overall HEALTH_OK 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:10.917 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: Deploying daemon mon.b on smithi114 2024-09-21T00:50:10.918 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/1853020223' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:10.918 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:10.918 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:10.918 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 ceph-mon[34309]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T00:50:10.918 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 bash[34290]: 0753b23967edd954f998d3172ec2d15112877b1a46fb1de4b63eb5eed39aee6d 2024-09-21T00:50:10.918 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:10 smithi114 systemd[1]: Started Ceph mon.b for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:50:11.890 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T00:50:11.941 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T00:50:12.196 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:50:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:50:15.931 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":3,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","modified":"2024-09-21T00:50:10.571743Z","created":"2024-09-21T00:48:33.302207Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:3300","nonce":0},{"type":"v1","addr":"172.21.15.114:6789","nonce":0}]},"addr":"172.21.15.114:6789/0","public_addr":"172.21.15.114:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T00:50:15.931 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 3 2024-09-21T00:50:15.931 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:15.931 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: mon.c calling monitor election 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: mon.a calling monitor election 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: monmap epoch 3 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:15.932 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: last_changed 2024-09-21T00:50:10.571743+0000 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: min_mon_release 19 (squid) 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: election_strategy: 1 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: 2: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: fsmap 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: mgrmap e14: x(active, since 50s) 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: overall HEALTH_OK 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:15.933 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:15.934 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: mon.c calling monitor election 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: mon.a calling monitor election 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: monmap epoch 3 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: last_changed 2024-09-21T00:50:10.571743+0000 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: min_mon_release 19 (squid) 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: election_strategy: 1 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: 2: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2024-09-21T00:50:15.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: fsmap 2024-09-21T00:50:15.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:15.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: mgrmap e14: x(active, since 50s) 2024-09-21T00:50:15.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: overall HEALTH_OK 2024-09-21T00:50:15.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:15.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:15.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:15.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:16.479 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T00:50:16.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T00:50:16.750 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:16.872 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:16 smithi047 ceph-mon[30960]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:16.872 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:16.872 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:16 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/2621031983' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:16.872 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:16.872 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:16.872 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:16.910 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:16 smithi134 ceph-mon[34785]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:16.910 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:16.910 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:16 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/2621031983' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:16.910 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:16.911 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:16.911 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:17.433 INFO:teuthology.orchestra.run.smithi047.stdout:# minimal ceph.conf for 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:17.433 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-09-21T00:50:17.433 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:17.434 INFO:teuthology.orchestra.run.smithi047.stdout: mon_host = [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: mon.c calling monitor election 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: mon.a calling monitor election 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:17.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: monmap epoch 3 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: last_changed 2024-09-21T00:50:10.571743+0000 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: min_mon_release 19 (squid) 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: election_strategy: 1 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:17.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: 2: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: fsmap 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: mgrmap e14: x(active, since 50s) 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: overall HEALTH_OK 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/2621031983' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T00:50:17.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:17.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:17.913 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.109 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T00:50:18.109 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:50:18.109 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:50:18.137 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:50:18.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:50:18.204 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:50:18.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:50:18.233 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:50:18.234 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:50:18.299 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:50:18.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T00:50:18.332 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:50:18.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T00:50:18.401 INFO:tasks.cephadm:Adding mgr.x on smithi047 2024-09-21T00:50:18.401 INFO:tasks.cephadm:Adding mgr.y on smithi114 2024-09-21T00:50:18.401 INFO:tasks.cephadm:Adding mgr.z on smithi134 2024-09-21T00:50:18.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi047=x;smithi114=y;smithi134=z' 2024-09-21T00:50:18.687 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:50:18.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: mon.b calling monitor election 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: Updating smithi047:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: mon.b calling monitor election 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: mon.c calling monitor election 2024-09-21T00:50:18.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: mon.a calling monitor election 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: monmap epoch 3 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: last_changed 2024-09-21T00:50:10.571743+0000 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: min_mon_release 19 (squid) 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: election_strategy: 1 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: 2: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2024-09-21T00:50:18.846 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: fsmap 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: mgrmap e14: x(active, since 52s) 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: overall HEALTH_OK 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: Reconfiguring daemon mon.a on smithi047 2024-09-21T00:50:18.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:18.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: mon.b calling monitor election 2024-09-21T00:50:18.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: Updating smithi047:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: mon.b calling monitor election 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: mon.c calling monitor election 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: mon.a calling monitor election 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: monmap epoch 3 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:18.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: last_changed 2024-09-21T00:50:10.571743+0000 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: min_mon_release 19 (squid) 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: election_strategy: 1 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: 2: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: fsmap 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: mgrmap e14: x(active, since 52s) 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: overall HEALTH_OK 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:50:18.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:18.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:18.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:18.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: Reconfiguring daemon mon.a on smithi047 2024-09-21T00:50:18.912 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:18.938 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: mon.b calling monitor election 2024-09-21T00:50:18.939 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:18.939 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-21T00:50:18.939 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-21T00:50:18.939 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-21T00:50:18.939 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: Updating smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.939 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: Updating smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: Updating smithi047:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T00:50:18.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: mon.b calling monitor election 2024-09-21T00:50:18.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: mon.c calling monitor election 2024-09-21T00:50:18.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: mon.a calling monitor election 2024-09-21T00:50:18.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T00:50:18.940 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: monmap epoch 3 2024-09-21T00:50:18.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:50:18.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: last_changed 2024-09-21T00:50:10.571743+0000 2024-09-21T00:50:18.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: created 2024-09-21T00:48:33.302207+0000 2024-09-21T00:50:18.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: min_mon_release 19 (squid) 2024-09-21T00:50:18.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: election_strategy: 1 2024-09-21T00:50:18.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-21T00:50:18.941 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: 1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2024-09-21T00:50:18.942 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: 2: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2024-09-21T00:50:18.942 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: fsmap 2024-09-21T00:50:18.942 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T00:50:18.942 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: mgrmap e14: x(active, since 52s) 2024-09-21T00:50:18.942 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: overall HEALTH_OK 2024-09-21T00:50:18.942 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.943 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.943 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:18.943 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T00:50:18.943 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:18.943 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:18.943 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:18.943 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: Reconfiguring daemon mon.a on smithi047 2024-09-21T00:50:18.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:50:19.335 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mgr update... 2024-09-21T00:50:19.865 DEBUG:teuthology.orchestra.run.smithi114:mgr.y> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T00:50:19.868 DEBUG:teuthology.orchestra.run.smithi134:mgr.z> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T00:50:19.870 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T00:50:19.870 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T00:50:19.873 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T00:50:19.873 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T00:50:19.917 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T00:50:19.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T00:50:19.961 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T00:50:19.961 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T00:50:20.004 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T00:50:20.004 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T00:50:20.048 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T00:50:20.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T00:50:20.091 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T00:50:20.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T00:50:20.135 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T00:50:20.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T00:50:20.179 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T00:50:20.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T00:50:20.201 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:20.203 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T00:50:20.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T00:50:20.254 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T00:50:20.255 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T00:50:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:20.300 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T00:50:20.300 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T00:50:20.345 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T00:50:20.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T00:50:20.388 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T00:50:20.388 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T00:50:20.436 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T00:50:20.437 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T00:50:20.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:20.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.437 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:50:20.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:20.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:20.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:20.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: Reconfiguring daemon mon.b on smithi114 2024-09-21T00:50:20.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi114=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:20.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: Saving service mgr spec with placement smithi047=x;smithi114=y;smithi134=z;count:3 2024-09-21T00:50:20.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.488 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T00:50:20.488 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T00:50:20.531 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T00:50:20.531 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: Reconfiguring daemon mon.b on smithi114 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi114=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:20.545 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: Saving service mgr spec with placement smithi047=x;smithi114=y;smithi134=z;count:3 2024-09-21T00:50:20.546 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.581 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T00:50:20.582 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T00:50:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: Reconfiguring mon.b (monmap changed)... 2024-09-21T00:50:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:20.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: Reconfiguring daemon mon.b on smithi114 2024-09-21T00:50:20.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi047=x;smithi114=y;smithi134=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:20.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: Saving service mgr spec with placement smithi047=x;smithi114=y;smithi134=z;count:3 2024-09-21T00:50:20.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:20.625 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T00:50:20.625 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T00:50:20.671 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T00:50:20.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T00:50:20.715 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T00:50:20.715 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T00:50:20.759 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T00:50:20.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T00:50:20.811 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T00:50:20.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T00:50:20.862 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T00:50:20.862 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T00:50:20.917 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T00:50:20.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T00:50:20.966 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T00:50:20.966 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T00:50:21.013 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T00:50:21.014 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi047') 2024-09-21T00:50:21.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:50:21.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:21.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:21.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: Reconfiguring daemon mon.c on smithi134 2024-09-21T00:50:21.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:21 smithi047 ceph-mon[30960]: from='client.? ' entity='client.admin' 2024-09-21T00:50:21.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:50:21.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:21.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:21.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:21.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: Reconfiguring daemon mon.c on smithi134 2024-09-21T00:50:21.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:21 smithi134 ceph-mon[34785]: from='client.? ' entity='client.admin' 2024-09-21T00:50:21.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:21.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: Reconfiguring mon.c (monmap changed)... 2024-09-21T00:50:21.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T00:50:21.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T00:50:21.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:21.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: Reconfiguring daemon mon.c on smithi134 2024-09-21T00:50:21.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:21 smithi114 ceph-mon[34309]: from='client.? ' entity='client.admin' 2024-09-21T00:50:22.088 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi047') 2024-09-21T00:50:22.100 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:23.191 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:23.191 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.191 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.191 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:23.191 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:23.191 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:23.192 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.192 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:23.192 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:50:23.192 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:23.192 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:23.192 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:22 smithi134 ceph-mon[34785]: Deploying daemon mgr.z on smithi134 2024-09-21T00:50:23.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:22 smithi047 ceph-mon[30960]: Deploying daemon mgr.z on smithi134 2024-09-21T00:50:23.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 -- 172.21.15.47:0/696853436 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1d2803fb20 msgr2=0x7f1d28042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:23.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 --2- 172.21.15.47:0/696853436 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1d2803fb20 0x7f1d28042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d34006010 tx=0x7f1d34000bc0 comp rx=0 tx=0).stop 2024-09-21T00:50:23.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 -- 172.21.15.47:0/696853436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d4006c340 msgr2=0x7f1d40199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 --2- 172.21.15.47:0/696853436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d4006c340 0x7f1d40199d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000eb90 tx=0x7f1d3000c6a0 comp rx=0 tx=0).stop 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 -- 172.21.15.47:0/696853436 shutdown_connections 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 --2- 172.21.15.47:0/696853436 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1d2803fb20 0x7f1d28042030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 --2- 172.21.15.47:0/696853436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d401094a0 0x7f1d4019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 --2- 172.21.15.47:0/696853436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d40106900 0x7f1d4019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 --2- 172.21.15.47:0/696853436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d4006c340 0x7f1d40199d50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 -- 172.21.15.47:0/696853436 >> 172.21.15.47:0/696853436 conn(0x7f1d400fdfe0 msgr2=0x7f1d40104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 -- 172.21.15.47:0/696853436 shutdown_connections 2024-09-21T00:50:23.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:23.276+0000 7f1d4538f640 1 -- 172.21.15.47:0/696853436 wait complete. 2024-09-21T00:50:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:22 smithi114 ceph-mon[34309]: Deploying daemon mgr.z on smithi134 2024-09-21T00:50:23.665 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi047') 2024-09-21T00:50:24.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:23 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1325365594' entity='client.admin' 2024-09-21T00:50:24.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:23 smithi134 ceph-mon[34785]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:24.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:23 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/696853436' entity='client.admin' 2024-09-21T00:50:24.345 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 00:50:24 smithi134 systemd[1]: Started Ceph mgr.z for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:50:24.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:23 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1325365594' entity='client.admin' 2024-09-21T00:50:24.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:23 smithi114 ceph-mon[34309]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:24.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:23 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/696853436' entity='client.admin' 2024-09-21T00:50:24.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:23 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1325365594' entity='client.admin' 2024-09-21T00:50:24.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:23 smithi047 ceph-mon[30960]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:24.418 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:23 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/696853436' entity='client.admin' 2024-09-21T00:50:24.446 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.446 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.446 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.447 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.448 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.453 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-09-21T00:50:24.454 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.456 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.470 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.486 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.518 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.548 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:24.876 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:25.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:25.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:50:25.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:25.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:25.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:25 smithi114 ceph-mon[34309]: Deploying daemon mgr.y on smithi114 2024-09-21T00:50:25.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:25.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:50:25.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:25.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:25.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:25 smithi047 ceph-mon[30960]: Deploying daemon mgr.y on smithi114 2024-09-21T00:50:25.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:25.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:25.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T00:50:25.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:25.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:25.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:25 smithi134 ceph-mon[34785]: Deploying daemon mgr.y on smithi114 2024-09-21T00:50:26.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 -- 172.21.15.47:0/1746005726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 msgr2=0x7ff67c103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1746005726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 0x7ff67c103a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009900 tx=0x7ff66c02a410 comp rx=0 tx=0).stop 2024-09-21T00:50:26.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 -- 172.21.15.47:0/1746005726 shutdown_connections 2024-09-21T00:50:26.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1746005726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c104140 0x7ff67c10abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1746005726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 0x7ff67c103a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1746005726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c102b50 0x7ff67c102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 -- 172.21.15.47:0/1746005726 >> 172.21.15.47:0/1746005726 conn(0x7ff67c0fd770 msgr2=0x7ff67c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 -- 172.21.15.47:0/1746005726 shutdown_connections 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.077+0000 7ff683fcb640 1 -- 172.21.15.47:0/1746005726 wait complete. 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff683fcb640 1 Processor -- start 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff683fcb640 1 -- start start 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff683fcb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c102b50 0x7ff67c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff683fcb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 0x7ff67c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff683fcb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c104140 0x7ff67c199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff683fcb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10dfe0 con 0x7ff67c103530 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff683fcb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10de60 con 0x7ff67c102b50 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff683fcb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10e160 con 0x7ff67c104140 2024-09-21T00:50:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff681566640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 0x7ff67c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff681566640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 0x7ff67c199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56656/0 (socket says 172.21.15.47:56656) 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff681566640 1 -- 172.21.15.47:0/1654581278 learned_addr learned my addr 172.21.15.47:0/1654581278 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff681d67640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c102b50 0x7ff67c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.078+0000 7ff682568640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c104140 0x7ff67c199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff681d67640 1 -- 172.21.15.47:0/1654581278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c104140 msgr2=0x7ff67c199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff681d67640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c104140 0x7ff67c199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff681d67640 1 -- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 msgr2=0x7ff67c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff681d67640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 0x7ff67c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff681d67640 1 -- 172.21.15.47:0/1654581278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c19a720 con 0x7ff67c102b50 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff681566640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 0x7ff67c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff681d67640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c102b50 0x7ff67c198cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff67800e9f0 tx=0x7ff67800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff672ffd640 1 -- 172.21.15.47:0/1654581278 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67800cd80 con 0x7ff67c102b50 2024-09-21T00:50:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff672ffd640 1 -- 172.21.15.47:0/1654581278 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7ff678004490 con 0x7ff67c102b50 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff672ffd640 1 -- 172.21.15.47:0/1654581278 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678010430 con 0x7ff67c102b50 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c19aa10 con 0x7ff67c102b50 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.079+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c1a1110 con 0x7ff67c102b50 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.081+0000 7ff672ffd640 1 -- 172.21.15.47:0/1654581278 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7ff6780105d0 con 0x7ff67c102b50 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.081+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c10e7a0 con 0x7ff67c102b50 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.081+0000 7ff672ffd640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff66803fb20 0x7ff668042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.081+0000 7ff672ffd640 1 -- 172.21.15.47:0/1654581278 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff6780546f0 con 0x7ff67c102b50 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.081+0000 7ff681566640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff66803fb20 0x7ff668042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.081+0000 7ff681566640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff66803fb20 0x7ff668042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0096c0 tx=0x7ff66c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.086+0000 7ff672ffd640 1 -- 172.21.15.47:0/1654581278 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff678016330 con 0x7ff67c102b50 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.279+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7ff67c02e870 con 0x7ff67c102b50 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.285+0000 7ff672ffd640 1 -- 172.21.15.47:0/1654581278 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v13)=0 v13) ==== 117+0+0 (secure 0 0 0) 0x7ff678013190 con 0x7ff67c102b50 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff66803fb20 msgr2=0x7ff668042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff66803fb20 0x7ff668042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0096c0 tx=0x7ff66c005a20 comp rx=0 tx=0).stop 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c102b50 msgr2=0x7ff67c198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c102b50 0x7ff67c198cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff67800e9f0 tx=0x7ff67800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 shutdown_connections 2024-09-21T00:50:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff66803fb20 0x7ff668042030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff67c104140 0x7ff67c199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff67c103530 0x7ff67c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 --2- 172.21.15.47:0/1654581278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c102b50 0x7ff67c198cf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 >> 172.21.15.47:0/1654581278 conn(0x7ff67c0fd770 msgr2=0x7ff67c106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 shutdown_connections 2024-09-21T00:50:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.288+0000 7ff683fcb640 1 -- 172.21.15.47:0/1654581278 wait complete. 2024-09-21T00:50:26.125 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 00:50:25 smithi114 systemd[1]: Starting Ceph mgr.y for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:50:26.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:26 smithi047 ceph-mon[30960]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:26.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:26 smithi047 ceph-mon[30960]: from='client.? ' entity='client.admin' 2024-09-21T00:50:26.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:26 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/354945848' entity='client.admin' 2024-09-21T00:50:26.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:26 smithi114 ceph-mon[34309]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:26.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:26 smithi114 ceph-mon[34309]: from='client.? ' entity='client.admin' 2024-09-21T00:50:26.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:26 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/354945848' entity='client.admin' 2024-09-21T00:50:26.410 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 00:50:26 smithi114 podman[35116]: 2024-09-21 00:50:26.027444865 +0000 UTC m=+0.016110096 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:50:26.410 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 00:50:26 smithi114 podman[35116]: 2024-09-21 00:50:26.134003342 +0000 UTC m=+0.122668557 container create 99048e0d70dce33867d25d947733e99429cf9ea240dba9a6dba00cbc74d0544c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T00:50:26.410 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 00:50:26 smithi114 podman[35116]: 2024-09-21 00:50:26.334682766 +0000 UTC m=+0.323348054 container init 99048e0d70dce33867d25d947733e99429cf9ea240dba9a6dba00cbc74d0544c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T00:50:26.410 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 00:50:26 smithi114 podman[35116]: 2024-09-21 00:50:26.337556491 +0000 UTC m=+0.326221707 container start 99048e0d70dce33867d25d947733e99429cf9ea240dba9a6dba00cbc74d0544c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:50:26.410 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 00:50:26 smithi114 ceph-mgr[35135]: -- 172.21.15.114:0/3939318420 <== mon.2 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625b5d210e0 con 0x5625b5d3fa80 2024-09-21T00:50:26.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 -- 172.21.15.47:0/4076256431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0501040a0 msgr2=0x7ff05010aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 --2- 172.21.15.47:0/4076256431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0501040a0 0x7ff05010aa40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff048009ca0 tx=0x7ff04802a950 comp rx=0 tx=0).stop 2024-09-21T00:50:26.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 -- 172.21.15.47:0/4076256431 shutdown_connections 2024-09-21T00:50:26.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 --2- 172.21.15.47:0/4076256431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff0501040a0 0x7ff05010aa40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 --2- 172.21.15.47:0/4076256431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff050103700 0x7ff050103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 --2- 172.21.15.47:0/4076256431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff050102670 0x7ff050102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 -- 172.21.15.47:0/4076256431 >> 172.21.15.47:0/4076256431 conn(0x7ff0500fdfe0 msgr2=0x7ff050100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:26.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 -- 172.21.15.47:0/4076256431 shutdown_connections 2024-09-21T00:50:26.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.429+0000 7ff0583d2640 1 -- 172.21.15.47:0/4076256431 wait complete. 2024-09-21T00:50:26.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff0583d2640 1 Processor -- start 2024-09-21T00:50:26.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff0583d2640 1 -- start start 2024-09-21T00:50:26.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff0583d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff050102670 0x7ff05006c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff0583d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff050103700 0x7ff05019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff0583d2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501040a0 0x7ff0501a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff0583d2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff05010e020 con 0x7ff050102670 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff0583d2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff05010dea0 con 0x7ff0501040a0 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff0583d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff05010e1a0 con 0x7ff050103700 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff05616e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff050102670 0x7ff05006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff05616e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff050102670 0x7ff05006c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56702/0 (socket says 172.21.15.47:56702) 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff05616e640 1 -- 172.21.15.47:0/2865283788 learned_addr learned my addr 172.21.15.47:0/2865283788 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff05596d640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff050103700 0x7ff05019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff05696f640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501040a0 0x7ff0501a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.430+0000 7ff05616e640 1 -- 172.21.15.47:0/2865283788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff050103700 msgr2=0x7ff05019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff05616e640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff050103700 0x7ff05019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff05616e640 1 -- 172.21.15.47:0/2865283788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501040a0 msgr2=0x7ff0501a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff05616e640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501040a0 0x7ff0501a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff05616e640 1 -- 172.21.15.47:0/2865283788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0501a1880 con 0x7ff050102670 2024-09-21T00:50:26.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff05616e640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff050102670 0x7ff05006c060 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00d950 tx=0x7ff04c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:26.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff0477fe640 1 -- 172.21.15.47:0/2865283788 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c017030 con 0x7ff050102670 2024-09-21T00:50:26.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0501a1b70 con 0x7ff050102670 2024-09-21T00:50:26.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff0477fe640 1 -- 172.21.15.47:0/2865283788 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7ff04c004020 con 0x7ff050102670 2024-09-21T00:50:26.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff0477fe640 1 -- 172.21.15.47:0/2865283788 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c005580 con 0x7ff050102670 2024-09-21T00:50:26.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.431+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0501a20b0 con 0x7ff050102670 2024-09-21T00:50:26.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.432+0000 7ff0477fe640 1 -- 172.21.15.47:0/2865283788 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7ff04c0047a0 con 0x7ff050102670 2024-09-21T00:50:26.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.432+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff050102ae0 con 0x7ff050102670 2024-09-21T00:50:26.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.432+0000 7ff0477fe640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff03c03fb20 0x7ff03c042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.432+0000 7ff0477fe640 1 -- 172.21.15.47:0/2865283788 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff04c053e90 con 0x7ff050102670 2024-09-21T00:50:26.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.432+0000 7ff05596d640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff03c03fb20 0x7ff03c042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.433+0000 7ff05596d640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff03c03fb20 0x7ff03c042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff040009b50 tx=0x7ff040005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:26.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.437+0000 7ff0477fe640 1 -- 172.21.15.47:0/2865283788 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff04c004a90 con 0x7ff050102670 2024-09-21T00:50:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:26 smithi134 ceph-mon[34785]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:26 smithi134 ceph-mon[34785]: from='client.? ' entity='client.admin' 2024-09-21T00:50:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:26 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/354945848' entity='client.admin' 2024-09-21T00:50:26.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.638+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7ff050063fc0 con 0x7ff050102670 2024-09-21T00:50:26.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.642+0000 7ff0477fe640 1 -- 172.21.15.47:0/2865283788 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v15)=0 v15) ==== 106+0+0 (secure 0 0 0) 0x7ff04c004d70 con 0x7ff050102670 2024-09-21T00:50:26.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.644+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff03c03fb20 msgr2=0x7ff03c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.644+0000 7ff0583d2640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff03c03fb20 0x7ff03c042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff040009b50 tx=0x7ff040005f90 comp rx=0 tx=0).stop 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.644+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff050102670 msgr2=0x7ff05006c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.644+0000 7ff0583d2640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff050102670 0x7ff05006c060 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00d950 tx=0x7ff04c00de10 comp rx=0 tx=0).stop 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.645+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 shutdown_connections 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.645+0000 7ff0583d2640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff03c03fb20 0x7ff03c042030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.645+0000 7ff0583d2640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501040a0 0x7ff0501a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.645+0000 7ff0583d2640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff050103700 0x7ff05019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.645+0000 7ff0583d2640 1 --2- 172.21.15.47:0/2865283788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff050102670 0x7ff05006c060 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.645+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 >> 172.21.15.47:0/2865283788 conn(0x7ff0500fdfe0 msgr2=0x7ff050106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.645+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 shutdown_connections 2024-09-21T00:50:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.645+0000 7ff0583d2640 1 -- 172.21.15.47:0/2865283788 wait complete. 2024-09-21T00:50:26.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 -- 172.21.15.47:0/549289663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 msgr2=0x7f00d0108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/549289663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 0x7f00d0108d30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009900 tx=0x7f00b802a410 comp rx=0 tx=0).stop 2024-09-21T00:50:26.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 -- 172.21.15.47:0/549289663 shutdown_connections 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/549289663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d0109470 0x7f00d010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/549289663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 0x7f00d0108d30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/549289663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d006b980 0x7f00d0106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 -- 172.21.15.47:0/549289663 >> 172.21.15.47:0/549289663 conn(0x7f00d00fdfb0 msgr2=0x7f00d0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 -- 172.21.15.47:0/549289663 shutdown_connections 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.650+0000 7f00d5ba8640 1 -- 172.21.15.47:0/549289663 wait complete. 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00d5ba8640 1 Processor -- start 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00d5ba8640 1 -- start start 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00d5ba8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d006b980 0x7f00d019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00d5ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 0x7f00d019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00d5ba8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d0109470 0x7f00d019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00d5ba8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00d010f150 con 0x7f00d01068d0 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00d5ba8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f00d010efd0 con 0x7f00d006b980 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00d5ba8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00d010f2d0 con 0x7f00d0109470 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 0x7f00d019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 0x7f00d019c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56720/0 (socket says 172.21.15.47:56720) 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00c7fff640 1 -- 172.21.15.47:0/3221824550 learned_addr learned my addr 172.21.15.47:0/3221824550 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00cf7fe640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d006b980 0x7f00d019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.651+0000 7f00cffff640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d0109470 0x7f00d019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00c7fff640 1 -- 172.21.15.47:0/3221824550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d0109470 msgr2=0x7f00d019d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00c7fff640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d0109470 0x7f00d019d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00c7fff640 1 -- 172.21.15.47:0/3221824550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d006b980 msgr2=0x7f00d019c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00c7fff640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d006b980 0x7f00d019c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00c7fff640 1 -- 172.21.15.47:0/3221824550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d019da30 con 0x7f00d01068d0 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00cf7fe640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d006b980 0x7f00d019c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00c7fff640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 0x7f00d019c670 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00b802aa00 tx=0x7f00b8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00cd7fa640 1 -- 172.21.15.47:0/3221824550 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b803f070 con 0x7f00d01068d0 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00cd7fa640 1 -- 172.21.15.47:0/3221824550 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f00b8031b20 con 0x7f00d01068d0 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d019dcc0 con 0x7f00d01068d0 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00cd7fa640 1 -- 172.21.15.47:0/3221824550 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b8035030 con 0x7f00d01068d0 2024-09-21T00:50:26.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.652+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d01a4420 con 0x7f00d01068d0 2024-09-21T00:50:26.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.653+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d0106d20 con 0x7f00d01068d0 2024-09-21T00:50:26.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.654+0000 7f00cd7fa640 1 -- 172.21.15.47:0/3221824550 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f00b8042070 con 0x7f00d01068d0 2024-09-21T00:50:26.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.654+0000 7f00cd7fa640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00bc03fb20 0x7f00bc042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.654+0000 7f00cd7fa640 1 -- 172.21.15.47:0/3221824550 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f00b8074e40 con 0x7f00d01068d0 2024-09-21T00:50:26.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.654+0000 7f00cf7fe640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00bc03fb20 0x7f00bc042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.655+0000 7f00cf7fe640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00bc03fb20 0x7f00bc042030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009fc0 tx=0x7f00c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:26.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.659+0000 7f00cd7fa640 1 -- 172.21.15.47:0/3221824550 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00b803b460 con 0x7f00d01068d0 2024-09-21T00:50:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.925+0000 7fde15614640 1 -- 172.21.15.47:0/3325091552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 msgr2=0x7fde1010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.925+0000 7fde15614640 1 --2- 172.21.15.47:0/3325091552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 0x7fde1010aa10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fde08009ca0 tx=0x7fde0802a950 comp rx=0 tx=0).stop 2024-09-21T00:50:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 -- 172.21.15.47:0/3325091552 shutdown_connections 2024-09-21T00:50:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 --2- 172.21.15.47:0/3325091552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 0x7fde1010aa10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 --2- 172.21.15.47:0/3325091552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde101036d0 0x7fde10103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 --2- 172.21.15.47:0/3325091552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde10102640 0x7fde10102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 -- 172.21.15.47:0/3325091552 >> 172.21.15.47:0/3325091552 conn(0x7fde100fdfb0 msgr2=0x7fde10100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 -- 172.21.15.47:0/3325091552 shutdown_connections 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 -- 172.21.15.47:0/3325091552 wait complete. 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 Processor -- start 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.926+0000 7fde15614640 1 -- start start 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde15614640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde10102640 0x7fde10198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde15614640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde101036d0 0x7fde101992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde15614640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 0x7fde10199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde15614640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fde1010dff0 con 0x7fde10104070 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde15614640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fde1010de70 con 0x7fde101036d0 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde15614640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde1010e170 con 0x7fde10102640 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 0x7fde10199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 0x7fde10199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56676/0 (socket says 172.21.15.47:56676) 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 -- 172.21.15.47:0/354945848 learned_addr learned my addr 172.21.15.47:0/354945848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:26.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0e7fc640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde101036d0 0x7fde101992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0effd640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde10102640 0x7fde10198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 -- 172.21.15.47:0/354945848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde10102640 msgr2=0x7fde10198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde10102640 0x7fde10198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 -- 172.21.15.47:0/354945848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde101036d0 msgr2=0x7fde101992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde101036d0 0x7fde101992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 -- 172.21.15.47:0/354945848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1019a6b0 con 0x7fde10104070 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.927+0000 7fde0f7fe640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 0x7fde10199e90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde08004af0 tx=0x7fde0802fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.928+0000 7fde07fff640 1 -- 172.21.15.47:0/354945848 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08034040 con 0x7fde10104070 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.928+0000 7fde07fff640 1 -- 172.21.15.47:0/354945848 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fde080308d0 con 0x7fde10104070 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.928+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1019a940 con 0x7fde10104070 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.928+0000 7fde07fff640 1 -- 172.21.15.47:0/354945848 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08004820 con 0x7fde10104070 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.928+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde101a0ed0 con 0x7fde10104070 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.929+0000 7fde07fff640 1 -- 172.21.15.47:0/354945848 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7fde08037020 con 0x7fde10104070 2024-09-21T00:50:26.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.929+0000 7fde07fff640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddfc03fb20 0x7fddfc042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.929+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde10102ab0 con 0x7fde10104070 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.929+0000 7fde07fff640 1 -- 172.21.15.47:0/354945848 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fde080760a0 con 0x7fde10104070 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.929+0000 7fde0effd640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddfc03fb20 0x7fddfc042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.929+0000 7fde0effd640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddfc03fb20 0x7fddfc042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fde00005d00 tx=0x7fde0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:25.934+0000 7fde07fff640 1 -- 172.21.15.47:0/354945848 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde08043d70 con 0x7fde10104070 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.126+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fde10109820 con 0x7fde10104070 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.129+0000 7fde07fff640 1 -- 172.21.15.47:0/354945848 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7fde10109820 con 0x7fde10104070 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddfc03fb20 msgr2=0x7fddfc042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddfc03fb20 0x7fddfc042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fde00005d00 tx=0x7fde0000b410 comp rx=0 tx=0).stop 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 msgr2=0x7fde10199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 0x7fde10199e90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde08004af0 tx=0x7fde0802fb00 comp rx=0 tx=0).stop 2024-09-21T00:50:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 shutdown_connections 2024-09-21T00:50:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddfc03fb20 0x7fddfc042030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde10104070 0x7fde10199e90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde101036d0 0x7fde101992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 --2- 172.21.15.47:0/354945848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde10102640 0x7fde10198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 >> 172.21.15.47:0/354945848 conn(0x7fde100fdfb0 msgr2=0x7fde101069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 shutdown_connections 2024-09-21T00:50:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.131+0000 7fde15614640 1 -- 172.21.15.47:0/354945848 wait complete. 2024-09-21T00:50:26.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.852+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f00d01a49d0 con 0x7f00d01068d0 2024-09-21T00:50:26.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.856+0000 7f00cd7fa640 1 -- 172.21.15.47:0/3221824550 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v16)=0 v16) ==== 127+0+0 (secure 0 0 0) 0x7f00b8039d70 con 0x7f00d01068d0 2024-09-21T00:50:26.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00bc03fb20 msgr2=0x7f00bc042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00bc03fb20 0x7f00bc042030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009fc0 tx=0x7f00c0005f90 comp rx=0 tx=0).stop 2024-09-21T00:50:26.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 msgr2=0x7f00d019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:26.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 0x7f00d019c670 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00b802aa00 tx=0x7f00b8003c10 comp rx=0 tx=0).stop 2024-09-21T00:50:26.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 shutdown_connections 2024-09-21T00:50:26.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00bc03fb20 0x7f00bc042030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d0109470 0x7f00d019d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01068d0 0x7f00d019c670 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 --2- 172.21.15.47:0/3221824550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d006b980 0x7f00d019c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:26.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 >> 172.21.15.47:0/3221824550 conn(0x7f00d00fdfb0 msgr2=0x7f00d01003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:26.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 shutdown_connections 2024-09-21T00:50:26.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:26.858+0000 7f00d5ba8640 1 -- 172.21.15.47:0/3221824550 wait complete. 2024-09-21T00:50:26.909 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 00:50:26 smithi114 bash[35116]: 99048e0d70dce33867d25d947733e99429cf9ea240dba9a6dba00cbc74d0544c 2024-09-21T00:50:26.909 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 00:50:26 smithi114 systemd[1]: Started Ceph mgr.y for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:50:27.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:27.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:27 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2865283788' entity='client.admin' 2024-09-21T00:50:27.676 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:27 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3221824550' entity='client.admin' 2024-09-21T00:50:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:27 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2865283788' entity='client.admin' 2024-09-21T00:50:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:27 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3221824550' entity='client.admin' 2024-09-21T00:50:27.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:27.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:27.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:27 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2865283788' entity='client.admin' 2024-09-21T00:50:27.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:27 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3221824550' entity='client.admin' 2024-09-21T00:50:28.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 -- 172.21.15.47:0/3845847298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9830105210 msgr2=0x7f983010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 --2- 172.21.15.47:0/3845847298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9830105210 0x7f983010bbb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9828009ca0 tx=0x7f982802a950 comp rx=0 tx=0).stop 2024-09-21T00:50:28.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 -- 172.21.15.47:0/3845847298 shutdown_connections 2024-09-21T00:50:28.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 --2- 172.21.15.47:0/3845847298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9830105210 0x7f983010bbb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 --2- 172.21.15.47:0/3845847298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9830104870 0x7f9830104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 --2- 172.21.15.47:0/3845847298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98301037e0 0x7f9830103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 -- 172.21.15.47:0/3845847298 >> 172.21.15.47:0/3845847298 conn(0x7f98300ff150 msgr2=0x7f9830101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:28.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 -- 172.21.15.47:0/3845847298 shutdown_connections 2024-09-21T00:50:28.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.235+0000 7f983770b640 1 -- 172.21.15.47:0/3845847298 wait complete. 2024-09-21T00:50:28.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f983770b640 1 Processor -- start 2024-09-21T00:50:28.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f983770b640 1 -- start start 2024-09-21T00:50:28.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f983770b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98301037e0 0x7f9830076dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:28.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f983770b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9830104870 0x7f9830075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:28.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f983770b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9830105210 0x7f9830075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:28.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f983770b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f983010f190 con 0x7f98301037e0 2024-09-21T00:50:28.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f983770b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f983010f010 con 0x7f9830105210 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f983770b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f983010f310 con 0x7f9830104870 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f98354a7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98301037e0 0x7f9830076dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f98354a7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98301037e0 0x7f9830076dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56734/0 (socket says 172.21.15.47:56734) 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.236+0000 7f98354a7640 1 -- 172.21.15.47:0/3116797640 learned_addr learned my addr 172.21.15.47:0/3116797640 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f9835ca8640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9830105210 0x7f9830075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f9834ca6640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9830104870 0x7f9830075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98354a7640 1 -- 172.21.15.47:0/3116797640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9830104870 msgr2=0x7f9830075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98354a7640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9830104870 0x7f9830075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98354a7640 1 -- 172.21.15.47:0/3116797640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9830105210 msgr2=0x7f9830075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98354a7640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9830105210 0x7f9830075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98354a7640 1 -- 172.21.15.47:0/3116797640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98300762f0 con 0x7f98301037e0 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98354a7640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98301037e0 0x7f9830076dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d770 tx=0x7f982c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:28.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98267fc640 1 -- 172.21.15.47:0/3116797640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c017070 con 0x7f98301037e0 2024-09-21T00:50:28.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98267fc640 1 -- 172.21.15.47:0/3116797640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f982c005490 con 0x7f98301037e0 2024-09-21T00:50:28.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98301a3f00 con 0x7f98301037e0 2024-09-21T00:50:28.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f98267fc640 1 -- 172.21.15.47:0/3116797640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c004b10 con 0x7f98301037e0 2024-09-21T00:50:28.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.237+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98301a42a0 con 0x7f98301037e0 2024-09-21T00:50:28.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.238+0000 7f98267fc640 1 -- 172.21.15.47:0/3116797640 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f982c004cb0 con 0x7f98301037e0 2024-09-21T00:50:28.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.238+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983010f950 con 0x7f98301037e0 2024-09-21T00:50:28.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.239+0000 7f98267fc640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f981c03fb20 0x7f981c042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:28.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.239+0000 7f98267fc640 1 -- 172.21.15.47:0/3116797640 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f982c053fa0 con 0x7f98301037e0 2024-09-21T00:50:28.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.239+0000 7f9834ca6640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f981c03fb20 0x7f981c042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:28.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.239+0000 7f9834ca6640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f981c03fb20 0x7f981c042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9820005d00 tx=0x7f982000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:28.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.243+0000 7f98267fc640 1 -- 172.21.15.47:0/3116797640 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f982c009c30 con 0x7f98301037e0 2024-09-21T00:50:28.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.434+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f983002e640 con 0x7f98301037e0 2024-09-21T00:50:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/1530161136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 msgr2=0x7f1f9810db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/1530161136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 0x7f1f9810db90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009ca0 tx=0x7f1f9002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/1530161136 shutdown_connections 2024-09-21T00:50:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/1530161136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 0x7f1f9810db90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/1530161136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f98108cd0 0x7f1f9810b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/1530161136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9806b7b0 0x7f1f98108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/1530161136 >> 172.21.15.47:0/1530161136 conn(0x7f1f980fdfb0 msgr2=0x7f1f98100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/1530161136 shutdown_connections 2024-09-21T00:50:28.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.436+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/1530161136 wait complete. 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9fd3d640 1 Processor -- start 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9fd3d640 1 -- start start 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9fd3d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9806b7b0 0x7f1f9819bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9fd3d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f98108cd0 0x7f1f9819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9fd3d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 0x7f1f9819d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9fd3d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f981112c0 con 0x7f1f9810b680 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9fd3d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98111140 con 0x7f1f9806b7b0 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9fd3d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98111440 con 0x7f1f98108cd0 2024-09-21T00:50:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9e2da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 0x7f1f9819d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9dad9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9806b7b0 0x7f1f9819bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9e2da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 0x7f1f9819d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56748/0 (socket says 172.21.15.47:56748) 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9e2da640 1 -- 172.21.15.47:0/3578539724 learned_addr learned my addr 172.21.15.47:0/3578539724 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.437+0000 7f1f9d2d8640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f98108cd0 0x7f1f9819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f1f9dad9640 1 -- 172.21.15.47:0/3578539724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f98108cd0 msgr2=0x7f1f9819c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f1f9dad9640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f98108cd0 0x7f1f9819c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f1f9dad9640 1 -- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 msgr2=0x7f1f9819d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f1f9dad9640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 0x7f1f9819d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f1f9dad9640 1 -- 172.21.15.47:0/3578539724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9819d9a0 con 0x7f1f9806b7b0 2024-09-21T00:50:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f1f9e2da640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 0x7f1f9819d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:28.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f98267fc640 1 -- 172.21.15.47:0/3116797640 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v17)=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f982c010d90 con 0x7f98301037e0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f1f9dad9640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9806b7b0 0x7f1f9819bf70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400e9f0 tx=0x7f1f9400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.438+0000 7f1f8effd640 1 -- 172.21.15.47:0/3578539724 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9400ccc0 con 0x7f1f9806b7b0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.439+0000 7f1f8effd640 1 -- 172.21.15.47:0/3578539724 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f1f940108a0 con 0x7f1f9806b7b0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.439+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9819dc90 con 0x7f1f9806b7b0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.439+0000 7f1f8effd640 1 -- 172.21.15.47:0/3578539724 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94018640 con 0x7f1f9806b7b0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.439+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f981a4390 con 0x7f1f9806b7b0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.440+0000 7f1f8effd640 1 -- 172.21.15.47:0/3578539724 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f1f940187e0 con 0x7f1f9806b7b0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.440+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f98108790 con 0x7f1f9806b7b0 2024-09-21T00:50:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.440+0000 7f1f8effd640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1f8403fb20 0x7f1f84042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.440+0000 7f1f8effd640 1 -- 172.21.15.47:0/3578539724 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1f94055660 con 0x7f1f9806b7b0 2024-09-21T00:50:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.440+0000 7f1f9d2d8640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1f8403fb20 0x7f1f84042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f1f9d2d8640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1f8403fb20 0x7f1f84042030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009bd0 tx=0x7f1f88005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f981c03fb20 msgr2=0x7f981c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f981c03fb20 0x7f981c042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9820005d00 tx=0x7f982000b410 comp rx=0 tx=0).stop 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98301037e0 msgr2=0x7f9830076dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98301037e0 0x7f9830076dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d770 tx=0x7f982c00dc30 comp rx=0 tx=0).stop 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 shutdown_connections 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f981c03fb20 0x7f981c042030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9830105210 0x7f9830075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9830104870 0x7f9830075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 --2- 172.21.15.47:0/3116797640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98301037e0 0x7f9830076dd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 >> 172.21.15.47:0/3116797640 conn(0x7f98300ff150 msgr2=0x7f9830107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 shutdown_connections 2024-09-21T00:50:28.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.441+0000 7f983770b640 1 -- 172.21.15.47:0/3116797640 wait complete. 2024-09-21T00:50:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.445+0000 7f1f8effd640 1 -- 172.21.15.47:0/3578539724 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f94020360 con 0x7f1f9806b7b0 2024-09-21T00:50:28.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.639+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1f98063fc0 con 0x7f1f9806b7b0 2024-09-21T00:50:28.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.645+0000 7f1f8effd640 1 -- 172.21.15.47:0/3578539724 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f1f94014d70 con 0x7f1f9806b7b0 2024-09-21T00:50:28.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1f8403fb20 msgr2=0x7f1f84042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1f8403fb20 0x7f1f84042030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009bd0 tx=0x7f1f88005f90 comp rx=0 tx=0).stop 2024-09-21T00:50:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9806b7b0 msgr2=0x7f1f9819bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9806b7b0 0x7f1f9819bf70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400e9f0 tx=0x7f1f9400eeb0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 shutdown_connections 2024-09-21T00:50:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1f8403fb20 0x7f1f84042030 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9810b680 0x7f1f9819d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f98108cd0 0x7f1f9819c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 --2- 172.21.15.47:0/3578539724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9806b7b0 0x7f1f9819bf70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:28.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.647+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 >> 172.21.15.47:0/3578539724 conn(0x7f1f980fdfb0 msgr2=0x7f1f98109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:28.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.648+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 shutdown_connections 2024-09-21T00:50:28.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:28.648+0000 7f1f9fd3d640 1 -- 172.21.15.47:0/3578539724 wait complete. 2024-09-21T00:50:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:28.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:28.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:50:28.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:28.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:28.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:28.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: Reconfiguring daemon mgr.x on smithi047 2024-09-21T00:50:28.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:28 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3116797640' entity='client.admin' 2024-09-21T00:50:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: Reconfiguring daemon mgr.x on smithi047 2024-09-21T00:50:28.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:28 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3116797640' entity='client.admin' 2024-09-21T00:50:28.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:28.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:28.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:28.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:28.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T00:50:28.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T00:50:28.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T00:50:28.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:28.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: Reconfiguring daemon mgr.x on smithi047 2024-09-21T00:50:28.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:28 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3116797640' entity='client.admin' 2024-09-21T00:50:29.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:29 smithi047 ceph-mon[30960]: from='client.? ' entity='client.admin' 2024-09-21T00:50:29.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:29 smithi047 ceph-mon[30960]: Standby manager daemon z started 2024-09-21T00:50:29.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:29 smithi047 ceph-mon[30960]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:50:29.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:29 smithi047 ceph-mon[30960]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:50:29.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:29 smithi047 ceph-mon[30960]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:50:29.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:29 smithi047 ceph-mon[30960]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:50:29.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:29 smithi114 ceph-mon[34309]: from='client.? ' entity='client.admin' 2024-09-21T00:50:29.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:29 smithi114 ceph-mon[34309]: Standby manager daemon z started 2024-09-21T00:50:29.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:29 smithi114 ceph-mon[34309]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:50:29.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:29 smithi114 ceph-mon[34309]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:50:29.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:29 smithi114 ceph-mon[34309]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:50:29.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:29 smithi114 ceph-mon[34309]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:50:30.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 -- 172.21.15.47:0/2564185564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 msgr2=0x7f62c4103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:30.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 --2- 172.21.15.47:0/2564185564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 0x7f62c4103af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009ca0 tx=0x7f62b402a950 comp rx=0 tx=0).stop 2024-09-21T00:50:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 -- 172.21.15.47:0/2564185564 shutdown_connections 2024-09-21T00:50:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 --2- 172.21.15.47:0/2564185564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c4104080 0x7f62c410aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 --2- 172.21.15.47:0/2564185564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 0x7f62c4103af0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 --2- 172.21.15.47:0/2564185564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c4102650 0x7f62c4102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 -- 172.21.15.47:0/2564185564 >> 172.21.15.47:0/2564185564 conn(0x7f62c40fdfe0 msgr2=0x7f62c4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 -- 172.21.15.47:0/2564185564 shutdown_connections 2024-09-21T00:50:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.047+0000 7f62cad2c640 1 -- 172.21.15.47:0/2564185564 wait complete. 2024-09-21T00:50:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.048+0000 7f62cad2c640 1 Processor -- start 2024-09-21T00:50:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.048+0000 7f62cad2c640 1 -- start start 2024-09-21T00:50:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.048+0000 7f62cad2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c4102650 0x7f62c4199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.048+0000 7f62cad2c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 0x7f62c419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62cad2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c4104080 0x7f62c419b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62cad2c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62c410f1e0 con 0x7f62c41036e0 2024-09-21T00:50:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62cad2c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f62c410f060 con 0x7f62c4104080 2024-09-21T00:50:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62cad2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f62c410f360 con 0x7f62c4102650 2024-09-21T00:50:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 0x7f62c419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 0x7f62c419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56762/0 (socket says 172.21.15.47:56762) 2024-09-21T00:50:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c92c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c4104080 0x7f62c419b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:30.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c3fff640 1 -- 172.21.15.47:0/4219452633 learned_addr learned my addr 172.21.15.47:0/4219452633 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c8ac8640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c4102650 0x7f62c4199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c92c9640 1 -- 172.21.15.47:0/4219452633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c4102650 msgr2=0x7f62c4199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c92c9640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c4102650 0x7f62c4199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c92c9640 1 -- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 msgr2=0x7f62c419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c92c9640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 0x7f62c419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c92c9640 1 -- 172.21.15.47:0/4219452633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c419b840 con 0x7f62c4104080 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c3fff640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 0x7f62c419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c92c9640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c4104080 0x7f62c419b020 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00e970 tx=0x7f62bc00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.049+0000 7f62c1ffb640 1 -- 172.21.15.47:0/4219452633 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00ccc0 con 0x7f62c4104080 2024-09-21T00:50:30.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.050+0000 7f62c1ffb640 1 -- 172.21.15.47:0/4219452633 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f62bc004490 con 0x7f62c4104080 2024-09-21T00:50:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.050+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c419bb30 con 0x7f62c4104080 2024-09-21T00:50:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.050+0000 7f62c1ffb640 1 -- 172.21.15.47:0/4219452633 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0047a0 con 0x7f62c4104080 2024-09-21T00:50:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.050+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c41a2230 con 0x7f62c4104080 2024-09-21T00:50:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.051+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c4102ac0 con 0x7f62c4104080 2024-09-21T00:50:30.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.051+0000 7f62c1ffb640 1 -- 172.21.15.47:0/4219452633 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7f62bc004940 con 0x7f62c4104080 2024-09-21T00:50:30.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.052+0000 7f62c1ffb640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f62b007afd0 0x7f62b007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:30.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.052+0000 7f62c1ffb640 1 -- 172.21.15.47:0/4219452633 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f62bc09cc40 con 0x7f62c4104080 2024-09-21T00:50:30.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.052+0000 7f62c8ac8640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f62b007afd0 0x7f62b007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:30.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.052+0000 7f62c8ac8640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f62b007afd0 0x7f62b007d4e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009bd0 tx=0x7f62ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:30.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.057+0000 7f62c1ffb640 1 -- 172.21.15.47:0/4219452633 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62bc069700 con 0x7f62c4104080 2024-09-21T00:50:30.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:29 smithi134 ceph-mon[34785]: from='client.? ' entity='client.admin' 2024-09-21T00:50:30.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:29 smithi134 ceph-mon[34785]: Standby manager daemon z started 2024-09-21T00:50:30.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:29 smithi134 ceph-mon[34785]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T00:50:30.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:29 smithi134 ceph-mon[34785]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:50:30.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:29 smithi134 ceph-mon[34785]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T00:50:30.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:29 smithi134 ceph-mon[34785]: from='mgr.? 172.21.15.134:0/3400568810' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:50:30.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.249+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f62c4063fc0 con 0x7f62c4104080 2024-09-21T00:50:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.254+0000 7f62c1ffb640 1 -- 172.21.15.47:0/4219452633 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7f62bc06e5b0 con 0x7f62c4104080 2024-09-21T00:50:30.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f62b007afd0 msgr2=0x7f62b007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:30.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f62b007afd0 0x7f62b007d4e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009bd0 tx=0x7f62ac005f90 comp rx=0 tx=0).stop 2024-09-21T00:50:30.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c4104080 msgr2=0x7f62c419b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c4104080 0x7f62c419b020 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00e970 tx=0x7f62bc00ee30 comp rx=0 tx=0).stop 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 shutdown_connections 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f62b007afd0 0x7f62b007d4e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c4104080 0x7f62c419b020 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62c41036e0 0x7f62c419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 --2- 172.21.15.47:0/4219452633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c4102650 0x7f62c4199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.256+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 >> 172.21.15.47:0/4219452633 conn(0x7f62c40fdfe0 msgr2=0x7f62c4106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.257+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 shutdown_connections 2024-09-21T00:50:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.257+0000 7f62cad2c640 1 -- 172.21.15.47:0/4219452633 wait complete. 2024-09-21T00:50:30.854 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:30 smithi047 ceph-mon[30960]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:30.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:30 smithi047 ceph-mon[30960]: mgrmap e15: x(active, since 64s), standbys: z 2024-09-21T00:50:30.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:50:30.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:30 smithi047 ceph-mon[30960]: from='client.? ' entity='client.admin' 2024-09-21T00:50:30.855 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:30.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 -- 172.21.15.47:0/2211224004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb8106900 msgr2=0x7fddb8108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:30.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 --2- 172.21.15.47:0/2211224004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb8106900 0x7fddb8108d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009900 tx=0x7fdda802a410 comp rx=0 tx=0).stop 2024-09-21T00:50:30.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 -- 172.21.15.47:0/2211224004 shutdown_connections 2024-09-21T00:50:30.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 --2- 172.21.15.47:0/2211224004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb81094a0 0x7fddb810b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 --2- 172.21.15.47:0/2211224004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb8106900 0x7fddb8108d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 --2- 172.21.15.47:0/2211224004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb806c660 0x7fddb81063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 -- 172.21.15.47:0/2211224004 >> 172.21.15.47:0/2211224004 conn(0x7fddb80fdfe0 msgr2=0x7fddb8100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 -- 172.21.15.47:0/2211224004 shutdown_connections 2024-09-21T00:50:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.853+0000 7fddc070a640 1 -- 172.21.15.47:0/2211224004 wait complete. 2024-09-21T00:50:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.854+0000 7fddc070a640 1 Processor -- start 2024-09-21T00:50:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.854+0000 7fddc070a640 1 -- start start 2024-09-21T00:50:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.854+0000 7fddc070a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb806c660 0x7fddb8199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.854+0000 7fddc070a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8106900 0x7fddb819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.854+0000 7fddc070a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb81094a0 0x7fddb819b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.854+0000 7fddc070a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fddb810f180 con 0x7fddb81094a0 2024-09-21T00:50:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.854+0000 7fddc070a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fddb810f000 con 0x7fddb8106900 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.854+0000 7fddc070a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddb810f300 con 0x7fddb806c660 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8106900 0x7fddb819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbeca7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb81094a0 0x7fddb819b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8106900 0x7fddb819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:33192/0 (socket says 172.21.15.47:33192) 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 -- 172.21.15.47:0/3170976080 learned_addr learned my addr 172.21.15.47:0/3170976080 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbe4a6640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb806c660 0x7fddb8199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 -- 172.21.15.47:0/3170976080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb806c660 msgr2=0x7fddb8199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb806c660 0x7fddb8199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 -- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb81094a0 msgr2=0x7fddb819b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb81094a0 0x7fddb819b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 -- 172.21.15.47:0/3170976080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb819b880 con 0x7fddb8106900 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbeca7640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb81094a0 0x7fddb819b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddbdca5640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8106900 0x7fddb819a4c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdda802aa00 tx=0x7fdda8003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddaf7fe640 1 -- 172.21.15.47:0/3170976080 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda803f070 con 0x7fddb8106900 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddaf7fe640 1 -- 172.21.15.47:0/3170976080 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fdda8031d20 con 0x7fddb8106900 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddaf7fe640 1 -- 172.21.15.47:0/3170976080 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8035030 con 0x7fddb8106900 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.855+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb819bb10 con 0x7fddb8106900 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.856+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb81a20a0 con 0x7fddb8106900 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.856+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb8106d50 con 0x7fddb8106900 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.857+0000 7fddaf7fe640 1 -- 172.21.15.47:0/3170976080 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7fdda8042070 con 0x7fddb8106900 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.858+0000 7fddaf7fe640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdda407afd0 0x7fdda407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.858+0000 7fddbe4a6640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdda407afd0 0x7fdda407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:30.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.858+0000 7fddaf7fe640 1 -- 172.21.15.47:0/3170976080 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdda80bd600 con 0x7fddb8106900 2024-09-21T00:50:30.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.858+0000 7fddbe4a6640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdda407afd0 0x7fdda407d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddb4005fd0 tx=0x7fddb400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:30.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:30.863+0000 7fddaf7fe640 1 -- 172.21.15.47:0/3170976080 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdda808a040 con 0x7fddb8106900 2024-09-21T00:50:30.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:30 smithi114 ceph-mon[34309]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:30.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:30 smithi114 ceph-mon[34309]: mgrmap e15: x(active, since 64s), standbys: z 2024-09-21T00:50:30.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:50:30.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:30 smithi114 ceph-mon[34309]: from='client.? ' entity='client.admin' 2024-09-21T00:50:30.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:31.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.052+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fddb802e9d0 con 0x7fddb8106900 2024-09-21T00:50:31.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.058+0000 7fddaf7fe640 1 -- 172.21.15.47:0/3170976080 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7fdda808eef0 con 0x7fddb8106900 2024-09-21T00:50:31.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdda407afd0 msgr2=0x7fdda407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:31.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdda407afd0 0x7fdda407d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddb4005fd0 tx=0x7fddb400b390 comp rx=0 tx=0).stop 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8106900 msgr2=0x7fddb819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8106900 0x7fddb819a4c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdda802aa00 tx=0x7fdda8003c80 comp rx=0 tx=0).stop 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 shutdown_connections 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdda407afd0 0x7fdda407d4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddb81094a0 0x7fddb819b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8106900 0x7fddb819a4c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 --2- 172.21.15.47:0/3170976080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb806c660 0x7fddb8199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.060+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 >> 172.21.15.47:0/3170976080 conn(0x7fddb80fdfe0 msgr2=0x7fddb8104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.061+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 shutdown_connections 2024-09-21T00:50:31.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.061+0000 7fddc070a640 1 -- 172.21.15.47:0/3170976080 wait complete. 2024-09-21T00:50:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:30 smithi134 ceph-mon[34785]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:30 smithi134 ceph-mon[34785]: mgrmap e15: x(active, since 64s), standbys: z 2024-09-21T00:50:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T00:50:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:30 smithi134 ceph-mon[34785]: from='client.? ' entity='client.admin' 2024-09-21T00:50:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:31.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.281+0000 7f93a4a02640 1 -- 172.21.15.47:0/1658498088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 msgr2=0x7f93a010b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.281+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1658498088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 0x7f93a010b970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9398009ca0 tx=0x7f939802a950 comp rx=0 tx=0).stop 2024-09-21T00:50:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.281+0000 7f93a4a02640 1 -- 172.21.15.47:0/1658498088 shutdown_connections 2024-09-21T00:50:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.281+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1658498088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 0x7f93a010b970 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.281+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1658498088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93a0104630 0x7f93a0104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.281+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1658498088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a01035a0 0x7f93a0103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.281+0000 7f93a4a02640 1 -- 172.21.15.47:0/1658498088 >> 172.21.15.47:0/1658498088 conn(0x7f93a00fef10 msgr2=0x7f93a01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.281+0000 7f93a4a02640 1 -- 172.21.15.47:0/1658498088 shutdown_connections 2024-09-21T00:50:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.282+0000 7f93a4a02640 1 -- 172.21.15.47:0/1658498088 wait complete. 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.282+0000 7f93a4a02640 1 Processor -- start 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f93a4a02640 1 -- start start 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f93a4a02640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a01035a0 0x7f93a0199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f93a4a02640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93a0104630 0x7f93a019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f93a4a02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 0x7f93a019add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f93a4a02640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93a010ef60 con 0x7f93a0104fd0 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f93a4a02640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f93a010ede0 con 0x7f93a0104630 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f93a4a02640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93a010f0e0 con 0x7f93a01035a0 2024-09-21T00:50:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 0x7f93a019add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93a0104630 0x7f93a019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a01035a0 0x7f93a0199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 0x7f93a019add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56794/0 (socket says 172.21.15.47:56794) 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939f59e640 1 -- 172.21.15.47:0/1881776806 learned_addr learned my addr 172.21.15.47:0/1881776806 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939659c640 1 -- 172.21.15.47:0/1881776806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a01035a0 msgr2=0x7f93a0199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939659c640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a01035a0 0x7f93a0199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939659c640 1 -- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 msgr2=0x7f93a019add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939659c640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 0x7f93a019add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939659c640 1 -- 172.21.15.47:0/1881776806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a019b5f0 con 0x7f93a0104630 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.283+0000 7f939f59e640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 0x7f93a019add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.284+0000 7f939659c640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93a0104630 0x7f93a019a230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f938800e9f0 tx=0x7f938800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.284+0000 7f939cd99640 1 -- 172.21.15.47:0/1881776806 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938800ccc0 con 0x7f93a0104630 2024-09-21T00:50:31.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.284+0000 7f939cd99640 1 -- 172.21.15.47:0/1881776806 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f93880108a0 con 0x7f93a0104630 2024-09-21T00:50:31.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.284+0000 7f939cd99640 1 -- 172.21.15.47:0/1881776806 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388018640 con 0x7f93a0104630 2024-09-21T00:50:31.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.284+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a019b8e0 con 0x7f93a0104630 2024-09-21T00:50:31.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.284+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a01a1fe0 con 0x7f93a0104630 2024-09-21T00:50:31.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.285+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a010f720 con 0x7f93a0104630 2024-09-21T00:50:31.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.286+0000 7f939cd99640 1 -- 172.21.15.47:0/1881776806 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7f9388010430 con 0x7f93a0104630 2024-09-21T00:50:31.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.286+0000 7f939cd99640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f938c07afd0 0x7f938c07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:31.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.286+0000 7f939ed9d640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f938c07afd0 0x7f938c07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:31.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.286+0000 7f939cd99640 1 -- 172.21.15.47:0/1881776806 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f938809d190 con 0x7f93a0104630 2024-09-21T00:50:31.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.287+0000 7f939ed9d640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f938c07afd0 0x7f938c07d4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f939000bbe0 tx=0x7f939000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:31.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.291+0000 7f939cd99640 1 -- 172.21.15.47:0/1881776806 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9388069b50 con 0x7f93a0104630 2024-09-21T00:50:31.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.481+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f93a002e7f0 con 0x7f93a0104630 2024-09-21T00:50:31.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.487+0000 7f939cd99640 1 -- 172.21.15.47:0/1881776806 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7f938806ea00 con 0x7f93a0104630 2024-09-21T00:50:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f938c07afd0 msgr2=0x7f938c07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f938c07afd0 0x7f938c07d4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f939000bbe0 tx=0x7f939000b390 comp rx=0 tx=0).stop 2024-09-21T00:50:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93a0104630 msgr2=0x7f93a019a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93a0104630 0x7f93a019a230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f938800e9f0 tx=0x7f938800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 shutdown_connections 2024-09-21T00:50:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f938c07afd0 0x7f938c07d4e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93a0104fd0 0x7f93a019add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93a0104630 0x7f93a019a230 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 --2- 172.21.15.47:0/1881776806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a01035a0 0x7f93a0199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 >> 172.21.15.47:0/1881776806 conn(0x7f93a00fef10 msgr2=0x7f93a0107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 shutdown_connections 2024-09-21T00:50:31.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:31.489+0000 7f93a4a02640 1 -- 172.21.15.47:0/1881776806 wait complete. 2024-09-21T00:50:32.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:32 smithi047 ceph-mon[30960]: from='client.? ' entity='client.admin' 2024-09-21T00:50:32.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:32 smithi047 ceph-mon[30960]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:32.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:32 smithi047 ceph-mon[30960]: Standby manager daemon y started 2024-09-21T00:50:32.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:32 smithi047 ceph-mon[30960]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:50:32.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:32 smithi047 ceph-mon[30960]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:50:32.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:32 smithi047 ceph-mon[30960]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:50:32.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:32 smithi047 ceph-mon[30960]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:50:32.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:32 smithi047 ceph-mon[30960]: from='client.? ' entity='client.admin' 2024-09-21T00:50:32.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:32 smithi134 ceph-mon[34785]: from='client.? ' entity='client.admin' 2024-09-21T00:50:32.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:32 smithi134 ceph-mon[34785]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:32.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:32 smithi134 ceph-mon[34785]: Standby manager daemon y started 2024-09-21T00:50:32.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:32 smithi134 ceph-mon[34785]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:50:32.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:32 smithi134 ceph-mon[34785]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:50:32.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:32 smithi134 ceph-mon[34785]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:50:32.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:32 smithi134 ceph-mon[34785]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:50:32.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:32 smithi134 ceph-mon[34785]: from='client.? ' entity='client.admin' 2024-09-21T00:50:32.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:32 smithi114 ceph-mon[34309]: from='client.? ' entity='client.admin' 2024-09-21T00:50:32.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:32 smithi114 ceph-mon[34309]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:32.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:32 smithi114 ceph-mon[34309]: Standby manager daemon y started 2024-09-21T00:50:32.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:32 smithi114 ceph-mon[34309]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T00:50:32.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:32 smithi114 ceph-mon[34309]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T00:50:32.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:32 smithi114 ceph-mon[34309]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T00:50:32.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:32 smithi114 ceph-mon[34309]: from='mgr.? 172.21.15.114:0/1944901548' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T00:50:32.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:32 smithi114 ceph-mon[34309]: from='client.? ' entity='client.admin' 2024-09-21T00:50:33.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:33 smithi134 ceph-mon[34785]: mgrmap e16: x(active, since 66s), standbys: z, y 2024-09-21T00:50:33.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:33 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:50:33.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:33 smithi114 ceph-mon[34309]: mgrmap e16: x(active, since 66s), standbys: z, y 2024-09-21T00:50:33.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:33 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:50:33.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:33 smithi047 ceph-mon[30960]: mgrmap e16: x(active, since 66s), standbys: z, y 2024-09-21T00:50:33.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:33 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T00:50:34.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:34 smithi134 ceph-mon[34785]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:34.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:34 smithi114 ceph-mon[34309]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:34.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:34 smithi047 ceph-mon[30960]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:34.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 -- 172.21.15.47:0/303217527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0102570 msgr2=0x7f54f0108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:34.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 --2- 172.21.15.47:0/303217527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0102570 0x7f54f0108d70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54d8009900 tx=0x7f54d802a410 comp rx=0 tx=0).stop 2024-09-21T00:50:34.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 -- 172.21.15.47:0/303217527 shutdown_connections 2024-09-21T00:50:34.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 --2- 172.21.15.47:0/303217527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f01094b0 0x7f54f010b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:34.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 --2- 172.21.15.47:0/303217527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0102570 0x7f54f0108d70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:34.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 --2- 172.21.15.47:0/303217527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f0101b40 0x7f54f0101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:34.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 -- 172.21.15.47:0/303217527 >> 172.21.15.47:0/303217527 conn(0x7f54f00fd770 msgr2=0x7f54f00ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:34.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 -- 172.21.15.47:0/303217527 shutdown_connections 2024-09-21T00:50:34.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.969+0000 7f54f59c2640 1 -- 172.21.15.47:0/303217527 wait complete. 2024-09-21T00:50:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54f59c2640 1 Processor -- start 2024-09-21T00:50:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54f59c2640 1 -- start start 2024-09-21T00:50:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54f59c2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0101b40 0x7f54f01042d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54f59c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f0102570 0x7f54f0102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54f59c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f01094b0 0x7f54f01030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54f59c2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54f010f120 con 0x7f54f0101b40 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54f59c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f54f010efa0 con 0x7f54f01094b0 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54f59c2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f54f010f2a0 con 0x7f54f0102570 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54eeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0101b40 0x7f54f01042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54eeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0101b40 0x7f54f01042d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50588/0 (socket says 172.21.15.47:50588) 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.970+0000 7f54eeffd640 1 -- 172.21.15.47:0/3496023859 learned_addr learned my addr 172.21.15.47:0/3496023859 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54ef7fe640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f01094b0 0x7f54f01030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54e7fff640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f0102570 0x7f54f0102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54eeffd640 1 -- 172.21.15.47:0/3496023859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f0102570 msgr2=0x7f54f0102ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54eeffd640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f0102570 0x7f54f0102ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:34.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54eeffd640 1 -- 172.21.15.47:0/3496023859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f01094b0 msgr2=0x7f54f01030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54eeffd640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f01094b0 0x7f54f01030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54eeffd640 1 -- 172.21.15.47:0/3496023859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f01037e0 con 0x7f54f0101b40 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54eeffd640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0101b40 0x7f54f01042d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f54e000e9f0 tx=0x7f54e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54f49c0640 1 -- 172.21.15.47:0/3496023859 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e000cd80 con 0x7f54f0101b40 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54f49c0640 1 -- 172.21.15.47:0/3496023859 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f54e00108a0 con 0x7f54f0101b40 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f01a3e80 con 0x7f54f0101b40 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54f49c0640 1 -- 172.21.15.47:0/3496023859 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0018760 con 0x7f54f0101b40 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.971+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f01a4220 con 0x7f54f0101b40 2024-09-21T00:50:34.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.972+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f010f8e0 con 0x7f54f0101b40 2024-09-21T00:50:34.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.974+0000 7f54f49c0640 1 -- 172.21.15.47:0/3496023859 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f54e0010430 con 0x7f54f0101b40 2024-09-21T00:50:34.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.975+0000 7f54f49c0640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f54dc0b6480 0x7f54dc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:34.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.975+0000 7f54e7fff640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f54dc0b6480 0x7f54dc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:34.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.975+0000 7f54f49c0640 1 -- 172.21.15.47:0/3496023859 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f54e00e5e30 con 0x7f54f0101b40 2024-09-21T00:50:34.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.976+0000 7f54e7fff640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f54dc0b6480 0x7f54dc0b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54d8009230 tx=0x7f54d80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:34.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.979+0000 7f54f49c0640 1 -- 172.21.15.47:0/3496023859 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54e00b2750 con 0x7f54f0101b40 2024-09-21T00:50:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.169+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f54f002e900 con 0x7f54f0101b40 2024-09-21T00:50:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.173+0000 7f54f49c0640 1 -- 172.21.15.47:0/3496023859 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f54e00b7690 con 0x7f54f0101b40 2024-09-21T00:50:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f54dc0b6480 msgr2=0x7f54dc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f54dc0b6480 0x7f54dc0b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54d8009230 tx=0x7f54d80058d0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0101b40 msgr2=0x7f54f01042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0101b40 0x7f54f01042d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f54e000e9f0 tx=0x7f54e000eeb0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 shutdown_connections 2024-09-21T00:50:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f54dc0b6480 0x7f54dc0b8990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f01094b0 0x7f54f01030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54f0102570 0x7f54f0102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 --2- 172.21.15.47:0/3496023859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54f0101b40 0x7f54f01042d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 >> 172.21.15.47:0/3496023859 conn(0x7f54f00fd770 msgr2=0x7f54f010a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 shutdown_connections 2024-09-21T00:50:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.176+0000 7f54f59c2640 1 -- 172.21.15.47:0/3496023859 wait complete. 2024-09-21T00:50:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 -- 172.21.15.47:0/1620834231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094103780 msgr2=0x7f7094103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 --2- 172.21.15.47:0/1620834231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094103780 0x7f7094103bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7084009900 tx=0x7f708402a480 comp rx=0 tx=0).stop 2024-09-21T00:50:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 -- 172.21.15.47:0/1620834231 shutdown_connections 2024-09-21T00:50:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 --2- 172.21.15.47:0/1620834231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70941051b0 0x7f709410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 --2- 172.21.15.47:0/1620834231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7094104810 0x7f7094104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 --2- 172.21.15.47:0/1620834231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094103780 0x7f7094103bf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 -- 172.21.15.47:0/1620834231 >> 172.21.15.47:0/1620834231 conn(0x7f70940ff0f0 msgr2=0x7f70941015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 -- 172.21.15.47:0/1620834231 shutdown_connections 2024-09-21T00:50:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.211+0000 7f709a856640 1 -- 172.21.15.47:0/1620834231 wait complete. 2024-09-21T00:50:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.212+0000 7f709a856640 1 Processor -- start 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.212+0000 7f709a856640 1 -- start start 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.212+0000 7f709a856640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094103780 0x7f7094197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.212+0000 7f709a856640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094104810 0x7f7094198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.212+0000 7f709a856640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70941051b0 0x7f7094198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.212+0000 7f709a856640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f709410cfd0 con 0x7f7094104810 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.212+0000 7f709a856640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f709410ce50 con 0x7f70941051b0 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.212+0000 7f709a856640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f709410d150 con 0x7f7094103780 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094104810 0x7f7094198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094104810 0x7f7094198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50604/0 (socket says 172.21.15.47:50604) 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 -- 172.21.15.47:0/3926208435 learned_addr learned my addr 172.21.15.47:0/3926208435 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f7098df3640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70941051b0 0x7f7094198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f7093fff640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094103780 0x7f7094197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 -- 172.21.15.47:0/3926208435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094103780 msgr2=0x7f7094197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094103780 0x7f7094197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 -- 172.21.15.47:0/3926208435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70941051b0 msgr2=0x7f7094198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70941051b0 0x7f7094198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 -- 172.21.15.47:0/3926208435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7094199640 con 0x7f7094104810 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f7098df3640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70941051b0 0x7f7094198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f7093fff640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094103780 0x7f7094197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70937fe640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094104810 0x7f7094198280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f708800d950 tx=0x7f708800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70917fa640 1 -- 172.21.15.47:0/3926208435 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088017070 con 0x7f7094104810 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70917fa640 1 -- 172.21.15.47:0/3926208435 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f7088009c30 con 0x7f7094104810 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.213+0000 7f70917fa640 1 -- 172.21.15.47:0/3926208435 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708800f620 con 0x7f7094104810 2024-09-21T00:50:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.214+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7094199930 con 0x7f7094104810 2024-09-21T00:50:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.214+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70941a0030 con 0x7f7094104810 2024-09-21T00:50:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.215+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7094103bf0 con 0x7f7094104810 2024-09-21T00:50:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.216+0000 7f70917fa640 1 -- 172.21.15.47:0/3926208435 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f7088010460 con 0x7f7094104810 2024-09-21T00:50:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.217+0000 7f70917fa640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f707c0b6500 0x7f707c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.217+0000 7f7093fff640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f707c0b6500 0x7f707c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.217+0000 7f70917fa640 1 -- 172.21.15.47:0/3926208435 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f70880e5270 con 0x7f7094104810 2024-09-21T00:50:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.218+0000 7f7093fff640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f707c0b6500 0x7f707c0b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7084005ab0 tx=0x7f7084005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.220+0000 7f70917fa640 1 -- 172.21.15.47:0/3926208435 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70880ad850 con 0x7f7094104810 2024-09-21T00:50:35.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.408+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f709410a960 con 0x7f7094104810 2024-09-21T00:50:35.409 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:35 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1360585039' entity='client.admin' 2024-09-21T00:50:35.409 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:35 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3496023859' entity='client.admin' 2024-09-21T00:50:35.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.412+0000 7f70917fa640 1 -- 172.21.15.47:0/3926208435 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f709410a960 con 0x7f7094104810 2024-09-21T00:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.413+0000 7f70917fa640 1 -- 172.21.15.47:0/3926208435 <== mon.0 v2:172.21.15.47:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f70880acc60 con 0x7f7094104810 2024-09-21T00:50:35.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f707c0b6500 msgr2=0x7f707c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:35.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f707c0b6500 0x7f707c0b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7084005ab0 tx=0x7f7084005a20 comp rx=0 tx=0).stop 2024-09-21T00:50:35.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094104810 msgr2=0x7f7094198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:35.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094104810 0x7f7094198280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f708800d950 tx=0x7f708800de10 comp rx=0 tx=0).stop 2024-09-21T00:50:35.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 shutdown_connections 2024-09-21T00:50:35.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f707c0b6500 0x7f707c0b8a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70941051b0 0x7f7094198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7094104810 0x7f7094198280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 --2- 172.21.15.47:0/3926208435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094103780 0x7f7094197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:35.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 >> 172.21.15.47:0/3926208435 conn(0x7f70940ff0f0 msgr2=0x7f7094107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:35.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 shutdown_connections 2024-09-21T00:50:35.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.415+0000 7f709a856640 1 -- 172.21.15.47:0/3926208435 wait complete. 2024-09-21T00:50:35.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:35 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1360585039' entity='client.admin' 2024-09-21T00:50:35.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:35 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3496023859' entity='client.admin' 2024-09-21T00:50:35.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:35 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1360585039' entity='client.admin' 2024-09-21T00:50:35.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:35 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3496023859' entity='client.admin' 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 -- 172.21.15.47:0/2769282940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 msgr2=0x7f17c0103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 --2- 172.21.15.47:0/2769282940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 0x7f17c0103b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009900 tx=0x7f17b402a480 comp rx=0 tx=0).stop 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 -- 172.21.15.47:0/2769282940 shutdown_connections 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 --2- 172.21.15.47:0/2769282940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c01040a0 0x7f17c010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 --2- 172.21.15.47:0/2769282940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 0x7f17c0103b10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 --2- 172.21.15.47:0/2769282940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c0102670 0x7f17c0102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 -- 172.21.15.47:0/2769282940 >> 172.21.15.47:0/2769282940 conn(0x7f17c00fdfe0 msgr2=0x7f17c0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 -- 172.21.15.47:0/2769282940 shutdown_connections 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.089+0000 7f17c69e4640 1 -- 172.21.15.47:0/2769282940 wait complete. 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.090+0000 7f17c69e4640 1 Processor -- start 2024-09-21T00:50:36.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.090+0000 7f17c69e4640 1 -- start start 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.090+0000 7f17c69e4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c0102670 0x7f17c0198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.090+0000 7f17c69e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 0x7f17c0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.090+0000 7f17c69e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c01040a0 0x7f17c0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.090+0000 7f17c69e4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f17c010e180 con 0x7f17c0103700 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.090+0000 7f17c69e4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17c010e000 con 0x7f17c0102670 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.090+0000 7f17c69e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f17c010e300 con 0x7f17c01040a0 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 0x7f17c0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c0102670 0x7f17c0198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 0x7f17c0199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50630/0 (socket says 172.21.15.47:50630) 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bf7fe640 1 -- 172.21.15.47:0/3852218535 learned_addr learned my addr 172.21.15.47:0/3852218535 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17c4f81640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c01040a0 0x7f17c0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bffff640 1 -- 172.21.15.47:0/3852218535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c01040a0 msgr2=0x7f17c0199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bffff640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c01040a0 0x7f17c0199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bffff640 1 -- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 msgr2=0x7f17c0199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bffff640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 0x7f17c0199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bffff640 1 -- 172.21.15.47:0/3852218535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c019a7f0 con 0x7f17c0102670 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bf7fe640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 0x7f17c0199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.091+0000 7f17bffff640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c0102670 0x7f17c0198dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17b000d6d0 tx=0x7f17b000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.092+0000 7f17bd7fa640 1 -- 172.21.15.47:0/3852218535 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0017070 con 0x7f17c0102670 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.092+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c019aae0 con 0x7f17c0102670 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.092+0000 7f17bd7fa640 1 -- 172.21.15.47:0/3852218535 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f17b0009820 con 0x7f17c0102670 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.092+0000 7f17bd7fa640 1 -- 172.21.15.47:0/3852218535 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0004bd0 con 0x7f17c0102670 2024-09-21T00:50:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.092+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c006b9f0 con 0x7f17c0102670 2024-09-21T00:50:36.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.093+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c0102ae0 con 0x7f17c0102670 2024-09-21T00:50:36.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.094+0000 7f17bd7fa640 1 -- 172.21.15.47:0/3852218535 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f17b0005220 con 0x7f17c0102670 2024-09-21T00:50:36.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.095+0000 7f17bd7fa640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f17a80b6500 0x7f17a80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.095+0000 7f17bf7fe640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f17a80b6500 0x7f17a80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.095+0000 7f17bd7fa640 1 -- 172.21.15.47:0/3852218535 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f17b00e5180 con 0x7f17c0102670 2024-09-21T00:50:36.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.096+0000 7f17bf7fe640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f17a80b6500 0x7f17a80b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17b4031440 tx=0x7f17b4005720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:36.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.098+0000 7f17bd7fa640 1 -- 172.21.15.47:0/3852218535 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17b00b1a20 con 0x7f17c0102670 2024-09-21T00:50:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.994+0000 7fbae4e46640 1 -- 172.21.15.47:0/4017992681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 msgr2=0x7fbae0103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.994+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4017992681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 0x7fbae0103be0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009900 tx=0x7fbad002a480 comp rx=0 tx=0).stop 2024-09-21T00:50:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.995+0000 7fbae4e46640 1 -- 172.21.15.47:0/4017992681 shutdown_connections 2024-09-21T00:50:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.995+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4017992681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae01051a0 0x7fbae010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.995+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4017992681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbae0104800 0x7fbae0104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.995+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4017992681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 0x7fbae0103be0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.995+0000 7fbae4e46640 1 -- 172.21.15.47:0/4017992681 >> 172.21.15.47:0/4017992681 conn(0x7fbae00ff0e0 msgr2=0x7fbae0101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.995+0000 7fbae4e46640 1 -- 172.21.15.47:0/4017992681 shutdown_connections 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.995+0000 7fbae4e46640 1 -- 172.21.15.47:0/4017992681 wait complete. 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbae4e46640 1 Processor -- start 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbae4e46640 1 -- start start 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbae4e46640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 0x7fbae0199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbae4e46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae0104800 0x7fbae019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbae4e46640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbae01051a0 0x7fbae019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbae4e46640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbae010f270 con 0x7fbae0103770 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbae4e46640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbae010f0f0 con 0x7fbae01051a0 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbae4e46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbae010f3f0 con 0x7fbae0104800 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbade59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 0x7fbae0199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbade59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 0x7fbae0199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50624/0 (socket says 172.21.15.47:50624) 2024-09-21T00:50:36.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.996+0000 7fbade59c640 1 -- 172.21.15.47:0/4230994903 learned_addr learned my addr 172.21.15.47:0/4230994903 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbaded9d640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbae01051a0 0x7fbae019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbaddd9b640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae0104800 0x7fbae019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbade59c640 1 -- 172.21.15.47:0/4230994903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae0104800 msgr2=0x7fbae019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbade59c640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae0104800 0x7fbae019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbade59c640 1 -- 172.21.15.47:0/4230994903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbae01051a0 msgr2=0x7fbae019b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbade59c640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbae01051a0 0x7fbae019b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbade59c640 1 -- 172.21.15.47:0/4230994903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae019b910 con 0x7fbae0103770 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbade59c640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 0x7fbae0199f50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbad0005790 tx=0x7fbad00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbacf7fe640 1 -- 172.21.15.47:0/4230994903 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad003f030 con 0x7fbae0103770 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbacf7fe640 1 -- 172.21.15.47:0/4230994903 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbad0003c90 con 0x7fbae0103770 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae019bba0 con 0x7fbae0103770 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.997+0000 7fbacf7fe640 1 -- 172.21.15.47:0/4230994903 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0035070 con 0x7fbae0103770 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.998+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae01a2130 con 0x7fbae0103770 2024-09-21T00:50:36.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:35.999+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae010a950 con 0x7fbae0103770 2024-09-21T00:50:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.000+0000 7fbacf7fe640 1 -- 172.21.15.47:0/4230994903 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fbad0042030 con 0x7fbae0103770 2024-09-21T00:50:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.001+0000 7fbacf7fe640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbac80b6500 0x7fbac80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.001+0000 7fbaddd9b640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbac80b6500 0x7fbac80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.001+0000 7fbacf7fe640 1 -- 172.21.15.47:0/4230994903 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbad0105c50 con 0x7fbae0103770 2024-09-21T00:50:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.001+0000 7fbaddd9b640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbac80b6500 0x7fbac80b8a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009bd0 tx=0x7fbad4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.005+0000 7fbacf7fe640 1 -- 172.21.15.47:0/4230994903 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbad00d24f0 con 0x7fbae0103770 2024-09-21T00:50:36.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.201+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fbae002e640 con 0x7fbae0103770 2024-09-21T00:50:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.205+0000 7fbacf7fe640 1 -- 172.21.15.47:0/4230994903 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v25)=0 v25) ==== 111+0+0 (secure 0 0 0) 0x7fbad00d7430 con 0x7fbae0103770 2024-09-21T00:50:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbac80b6500 msgr2=0x7fbac80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbac80b6500 0x7fbac80b8a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009bd0 tx=0x7fbad4005f90 comp rx=0 tx=0).stop 2024-09-21T00:50:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 msgr2=0x7fbae0199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 0x7fbae0199f50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbad0005790 tx=0x7fbad00042f0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 shutdown_connections 2024-09-21T00:50:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbac80b6500 0x7fbac80b8a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbae01051a0 0x7fbae019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae0104800 0x7fbae019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 --2- 172.21.15.47:0/4230994903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbae0103770 0x7fbae0199f50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 >> 172.21.15.47:0/4230994903 conn(0x7fbae00ff0e0 msgr2=0x7fbae0107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 shutdown_connections 2024-09-21T00:50:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.208+0000 7fbae4e46640 1 -- 172.21.15.47:0/4230994903 wait complete. 2024-09-21T00:50:36.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.290+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f17c0109360 con 0x7f17c0102670 2024-09-21T00:50:36.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.291+0000 7f17bd7fa640 1 -- 172.21.15.47:0/3852218535 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v25)=0 v25) ==== 106+0+0 (secure 0 0 0) 0x7f17b00b6960 con 0x7f17c0102670 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f17a80b6500 msgr2=0x7f17a80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f17a80b6500 0x7f17a80b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17b4031440 tx=0x7f17b4005720 comp rx=0 tx=0).stop 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c0102670 msgr2=0x7f17c0198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c0102670 0x7f17c0198dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17b000d6d0 tx=0x7f17b000db90 comp rx=0 tx=0).stop 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 shutdown_connections 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f17a80b6500 0x7f17a80b8a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17c01040a0 0x7f17c0199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17c0103700 0x7f17c0199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 --2- 172.21.15.47:0/3852218535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17c0102670 0x7f17c0198dc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 >> 172.21.15.47:0/3852218535 conn(0x7f17c00fdfe0 msgr2=0x7f17c0106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:36.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 shutdown_connections 2024-09-21T00:50:36.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:36.294+0000 7f17c69e4640 1 -- 172.21.15.47:0/3852218535 wait complete. 2024-09-21T00:50:36.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:36 smithi047 ceph-mon[30960]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:36.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:36 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3926208435' entity='client.admin' 2024-09-21T00:50:36.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:36 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4230994903' entity='client.admin' 2024-09-21T00:50:36.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:36 smithi134 ceph-mon[34785]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:36.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:36 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3926208435' entity='client.admin' 2024-09-21T00:50:36.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:36 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4230994903' entity='client.admin' 2024-09-21T00:50:36.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:36 smithi114 ceph-mon[34309]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:36.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:36 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3926208435' entity='client.admin' 2024-09-21T00:50:36.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:36 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4230994903' entity='client.admin' 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 -- 172.21.15.47:0/2210159062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 msgr2=0x7fb974103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/2210159062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 0x7fb974103ae0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb964009900 tx=0x7fb96402a480 comp rx=0 tx=0).stop 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 -- 172.21.15.47:0/2210159062 shutdown_connections 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/2210159062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb974104070 0x7fb97410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/2210159062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 0x7fb974103ae0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/2210159062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb974102640 0x7fb974102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 -- 172.21.15.47:0/2210159062 >> 172.21.15.47:0/2210159062 conn(0x7fb9740fdfb0 msgr2=0x7fb974100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 -- 172.21.15.47:0/2210159062 shutdown_connections 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.995+0000 7fb97bcdd640 1 -- 172.21.15.47:0/2210159062 wait complete. 2024-09-21T00:50:36.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.996+0000 7fb97bcdd640 1 Processor -- start 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.996+0000 7fb97bcdd640 1 -- start start 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.996+0000 7fb97bcdd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb974102640 0x7fb97419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.996+0000 7fb97bcdd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 0x7fb97419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.996+0000 7fb97bcdd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb974104070 0x7fb97419d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.996+0000 7fb97bcdd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb97410e040 con 0x7fb9741036d0 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.996+0000 7fb97bcdd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb97410dec0 con 0x7fb974102640 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.996+0000 7fb97bcdd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb97410e1c0 con 0x7fb974104070 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 0x7fb97419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 0x7fb97419c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50560/0 (socket says 172.21.15.47:50560) 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 -- 172.21.15.47:0/1360585039 learned_addr learned my addr 172.21.15.47:0/1360585039 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979a79640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb974102640 0x7fb97419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb97a27a640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb974104070 0x7fb97419d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 -- 172.21.15.47:0/1360585039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb974104070 msgr2=0x7fb97419d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb974104070 0x7fb97419d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 -- 172.21.15.47:0/1360585039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb974102640 msgr2=0x7fb97419c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb974102640 0x7fb97419c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 -- 172.21.15.47:0/1360585039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97419da40 con 0x7fb9741036d0 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb97a27a640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb974104070 0x7fb97419d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb979278640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 0x7fb97419c680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb96402aa70 tx=0x7fb964003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb96affd640 1 -- 172.21.15.47:0/1360585039 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96403f070 con 0x7fb9741036d0 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97419dcd0 con 0x7fb9741036d0 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb96affd640 1 -- 172.21.15.47:0/1360585039 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fb964031d20 con 0x7fb9741036d0 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.997+0000 7fb96affd640 1 -- 172.21.15.47:0/1360585039 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964035030 con 0x7fb9741036d0 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.998+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9741a4430 con 0x7fb9741036d0 2024-09-21T00:50:36.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:33.999+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb974102ab0 con 0x7fb9741036d0 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.000+0000 7fb96affd640 1 -- 172.21.15.47:0/1360585039 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fb964042070 con 0x7fb9741036d0 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.001+0000 7fb96affd640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb9600b6480 0x7fb9600b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.001+0000 7fb979a79640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb9600b6480 0x7fb9600b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.001+0000 7fb96affd640 1 -- 172.21.15.47:0/1360585039 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb964105c50 con 0x7fb9741036d0 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.001+0000 7fb979a79640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb9600b6480 0x7fb9600b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb970005d00 tx=0x7fb97000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.005+0000 7fb96affd640 1 -- 172.21.15.47:0/1360585039 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9640ce110 con 0x7fb9741036d0 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.201+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb9741a48f0 con 0x7fb9741036d0 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.205+0000 7fb96affd640 1 -- 172.21.15.47:0/1360585039 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fb9640d24f0 con 0x7fb9741036d0 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb9600b6480 msgr2=0x7fb9600b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb9600b6480 0x7fb9600b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb970005d00 tx=0x7fb97000b410 comp rx=0 tx=0).stop 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 msgr2=0x7fb97419c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 0x7fb97419c680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb96402aa70 tx=0x7fb964003cd0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 shutdown_connections 2024-09-21T00:50:36.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb9600b6480 0x7fb9600b8990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb974104070 0x7fb97419d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9741036d0 0x7fb97419c680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 --2- 172.21.15.47:0/1360585039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb974102640 0x7fb97419c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:36.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 >> 172.21.15.47:0/1360585039 conn(0x7fb9740fdfb0 msgr2=0x7fb9740ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:36.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 shutdown_connections 2024-09-21T00:50:36.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:34.208+0000 7fb97bcdd640 1 -- 172.21.15.47:0/1360585039 wait complete. 2024-09-21T00:50:37.132 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:37.133 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:38.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 -- 172.21.15.47:0/3257752952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c102660 msgr2=0x7f777c102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 --2- 172.21.15.47:0/3257752952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c102660 0x7f777c102ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7778009900 tx=0x7f777802a480 comp rx=0 tx=0).stop 2024-09-21T00:50:38.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 -- 172.21.15.47:0/3257752952 shutdown_connections 2024-09-21T00:50:38.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 --2- 172.21.15.47:0/3257752952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777c104090 0x7f777c10aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 --2- 172.21.15.47:0/3257752952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f777c1036f0 0x7f777c103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 --2- 172.21.15.47:0/3257752952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c102660 0x7f777c102ad0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 -- 172.21.15.47:0/3257752952 >> 172.21.15.47:0/3257752952 conn(0x7f777c0fdfd0 msgr2=0x7f777c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:38.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 -- 172.21.15.47:0/3257752952 shutdown_connections 2024-09-21T00:50:38.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.078+0000 7f77833a3640 1 -- 172.21.15.47:0/3257752952 wait complete. 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f77833a3640 1 Processor -- start 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f77833a3640 1 -- start start 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f77833a3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f777c102660 0x7f777c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f77833a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c1036f0 0x7f777c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f77833a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777c104090 0x7f777c19b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f77833a3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f777c10e1c0 con 0x7f777c1036f0 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f77833a3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f777c10e040 con 0x7f777c104090 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f77833a3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f777c10e340 con 0x7f777c102660 2024-09-21T00:50:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.079+0000 7f778093e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c1036f0 0x7f777c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778093e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c1036f0 0x7f777c19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50642/0 (socket says 172.21.15.47:50642) 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778093e640 1 -- 172.21.15.47:0/1419410777 learned_addr learned my addr 172.21.15.47:0/1419410777 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778113f640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f777c102660 0x7f777c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f7781940640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777c104090 0x7f777c19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778093e640 1 -- 172.21.15.47:0/1419410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f777c102660 msgr2=0x7f777c19a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778093e640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f777c102660 0x7f777c19a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778093e640 1 -- 172.21.15.47:0/1419410777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777c104090 msgr2=0x7f777c19b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778093e640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777c104090 0x7f777c19b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778093e640 1 -- 172.21.15.47:0/1419410777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c19ba10 con 0x7f777c1036f0 2024-09-21T00:50:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f7781940640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777c104090 0x7f777c19b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778113f640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f777c102660 0x7f777c19a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f778093e640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c1036f0 0x7f777c19a6e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f776c00b4a0 tx=0x7f776c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f77727fc640 1 -- 172.21.15.47:0/1419410777 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c014070 con 0x7f777c1036f0 2024-09-21T00:50:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f77727fc640 1 -- 172.21.15.47:0/1419410777 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f776c010aa0 con 0x7f777c1036f0 2024-09-21T00:50:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f77727fc640 1 -- 172.21.15.47:0/1419410777 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c017b80 con 0x7f777c1036f0 2024-09-21T00:50:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777c19bd00 con 0x7f777c1036f0 2024-09-21T00:50:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.080+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777c1a2490 con 0x7f777c1036f0 2024-09-21T00:50:38.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.082+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777c1a2660 con 0x7f777c1036f0 2024-09-21T00:50:38.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.083+0000 7f77727fc640 1 -- 172.21.15.47:0/1419410777 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f776c017070 con 0x7f777c1036f0 2024-09-21T00:50:38.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.084+0000 7f77727fc640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77680b6500 0x7f77680b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:38.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.084+0000 7f778113f640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77680b6500 0x7f77680b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:38.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.084+0000 7f77727fc640 1 -- 172.21.15.47:0/1419410777 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f776c0e4db0 con 0x7f777c1036f0 2024-09-21T00:50:38.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.085+0000 7f778113f640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77680b6500 0x7f77680b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7778031440 tx=0x7f7778009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:38.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.087+0000 7f77727fc640 1 -- 172.21.15.47:0/1419410777 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f776c0ad310 con 0x7f777c1036f0 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 -- 172.21.15.47:0/1873402746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c104800 msgr2=0x7fdb1c104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 --2- 172.21.15.47:0/1873402746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c104800 0x7fdb1c104c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009900 tx=0x7fdb0802a480 comp rx=0 tx=0).stop 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 -- 172.21.15.47:0/1873402746 shutdown_connections 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 --2- 172.21.15.47:0/1873402746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c1051a0 0x7fdb1c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 --2- 172.21.15.47:0/1873402746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c104800 0x7fdb1c104c10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 --2- 172.21.15.47:0/1873402746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c103770 0x7fdb1c103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 -- 172.21.15.47:0/1873402746 >> 172.21.15.47:0/1873402746 conn(0x7fdb1c0ff0e0 msgr2=0x7fdb1c101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 -- 172.21.15.47:0/1873402746 shutdown_connections 2024-09-21T00:50:38.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 -- 172.21.15.47:0/1873402746 wait complete. 2024-09-21T00:50:38.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.275+0000 7fdb22c43640 1 Processor -- start 2024-09-21T00:50:38.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb22c43640 1 -- start start 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb22c43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103770 0x7fdb1c19c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb22c43640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c104800 0x7fdb1c19c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb22c43640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c1051a0 0x7fdb1c19d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb22c43640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c10f280 con 0x7fdb1c1051a0 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb22c43640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c10f100 con 0x7fdb1c104800 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb22c43640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c10f400 con 0x7fdb1c103770 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb211e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c1051a0 0x7fdb1c19d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb211e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c1051a0 0x7fdb1c19d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50670/0 (socket says 172.21.15.47:50670) 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb211e0640 1 -- 172.21.15.47:0/4158251564 learned_addr learned my addr 172.21.15.47:0/4158251564 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb209df640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103770 0x7fdb1c19c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb1bfff640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c104800 0x7fdb1c19c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:38.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb211e0640 1 -- 172.21.15.47:0/4158251564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103770 msgr2=0x7fdb1c19c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb211e0640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103770 0x7fdb1c19c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb211e0640 1 -- 172.21.15.47:0/4158251564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c104800 msgr2=0x7fdb1c19c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb211e0640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c104800 0x7fdb1c19c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb211e0640 1 -- 172.21.15.47:0/4158251564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1c19db30 con 0x7fdb1c1051a0 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.276+0000 7fdb1bfff640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c104800 0x7fdb1c19c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.277+0000 7fdb211e0640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c1051a0 0x7fdb1c19d310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eaa0 tx=0x7fdb1400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.277+0000 7fdb19ffb640 1 -- 172.21.15.47:0/4158251564 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400cdb0 con 0x7fdb1c1051a0 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.277+0000 7fdb19ffb640 1 -- 172.21.15.47:0/4158251564 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdb14005020 con 0x7fdb1c1051a0 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.277+0000 7fdb19ffb640 1 -- 172.21.15.47:0/4158251564 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb140116d0 con 0x7fdb1c1051a0 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.277+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1c19de20 con 0x7fdb1c1051a0 2024-09-21T00:50:38.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.277+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c1a4520 con 0x7fdb1c1051a0 2024-09-21T00:50:38.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.278+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1c1a46f0 con 0x7fdb1c1051a0 2024-09-21T00:50:38.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.279+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f777c1a2830 con 0x7f777c1036f0 2024-09-21T00:50:38.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.280+0000 7fdb19ffb640 1 -- 172.21.15.47:0/4158251564 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fdb14004a40 con 0x7fdb1c1051a0 2024-09-21T00:50:38.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.281+0000 7fdb19ffb640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb0c0b6480 0x7fdb0c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:38.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.281+0000 7fdb209df640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb0c0b6480 0x7fdb0c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:38.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.281+0000 7fdb19ffb640 1 -- 172.21.15.47:0/4158251564 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdb140e5770 con 0x7fdb1c1051a0 2024-09-21T00:50:38.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.281+0000 7fdb209df640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb0c0b6480 0x7fdb0c0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb10005d00 tx=0x7fdb1000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:38.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.285+0000 7fdb19ffb640 1 -- 172.21.15.47:0/4158251564 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb14016030 con 0x7fdb1c1051a0 2024-09-21T00:50:38.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.288+0000 7f77727fc640 1 -- 172.21.15.47:0/1419410777 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7f776c0b16f0 con 0x7f777c1036f0 2024-09-21T00:50:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77680b6500 msgr2=0x7f77680b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77680b6500 0x7f77680b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7778031440 tx=0x7f7778009680 comp rx=0 tx=0).stop 2024-09-21T00:50:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c1036f0 msgr2=0x7f777c19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c1036f0 0x7f777c19a6e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f776c00b4a0 tx=0x7f776c00b960 comp rx=0 tx=0).stop 2024-09-21T00:50:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 shutdown_connections 2024-09-21T00:50:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77680b6500 0x7f77680b8a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777c104090 0x7f777c19b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f777c1036f0 0x7f777c19a6e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 --2- 172.21.15.47:0/1419410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f777c102660 0x7f777c19a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 >> 172.21.15.47:0/1419410777 conn(0x7f777c0fdfd0 msgr2=0x7f777c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 shutdown_connections 2024-09-21T00:50:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.291+0000 7f77833a3640 1 -- 172.21.15.47:0/1419410777 wait complete. 2024-09-21T00:50:38.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.485+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fdb1c1a48c0 con 0x7fdb1c1051a0 2024-09-21T00:50:38.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.491+0000 7fdb19ffb640 1 -- 172.21.15.47:0/4158251564 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v27)=0 v27) ==== 108+0+0 (secure 0 0 0) 0x7fdb140adcd0 con 0x7fdb1c1051a0 2024-09-21T00:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb0c0b6480 msgr2=0x7fdb0c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb0c0b6480 0x7fdb0c0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb10005d00 tx=0x7fdb1000b410 comp rx=0 tx=0).stop 2024-09-21T00:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c1051a0 msgr2=0x7fdb1c19d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c1051a0 0x7fdb1c19d310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eaa0 tx=0x7fdb1400ef60 comp rx=0 tx=0).stop 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 shutdown_connections 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb0c0b6480 0x7fdb0c0b8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb1c1051a0 0x7fdb1c19d310 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c104800 0x7fdb1c19c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 --2- 172.21.15.47:0/4158251564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103770 0x7fdb1c19c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 >> 172.21.15.47:0/4158251564 conn(0x7fdb1c0ff0e0 msgr2=0x7fdb1c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 shutdown_connections 2024-09-21T00:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:38.494+0000 7fdb22c43640 1 -- 172.21.15.47:0/4158251564 wait complete. 2024-09-21T00:50:38.598 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:38 smithi047 ceph-mon[30960]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:38.598 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:38 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1419410777' entity='client.admin' 2024-09-21T00:50:38.712 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:38 smithi114 ceph-mon[34309]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:38.712 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:38 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1419410777' entity='client.admin' 2024-09-21T00:50:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:38 smithi134 ceph-mon[34785]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:38 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1419410777' entity='client.admin' 2024-09-21T00:50:38.939 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-09-21T00:50:39.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:39 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4158251564' entity='client.admin' 2024-09-21T00:50:39.882 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:39 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4158251564' entity='client.admin' 2024-09-21T00:50:39.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:39 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4158251564' entity='client.admin' 2024-09-21T00:50:40.427 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:40.427 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:40.427 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:40.428 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:40.428 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:40.428 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:40 smithi134 ceph-mon[34785]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:40.879 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:40 smithi047 ceph-mon[30960]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:40 smithi114 ceph-mon[34309]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.934+0000 7f8ecafa4640 1 -- 172.21.15.47:0/2276295314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec4102650 msgr2=0x7f8ec4102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.934+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/2276295314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec4102650 0x7f8ec4102ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009900 tx=0x7f8eb802a480 comp rx=0 tx=0).stop 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.934+0000 7f8ecafa4640 1 -- 172.21.15.47:0/2276295314 shutdown_connections 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.934+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/2276295314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4104080 0x7f8ec410aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.934+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/2276295314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec41036e0 0x7f8ec4103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.934+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/2276295314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec4102650 0x7f8ec4102ac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.934+0000 7f8ecafa4640 1 -- 172.21.15.47:0/2276295314 >> 172.21.15.47:0/2276295314 conn(0x7f8ec40fdfe0 msgr2=0x7f8ec4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.934+0000 7f8ecafa4640 1 -- 172.21.15.47:0/2276295314 shutdown_connections 2024-09-21T00:50:41.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.935+0000 7f8ecafa4640 1 -- 172.21.15.47:0/2276295314 wait complete. 2024-09-21T00:50:41.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ecafa4640 1 Processor -- start 2024-09-21T00:50:41.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ecafa4640 1 -- start start 2024-09-21T00:50:41.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ecafa4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec4102650 0x7f8ec4198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ecafa4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec41036e0 0x7f8ec4199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ecafa4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4104080 0x7f8ec4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ecafa4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec410e150 con 0x7f8ec41036e0 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ecafa4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec410dfd0 con 0x7f8ec4104080 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ecafa4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec410e2d0 con 0x7f8ec4102650 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ec3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec41036e0 0x7f8ec4199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ec3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec41036e0 0x7f8ec4199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43168/0 (socket says 172.21.15.47:43168) 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ec3fff640 1 -- 172.21.15.47:0/3462564830 learned_addr learned my addr 172.21.15.47:0/3462564830 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ec8d40640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec4102650 0x7f8ec4198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.936+0000 7f8ec9541640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4104080 0x7f8ec4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec3fff640 1 -- 172.21.15.47:0/3462564830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec4102650 msgr2=0x7f8ec4198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec3fff640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec4102650 0x7f8ec4198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec3fff640 1 -- 172.21.15.47:0/3462564830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4104080 msgr2=0x7f8ec4199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec3fff640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4104080 0x7f8ec4199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec3fff640 1 -- 172.21.15.47:0/3462564830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec419a810 con 0x7f8ec41036e0 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec9541640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4104080 0x7f8ec4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec3fff640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec41036e0 0x7f8ec4199450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000d770 tx=0x7f8eb000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec1ffb640 1 -- 172.21.15.47:0/3462564830 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0017070 con 0x7f8ec41036e0 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec1ffb640 1 -- 172.21.15.47:0/3462564830 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8eb00054b0 con 0x7f8ec41036e0 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec419ab00 con 0x7f8ec41036e0 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ec1ffb640 1 -- 172.21.15.47:0/3462564830 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0004c70 con 0x7f8ec41036e0 2024-09-21T00:50:41.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.937+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec406bd10 con 0x7f8ec41036e0 2024-09-21T00:50:41.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.938+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec4102ac0 con 0x7f8ec41036e0 2024-09-21T00:50:41.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.940+0000 7f8ec1ffb640 1 -- 172.21.15.47:0/3462564830 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f8eb0004e10 con 0x7f8ec41036e0 2024-09-21T00:50:41.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.940+0000 7f8ec1ffb640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8eb40b6500 0x7f8eb40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:41.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.941+0000 7f8ec8d40640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8eb40b6500 0x7f8eb40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:41.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.941+0000 7f8ec1ffb640 1 -- 172.21.15.47:0/3462564830 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8eb00e5030 con 0x7f8ec41036e0 2024-09-21T00:50:41.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.941+0000 7f8ec8d40640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8eb40b6500 0x7f8eb40b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8000c00 tx=0x7f8eb8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:41.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:41.945+0000 7f8ec1ffb640 1 -- 172.21.15.47:0/3462564830 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8eb00ad590 con 0x7f8ec41036e0 2024-09-21T00:50:42.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.138+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f8ec41092d0 con 0x7f8ec41036e0 2024-09-21T00:50:42.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.142+0000 7f8ec1ffb640 1 -- 172.21.15.47:0/3462564830 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7f8eb00b1970 con 0x7f8ec41036e0 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.144+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8eb40b6500 msgr2=0x7f8eb40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.144+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8eb40b6500 0x7f8eb40b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8000c00 tx=0x7f8eb8031400 comp rx=0 tx=0).stop 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.144+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec41036e0 msgr2=0x7f8ec4199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.144+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec41036e0 0x7f8ec4199450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000d770 tx=0x7f8eb000dc30 comp rx=0 tx=0).stop 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.145+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 shutdown_connections 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.145+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8eb40b6500 0x7f8eb40b8a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.145+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4104080 0x7f8ec4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.145+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec41036e0 0x7f8ec4199450 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.145+0000 7f8ecafa4640 1 --2- 172.21.15.47:0/3462564830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ec4102650 0x7f8ec4198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.145+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 >> 172.21.15.47:0/3462564830 conn(0x7f8ec40fdfe0 msgr2=0x7f8ec4106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:42.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.145+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 shutdown_connections 2024-09-21T00:50:42.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.145+0000 7f8ecafa4640 1 -- 172.21.15.47:0/3462564830 wait complete. 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2471384237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 msgr2=0x7ff5ac10aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2471384237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 0x7ff5ac10aa10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009ca0 tx=0x7ff5a402a950 comp rx=0 tx=0).stop 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2471384237 shutdown_connections 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2471384237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 0x7ff5ac10aa10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2471384237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ac1036d0 0x7ff5ac103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2471384237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ac102640 0x7ff5ac102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2471384237 >> 172.21.15.47:0/2471384237 conn(0x7ff5ac0fdfb0 msgr2=0x7ff5ac100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2471384237 shutdown_connections 2024-09-21T00:50:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.159+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2471384237 wait complete. 2024-09-21T00:50:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5b1a96640 1 Processor -- start 2024-09-21T00:50:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5b1a96640 1 -- start start 2024-09-21T00:50:42.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5b1a96640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ac102640 0x7ff5ac06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5b1a96640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ac1036d0 0x7ff5ac19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5b1a96640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 0x7ff5ac1a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5b1a96640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ac10e130 con 0x7ff5ac104070 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5b1a96640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ac10dfb0 con 0x7ff5ac102640 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5b1a96640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ac10e2b0 con 0x7ff5ac1036d0 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5abfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 0x7ff5ac1a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5abfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 0x7ff5ac1a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43188/0 (socket says 172.21.15.47:43188) 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5abfff640 1 -- 172.21.15.47:0/2860515924 learned_addr learned my addr 172.21.15.47:0/2860515924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5ab7fe640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ac102640 0x7ff5ac06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.160+0000 7ff5aaffd640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ac1036d0 0x7ff5ac19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5abfff640 1 -- 172.21.15.47:0/2860515924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ac1036d0 msgr2=0x7ff5ac19ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:42.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5abfff640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ac1036d0 0x7ff5ac19ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5abfff640 1 -- 172.21.15.47:0/2860515924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ac102640 msgr2=0x7ff5ac06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5abfff640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ac102640 0x7ff5ac06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5abfff640 1 -- 172.21.15.47:0/2860515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ac1a1940 con 0x7ff5ac104070 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5abfff640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 0x7ff5ac1a1140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5a402ae70 tx=0x7ff5a4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5a8ff9640 1 -- 172.21.15.47:0/2860515924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4034040 con 0x7ff5ac104070 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5a8ff9640 1 -- 172.21.15.47:0/2860515924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff5a4003e50 con 0x7ff5ac104070 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ac1a1bd0 con 0x7ff5ac104070 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5a8ff9640 1 -- 172.21.15.47:0/2860515924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40045e0 con 0x7ff5ac104070 2024-09-21T00:50:42.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.161+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ac1a2100 con 0x7ff5ac104070 2024-09-21T00:50:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.162+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ac109820 con 0x7ff5ac104070 2024-09-21T00:50:42.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.164+0000 7ff5a8ff9640 1 -- 172.21.15.47:0/2860515924 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7ff5a4037020 con 0x7ff5ac104070 2024-09-21T00:50:42.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.165+0000 7ff5a8ff9640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5940b6500 0x7ff5940b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:42.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.165+0000 7ff5ab7fe640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5940b6500 0x7ff5940b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:42.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.166+0000 7ff5a8ff9640 1 -- 172.21.15.47:0/2860515924 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff5a41064e0 con 0x7ff5ac104070 2024-09-21T00:50:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.166+0000 7ff5ab7fe640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5940b6500 0x7ff5940b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009bd0 tx=0x7ff59c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:42.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.168+0000 7ff5a8ff9640 1 -- 172.21.15.47:0/2860515924 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5a4083710 con 0x7ff5ac104070 2024-09-21T00:50:42.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.360+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7ff5ac02e640 con 0x7ff5ac104070 2024-09-21T00:50:42.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.364+0000 7ff5a8ff9640 1 -- 172.21.15.47:0/2860515924 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7ff5a40cea40 con 0x7ff5ac104070 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5940b6500 msgr2=0x7ff5940b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5940b6500 0x7ff5940b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009bd0 tx=0x7ff59c005f90 comp rx=0 tx=0).stop 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 msgr2=0x7ff5ac1a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 0x7ff5ac1a1140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5a402ae70 tx=0x7ff5a4003ba0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 shutdown_connections 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5940b6500 0x7ff5940b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5ac104070 0x7ff5ac1a1140 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5ac1036d0 0x7ff5ac19ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 --2- 172.21.15.47:0/2860515924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ac102640 0x7ff5ac06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 >> 172.21.15.47:0/2860515924 conn(0x7ff5ac0fdfb0 msgr2=0x7ff5ac1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 shutdown_connections 2024-09-21T00:50:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:42.366+0000 7ff5b1a96640 1 -- 172.21.15.47:0/2860515924 wait complete. 2024-09-21T00:50:42.699 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:42 smithi047 ceph-mon[30960]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:42.700 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:42 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3462564830' entity='client.admin' 2024-09-21T00:50:42.700 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:42 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2860515924' entity='client.admin' 2024-09-21T00:50:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:42 smithi134 ceph-mon[34785]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:42 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3462564830' entity='client.admin' 2024-09-21T00:50:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:42 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2860515924' entity='client.admin' 2024-09-21T00:50:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:42 smithi114 ceph-mon[34309]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:42 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3462564830' entity='client.admin' 2024-09-21T00:50:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:42 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2860515924' entity='client.admin' 2024-09-21T00:50:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 -- 172.21.15.47:0/3396000256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 msgr2=0x7fecfc103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 --2- 172.21.15.47:0/3396000256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 0x7fecfc103af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009900 tx=0x7fecf002a480 comp rx=0 tx=0).stop 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 -- 172.21.15.47:0/3396000256 shutdown_connections 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 --2- 172.21.15.47:0/3396000256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecfc104080 0x7fecfc10aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 --2- 172.21.15.47:0/3396000256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 0x7fecfc103af0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 --2- 172.21.15.47:0/3396000256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecfc102650 0x7fecfc102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 -- 172.21.15.47:0/3396000256 >> 172.21.15.47:0/3396000256 conn(0x7fecfc0fdfa0 msgr2=0x7fecfc100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 -- 172.21.15.47:0/3396000256 shutdown_connections 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.271+0000 7fed01892640 1 -- 172.21.15.47:0/3396000256 wait complete. 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.272+0000 7fed01892640 1 Processor -- start 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.272+0000 7fed01892640 1 -- start start 2024-09-21T00:50:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.272+0000 7fed01892640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecfc102650 0x7fecfc06c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.272+0000 7fed01892640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 0x7fecfc19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.272+0000 7fed01892640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecfc104080 0x7fecfc1a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.272+0000 7fed01892640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc10e140 con 0x7fecfc1036e0 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.272+0000 7fed01892640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc10dfc0 con 0x7fecfc104080 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.272+0000 7fed01892640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc10e2c0 con 0x7fecfc102650 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 0x7fecfc19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 0x7fecfc19ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43218/0 (socket says 172.21.15.47:43218) 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 -- 172.21.15.47:0/639170115 learned_addr learned my addr 172.21.15.47:0/639170115 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfb7fe640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecfc104080 0x7fecfc1a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:44.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfaffd640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecfc102650 0x7fecfc06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:44.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 -- 172.21.15.47:0/639170115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecfc102650 msgr2=0x7fecfc06c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecfc102650 0x7fecfc06c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 -- 172.21.15.47:0/639170115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecfc104080 msgr2=0x7fecfc1a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecfc104080 0x7fecfc1a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 -- 172.21.15.47:0/639170115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc1989f0 con 0x7fecfc1036e0 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfaffd640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecfc102650 0x7fecfc06c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfb7fe640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecfc104080 0x7fecfc1a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fecfa7fc640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 0x7fecfc19ec20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fecf0004770 tx=0x7fecf00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fed00890640 1 -- 172.21.15.47:0/639170115 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf003f030 con 0x7fecfc1036e0 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc198c80 con 0x7fecfc1036e0 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fed00890640 1 -- 172.21.15.47:0/639170115 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fecf00044c0 con 0x7fecfc1036e0 2024-09-21T00:50:44.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.273+0000 7fed00890640 1 -- 172.21.15.47:0/639170115 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0035070 con 0x7fecfc1036e0 2024-09-21T00:50:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.274+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc1991b0 con 0x7fecfc1036e0 2024-09-21T00:50:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.275+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecfc02e640 con 0x7fecfc1036e0 2024-09-21T00:50:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.276+0000 7fed00890640 1 -- 172.21.15.47:0/639170115 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fecf0042030 con 0x7fecfc1036e0 2024-09-21T00:50:44.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.277+0000 7fed00890640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fece40b6500 0x7fece40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:44.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.277+0000 7fecfaffd640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fece40b6500 0x7fece40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:44.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.277+0000 7fed00890640 1 -- 172.21.15.47:0/639170115 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fecf0106200 con 0x7fecfc1036e0 2024-09-21T00:50:44.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.277+0000 7fecfaffd640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fece40b6500 0x7fece40b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fecec009c20 tx=0x7fecec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:44.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.280+0000 7fed00890640 1 -- 172.21.15.47:0/639170115 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fecf00ce760 con 0x7fecfc1036e0 2024-09-21T00:50:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.469+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fecfc109340 con 0x7fecfc1036e0 2024-09-21T00:50:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.469+0000 7fed00890640 1 -- 172.21.15.47:0/639170115 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v29)=0 v29) ==== 108+0+0 (secure 0 0 0) 0x7fecf00d2b40 con 0x7fecfc1036e0 2024-09-21T00:50:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.471+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fece40b6500 msgr2=0x7fece40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.471+0000 7fed01892640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fece40b6500 0x7fece40b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fecec009c20 tx=0x7fecec005f90 comp rx=0 tx=0).stop 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.471+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 msgr2=0x7fecfc19ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.471+0000 7fed01892640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 0x7fecfc19ec20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fecf0004770 tx=0x7fecf00040c0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.471+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 shutdown_connections 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.471+0000 7fed01892640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fece40b6500 0x7fece40b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.472+0000 7fed01892640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecfc104080 0x7fecfc1a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.472+0000 7fed01892640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecfc1036e0 0x7fecfc19ec20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.472+0000 7fed01892640 1 --2- 172.21.15.47:0/639170115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecfc102650 0x7fecfc06c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.472+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 >> 172.21.15.47:0/639170115 conn(0x7fecfc0fdfa0 msgr2=0x7fecfc106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.472+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 shutdown_connections 2024-09-21T00:50:44.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.472+0000 7fed01892640 1 -- 172.21.15.47:0/639170115 wait complete. 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.503+0000 7ff866cb1640 1 -- 172.21.15.47:0/1281471163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860103720 msgr2=0x7ff860103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.503+0000 7ff866cb1640 1 --2- 172.21.15.47:0/1281471163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860103720 0x7ff860103b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009900 tx=0x7ff84c02a480 comp rx=0 tx=0).stop 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.504+0000 7ff866cb1640 1 -- 172.21.15.47:0/1281471163 shutdown_connections 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.504+0000 7ff866cb1640 1 --2- 172.21.15.47:0/1281471163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8601040c0 0x7ff86010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.504+0000 7ff866cb1640 1 --2- 172.21.15.47:0/1281471163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860103720 0x7ff860103b30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.504+0000 7ff866cb1640 1 --2- 172.21.15.47:0/1281471163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff860102690 0x7ff860102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.504+0000 7ff866cb1640 1 -- 172.21.15.47:0/1281471163 >> 172.21.15.47:0/1281471163 conn(0x7ff8600fe000 msgr2=0x7ff8601004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.504+0000 7ff866cb1640 1 -- 172.21.15.47:0/1281471163 shutdown_connections 2024-09-21T00:50:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.504+0000 7ff866cb1640 1 -- 172.21.15.47:0/1281471163 wait complete. 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.504+0000 7ff866cb1640 1 Processor -- start 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff866cb1640 1 -- start start 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff866cb1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860102690 0x7ff860197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff866cb1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff860103720 0x7ff860198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff866cb1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8601040c0 0x7ff860198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff866cb1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff86010d110 con 0x7ff860102690 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff866cb1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff86010cf90 con 0x7ff8601040c0 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff866cb1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff86010d290 con 0x7ff860103720 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff864a4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860102690 0x7ff860197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff864a4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860102690 0x7ff860197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43234/0 (socket says 172.21.15.47:43234) 2024-09-21T00:50:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff864a4d640 1 -- 172.21.15.47:0/3630536723 learned_addr learned my addr 172.21.15.47:0/3630536723 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff86524e640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8601040c0 0x7ff860198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff85ffff640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff860103720 0x7ff860198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff864a4d640 1 -- 172.21.15.47:0/3630536723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff860103720 msgr2=0x7ff860198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff864a4d640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff860103720 0x7ff860198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff864a4d640 1 -- 172.21.15.47:0/3630536723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8601040c0 msgr2=0x7ff860198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff864a4d640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8601040c0 0x7ff860198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.505+0000 7ff864a4d640 1 -- 172.21.15.47:0/3630536723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff860199730 con 0x7ff860102690 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.506+0000 7ff86524e640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8601040c0 0x7ff860198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.506+0000 7ff85ffff640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff860103720 0x7ff860198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.506+0000 7ff864a4d640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860102690 0x7ff860197d00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff85400e9f0 tx=0x7ff85400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.506+0000 7ff85dffb640 1 -- 172.21.15.47:0/3630536723 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85400cd80 con 0x7ff860102690 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.506+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff860199a20 con 0x7ff860102690 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.506+0000 7ff85dffb640 1 -- 172.21.15.47:0/3630536723 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff8540054b0 con 0x7ff860102690 2024-09-21T00:50:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.506+0000 7ff85dffb640 1 -- 172.21.15.47:0/3630536723 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85400cd80 con 0x7ff860102690 2024-09-21T00:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.506+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8601a0120 con 0x7ff860102690 2024-09-21T00:50:44.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.507+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff860102b00 con 0x7ff860102690 2024-09-21T00:50:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.510+0000 7ff85dffb640 1 -- 172.21.15.47:0/3630536723 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7ff8540046c0 con 0x7ff860102690 2024-09-21T00:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.512+0000 7ff85dffb640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff8500b68f0 0x7ff8500b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.512+0000 7ff85dffb640 1 -- 172.21.15.47:0/3630536723 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff85400cb80 con 0x7ff860102690 2024-09-21T00:50:44.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.513+0000 7ff85ffff640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff8500b68f0 0x7ff8500b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:44.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.513+0000 7ff85dffb640 1 -- 172.21.15.47:0/3630536723 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8540adaf0 con 0x7ff860102690 2024-09-21T00:50:44.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.514+0000 7ff85ffff640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff8500b68f0 0x7ff8500b8e00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff84c005790 tx=0x7ff84c005720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.717+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ff860109870 con 0x7ff860102690 2024-09-21T00:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.721+0000 7ff85dffb640 1 -- 172.21.15.47:0/3630536723 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7ff860109870 con 0x7ff860102690 2024-09-21T00:50:44.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:44 smithi047 ceph-mon[30960]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:44.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:44.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:44.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:44.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:44.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:44.722 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.722+0000 7ff85dffb640 1 -- 172.21.15.47:0/3630536723 <== mon.0 v2:172.21.15.47:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8540acf00 con 0x7ff860102690 2024-09-21T00:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff8500b68f0 msgr2=0x7ff8500b8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff8500b68f0 0x7ff8500b8e00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff84c005790 tx=0x7ff84c005720 comp rx=0 tx=0).stop 2024-09-21T00:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860102690 msgr2=0x7ff860197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860102690 0x7ff860197d00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff85400e9f0 tx=0x7ff85400edf0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 shutdown_connections 2024-09-21T00:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff8500b68f0 0x7ff8500b8e00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8601040c0 0x7ff860198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff860103720 0x7ff860198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 --2- 172.21.15.47:0/3630536723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff860102690 0x7ff860197d00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 >> 172.21.15.47:0/3630536723 conn(0x7ff8600fe000 msgr2=0x7ff860106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 shutdown_connections 2024-09-21T00:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:44.723+0000 7ff866cb1640 1 -- 172.21.15.47:0/3630536723 wait complete. 2024-09-21T00:50:45.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:44 smithi134 ceph-mon[34785]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:45.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:45.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:45.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:45.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:45.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:45.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:45.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 -- 172.21.15.47:0/3889369510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a30103700 msgr2=0x7f6a30103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 --2- 172.21.15.47:0/3889369510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a30103700 0x7f6a30103b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009900 tx=0x7f6a2402a480 comp rx=0 tx=0).stop 2024-09-21T00:50:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 -- 172.21.15.47:0/3889369510 shutdown_connections 2024-09-21T00:50:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 --2- 172.21.15.47:0/3889369510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a301040a0 0x7f6a3010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 --2- 172.21.15.47:0/3889369510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a30103700 0x7f6a30103b10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 --2- 172.21.15.47:0/3889369510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a30102670 0x7f6a30102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 -- 172.21.15.47:0/3889369510 >> 172.21.15.47:0/3889369510 conn(0x7f6a300fdfe0 msgr2=0x7f6a30100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 -- 172.21.15.47:0/3889369510 shutdown_connections 2024-09-21T00:50:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 -- 172.21.15.47:0/3889369510 wait complete. 2024-09-21T00:50:45.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 Processor -- start 2024-09-21T00:50:45.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.144+0000 7f6a373f7640 1 -- start start 2024-09-21T00:50:45.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a373f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a30102670 0x7f6a3006c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:45.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a373f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a30103700 0x7f6a3019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a373f7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a301040a0 0x7f6a301a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a373f7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3010e2a0 con 0x7f6a301040a0 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a373f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3010e120 con 0x7f6a30103700 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a373f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3010e420 con 0x7f6a30102670 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a301040a0 0x7f6a301a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a301040a0 0x7f6a301a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43238/0 (socket says 172.21.15.47:43238) 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 -- 172.21.15.47:0/966048212 learned_addr learned my addr 172.21.15.47:0/966048212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35193640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a30102670 0x7f6a3006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a34992640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a30103700 0x7f6a3019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 -- 172.21.15.47:0/966048212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a30102670 msgr2=0x7f6a3006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a30102670 0x7f6a3006c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 -- 172.21.15.47:0/966048212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a30103700 msgr2=0x7f6a3019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a30103700 0x7f6a3019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 -- 172.21.15.47:0/966048212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a301a1ac0 con 0x7f6a301040a0 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.145+0000 7f6a35994640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a301040a0 0x7f6a301a12c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009fd0 tx=0x7f6a2000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.146+0000 7f6a2e7fc640 1 -- 172.21.15.47:0/966048212 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20017070 con 0x7f6a301040a0 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.146+0000 7f6a2e7fc640 1 -- 172.21.15.47:0/966048212 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a20003e20 con 0x7f6a301040a0 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.146+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a301a1db0 con 0x7f6a301040a0 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.146+0000 7f6a2e7fc640 1 -- 172.21.15.47:0/966048212 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20010460 con 0x7f6a301040a0 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.146+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a301a2210 con 0x7f6a301040a0 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.147+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a30109830 con 0x7f6a301040a0 2024-09-21T00:50:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.148+0000 7f6a2e7fc640 1 -- 172.21.15.47:0/966048212 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f6a20003970 con 0x7f6a301040a0 2024-09-21T00:50:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.149+0000 7f6a2e7fc640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6a180b6500 0x7f6a180b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.150+0000 7f6a35193640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6a180b6500 0x7f6a180b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.150+0000 7f6a2e7fc640 1 -- 172.21.15.47:0/966048212 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6a200e5760 con 0x7f6a301040a0 2024-09-21T00:50:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.150+0000 7f6a35193640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6a180b6500 0x7f6a180b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800bbe0 tx=0x7f6a2800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:45.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.153+0000 7f6a2e7fc640 1 -- 172.21.15.47:0/966048212 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a200add20 con 0x7f6a301040a0 2024-09-21T00:50:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:44 smithi114 ceph-mon[34309]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:45.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:50:45.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:45.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:50:45.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:50:45.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.342+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f6a3002e640 con 0x7f6a301040a0 2024-09-21T00:50:45.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.347+0000 7f6a2e7fc640 1 -- 172.21.15.47:0/966048212 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v31)=0 v31) ==== 116+0+0 (secure 0 0 0) 0x7f6a200b2100 con 0x7f6a301040a0 2024-09-21T00:50:45.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6a180b6500 msgr2=0x7f6a180b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:45.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6a180b6500 0x7f6a180b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800bbe0 tx=0x7f6a2800b390 comp rx=0 tx=0).stop 2024-09-21T00:50:45.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a301040a0 msgr2=0x7f6a301a12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:45.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a301040a0 0x7f6a301a12c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009fd0 tx=0x7f6a2000b260 comp rx=0 tx=0).stop 2024-09-21T00:50:45.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 shutdown_connections 2024-09-21T00:50:45.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6a180b6500 0x7f6a180b8a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a301040a0 0x7f6a301a12c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a30103700 0x7f6a3019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 --2- 172.21.15.47:0/966048212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a30102670 0x7f6a3006c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:45.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 >> 172.21.15.47:0/966048212 conn(0x7f6a300fdfe0 msgr2=0x7f6a30106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:45.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 shutdown_connections 2024-09-21T00:50:45.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:45.349+0000 7f6a373f7640 1 -- 172.21.15.47:0/966048212 wait complete. 2024-09-21T00:50:45.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi047') 2024-09-21T00:50:45.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi047') 2024-09-21T00:50:45.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi047') 2024-09-21T00:50:45.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi047') 2024-09-21T00:50:45.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi047') 2024-09-21T00:50:45.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi047') 2024-09-21T00:50:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:45 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3630536723' entity='client.admin' 2024-09-21T00:50:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:45 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/966048212' entity='client.admin' 2024-09-21T00:50:46.113 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:45 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3630536723' entity='client.admin' 2024-09-21T00:50:46.113 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:45 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/966048212' entity='client.admin' 2024-09-21T00:50:46.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:45 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3630536723' entity='client.admin' 2024-09-21T00:50:46.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:45 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/966048212' entity='client.admin' 2024-09-21T00:50:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:46 smithi047 ceph-mon[30960]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:47.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:46 smithi134 ceph-mon[34785]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:47.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:46 smithi114 ceph-mon[34309]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 -- 172.21.15.47:0/16417414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4102640 msgr2=0x7f74e4108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/16417414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4102640 0x7f74e4108e00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009900 tx=0x7f74d402a410 comp rx=0 tx=0).stop 2024-09-21T00:50:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 -- 172.21.15.47:0/16417414 shutdown_connections 2024-09-21T00:50:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/16417414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74e4109540 0x7f74e410ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/16417414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4102640 0x7f74e4108e00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/16417414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74e4101c10 0x7f74e4102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 -- 172.21.15.47:0/16417414 >> 172.21.15.47:0/16417414 conn(0x7f74e40fd800 msgr2=0x7f74e40ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 -- 172.21.15.47:0/16417414 shutdown_connections 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.792+0000 7f74eb4b9640 1 -- 172.21.15.47:0/16417414 wait complete. 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74eb4b9640 1 Processor -- start 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74eb4b9640 1 -- start start 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74eb4b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101c10 0x7f74e4199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74eb4b9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74e4102640 0x7f74e419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74eb4b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74e4109540 0x7f74e419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:47.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74eb4b9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f74e410f390 con 0x7f74e4101c10 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74eb4b9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f74e410f210 con 0x7f74e4102640 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74eb4b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74e410f510 con 0x7f74e4109540 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74e9255640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101c10 0x7f74e4199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74e9255640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101c10 0x7f74e4199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43254/0 (socket says 172.21.15.47:43254) 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74e9255640 1 -- 172.21.15.47:0/4240334240 learned_addr learned my addr 172.21.15.47:0/4240334240 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74e8a54640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74e4102640 0x7f74e419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.793+0000 7f74e9a56640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74e4109540 0x7f74e419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74e9255640 1 -- 172.21.15.47:0/4240334240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74e4109540 msgr2=0x7f74e419b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74e9255640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74e4109540 0x7f74e419b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74e9255640 1 -- 172.21.15.47:0/4240334240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74e4102640 msgr2=0x7f74e419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:47.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74e9255640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74e4102640 0x7f74e419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74e9255640 1 -- 172.21.15.47:0/4240334240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e419b9c0 con 0x7f74e4101c10 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74e9255640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101c10 0x7f74e4199f90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74e000d950 tx=0x7f74e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74da7fc640 1 -- 172.21.15.47:0/4240334240 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0017070 con 0x7f74e4101c10 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74da7fc640 1 -- 172.21.15.47:0/4240334240 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74e0009c30 con 0x7f74e4101c10 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e419bcb0 con 0x7f74e4101c10 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74da7fc640 1 -- 172.21.15.47:0/4240334240 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e000f620 con 0x7f74e4101c10 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.794+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e41a23b0 con 0x7f74e4101c10 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.795+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e40ff320 con 0x7f74e4101c10 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.797+0000 7f74da7fc640 1 -- 172.21.15.47:0/4240334240 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f74e0010460 con 0x7f74e4101c10 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.798+0000 7f74da7fc640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74d00b6500 0x7f74d00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.798+0000 7f74e8a54640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74d00b6500 0x7f74d00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:47.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.798+0000 7f74da7fc640 1 -- 172.21.15.47:0/4240334240 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f74e00e5190 con 0x7f74e4101c10 2024-09-21T00:50:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.799+0000 7f74e8a54640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74d00b6500 0x7f74d00b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74d4000c00 tx=0x7f74d4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:47.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.801+0000 7f74da7fc640 1 -- 172.21.15.47:0/4240334240 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74e0009de0 con 0x7f74e4101c10 2024-09-21T00:50:47.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.989+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f74e402e640 con 0x7f74e4101c10 2024-09-21T00:50:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.994+0000 7f74da7fc640 1 -- 172.21.15.47:0/4240334240 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v32)=0 v32) ==== 115+0+0 (secure 0 0 0) 0x7f74e00b1af0 con 0x7f74e4101c10 2024-09-21T00:50:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74d00b6500 msgr2=0x7f74d00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74d00b6500 0x7f74d00b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74d4000c00 tx=0x7f74d4031400 comp rx=0 tx=0).stop 2024-09-21T00:50:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101c10 msgr2=0x7f74e4199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101c10 0x7f74e4199f90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74e000d950 tx=0x7f74e000de10 comp rx=0 tx=0).stop 2024-09-21T00:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 shutdown_connections 2024-09-21T00:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74d00b6500 0x7f74d00b8a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74e4109540 0x7f74e419b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74e4102640 0x7f74e419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 --2- 172.21.15.47:0/4240334240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e4101c10 0x7f74e4199f90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 >> 172.21.15.47:0/4240334240 conn(0x7f74e40fd800 msgr2=0x7f74e410a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 shutdown_connections 2024-09-21T00:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:47.996+0000 7f74eb4b9640 1 -- 172.21.15.47:0/4240334240 wait complete. 2024-09-21T00:50:48.270 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi047') 2024-09-21T00:50:48.270 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi047') 2024-09-21T00:50:48.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:48 smithi047 ceph-mon[30960]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:48.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:48 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4240334240' entity='client.admin' 2024-09-21T00:50:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:48 smithi134 ceph-mon[34785]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:48 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4240334240' entity='client.admin' 2024-09-21T00:50:49.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:48 smithi114 ceph-mon[34309]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:49.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:48 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4240334240' entity='client.admin' 2024-09-21T00:50:49.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi047') 2024-09-21T00:50:49.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-09-21T00:50:49.163 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi047') 2024-09-21T00:50:49.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-09-21T00:50:49.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-09-21T00:50:49.164 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi047') 2024-09-21T00:50:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2799097352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 msgr2=0x7f59a0104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2799097352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 0x7f59a0104bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5990009900 tx=0x7f599002a480 comp rx=0 tx=0).stop 2024-09-21T00:50:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2799097352 shutdown_connections 2024-09-21T00:50:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2799097352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0105180 0x7f59a010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2799097352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 0x7f59a0104bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2799097352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a0103750 0x7f59a0103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2799097352 >> 172.21.15.47:0/2799097352 conn(0x7f59a00ff0c0 msgr2=0x7f59a0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2799097352 shutdown_connections 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.395+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2799097352 wait complete. 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a7a7b640 1 Processor -- start 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a7a7b640 1 -- start start 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a7a7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0103750 0x7f59a0199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a7a7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 0x7f59a019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a7a7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a0105180 0x7f59a019b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a7a7b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59a010f380 con 0x7f59a01047e0 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a7a7b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f59a010f200 con 0x7f59a0105180 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a7a7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59a010f500 con 0x7f59a0103750 2024-09-21T00:50:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a5016640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 0x7f59a019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:49.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a5016640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 0x7f59a019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43260/0 (socket says 172.21.15.47:43260) 2024-09-21T00:50:49.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a5016640 1 -- 172.21.15.47:0/2055509320 learned_addr learned my addr 172.21.15.47:0/2055509320 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:49.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a5817640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0103750 0x7f59a0199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:49.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.396+0000 7f59a6018640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a0105180 0x7f59a019b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f59a5016640 1 -- 172.21.15.47:0/2055509320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0103750 msgr2=0x7f59a0199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f59a5016640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0103750 0x7f59a0199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f59a5016640 1 -- 172.21.15.47:0/2055509320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a0105180 msgr2=0x7f59a019b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f59a5016640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a0105180 0x7f59a019b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f59a5016640 1 -- 172.21.15.47:0/2055509320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a019b9e0 con 0x7f59a01047e0 2024-09-21T00:50:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f59a5016640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 0x7f59a019a620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5990006010 tx=0x7f5990031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f5996ffd640 1 -- 172.21.15.47:0/2055509320 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599003f030 con 0x7f59a01047e0 2024-09-21T00:50:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f5996ffd640 1 -- 172.21.15.47:0/2055509320 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5990003aa0 con 0x7f59a01047e0 2024-09-21T00:50:49.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a019bc70 con 0x7f59a01047e0 2024-09-21T00:50:49.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f5996ffd640 1 -- 172.21.15.47:0/2055509320 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990035070 con 0x7f59a01047e0 2024-09-21T00:50:49.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.397+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a00755f0 con 0x7f59a01047e0 2024-09-21T00:50:49.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.398+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a010a930 con 0x7f59a01047e0 2024-09-21T00:50:49.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.400+0000 7f5996ffd640 1 -- 172.21.15.47:0/2055509320 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f5990042030 con 0x7f59a01047e0 2024-09-21T00:50:49.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.401+0000 7f5996ffd640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f598c0b6480 0x7f598c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:49.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.401+0000 7f5996ffd640 1 -- 172.21.15.47:0/2055509320 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5990106200 con 0x7f59a01047e0 2024-09-21T00:50:49.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.401+0000 7f59a5817640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f598c0b6480 0x7f598c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:49.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.402+0000 7f59a5817640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f598c0b6480 0x7f598c0b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f599c009bd0 tx=0x7f599c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.404+0000 7f5996ffd640 1 -- 172.21.15.47:0/2055509320 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59900d2b40 con 0x7f59a01047e0 2024-09-21T00:50:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.595+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f59a002e640 con 0x7f59a01047e0 2024-09-21T00:50:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.600+0000 7f5996ffd640 1 -- 172.21.15.47:0/2055509320 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v33)=0 v33) ==== 120+0+0 (secure 0 0 0) 0x7f59900d7a80 con 0x7f59a01047e0 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f598c0b6480 msgr2=0x7f598c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f598c0b6480 0x7f598c0b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f599c009bd0 tx=0x7f599c005f90 comp rx=0 tx=0).stop 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 msgr2=0x7f59a019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 0x7f59a019a620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5990006010 tx=0x7f5990031a50 comp rx=0 tx=0).stop 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 shutdown_connections 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f598c0b6480 0x7f598c0b8990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a0105180 0x7f59a019b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59a01047e0 0x7f59a019a620 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 --2- 172.21.15.47:0/2055509320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a0103750 0x7f59a0199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:49.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 >> 172.21.15.47:0/2055509320 conn(0x7f59a00ff0c0 msgr2=0x7f59a0107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:49.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 shutdown_connections 2024-09-21T00:50:49.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:49.602+0000 7f59a7a7b640 1 -- 172.21.15.47:0/2055509320 wait complete. 2024-09-21T00:50:50.218 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi047') 2024-09-21T00:50:50.218 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi047') 2024-09-21T00:50:50.218 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi047') 2024-09-21T00:50:50.218 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi047') 2024-09-21T00:50:50.219 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi047') 2024-09-21T00:50:50.219 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi047') 2024-09-21T00:50:50.219 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1256112e-77b3-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi047') 2024-09-21T00:50:50.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T00:50:50.475 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:50.905 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:50 smithi047 ceph-mon[30960]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:50.905 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:50 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2055509320' entity='client.admin' 2024-09-21T00:50:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:50 smithi114 ceph-mon[34309]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:50 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2055509320' entity='client.admin' 2024-09-21T00:50:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 -- 172.21.15.47:0/2793304535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 msgr2=0x7fd6a4103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/2793304535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 0x7fd6a4103c50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009900 tx=0x7fd69c02a480 comp rx=0 tx=0).stop 2024-09-21T00:50:50.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 -- 172.21.15.47:0/2793304535 shutdown_connections 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/2793304535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a4105210 0x7fd6a410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/2793304535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a4104870 0x7fd6a4104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/2793304535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 0x7fd6a4103c50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 -- 172.21.15.47:0/2793304535 >> 172.21.15.47:0/2793304535 conn(0x7fd6a40ff150 msgr2=0x7fd6a4101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 -- 172.21.15.47:0/2793304535 shutdown_connections 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.904+0000 7fd6ab31f640 1 -- 172.21.15.47:0/2793304535 wait complete. 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.905+0000 7fd6ab31f640 1 Processor -- start 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.905+0000 7fd6ab31f640 1 -- start start 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.905+0000 7fd6ab31f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 0x7fd6a419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.905+0000 7fd6ab31f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a4104870 0x7fd6a419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.905+0000 7fd6ab31f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a4105210 0x7fd6a419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6ab31f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a410f3b0 con 0x7fd6a41037e0 2024-09-21T00:50:50.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6ab31f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a410f230 con 0x7fd6a4104870 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6ab31f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a410f530 con 0x7fd6a4105210 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 0x7fd6a419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 0x7fd6a419a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43274/0 (socket says 172.21.15.47:43274) 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 -- 172.21.15.47:0/75508910 learned_addr learned my addr 172.21.15.47:0/75508910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a98bc640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a4105210 0x7fd6a419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a88ba640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a4104870 0x7fd6a419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 -- 172.21.15.47:0/75508910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a4105210 msgr2=0x7fd6a419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a4105210 0x7fd6a419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 -- 172.21.15.47:0/75508910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a4104870 msgr2=0x7fd6a419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a4104870 0x7fd6a419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 -- 172.21.15.47:0/75508910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a419ba50 con 0x7fd6a41037e0 2024-09-21T00:50:50.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a90bb640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 0x7fd6a419a020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd69c006010 tx=0x7fd69c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a27fc640 1 -- 172.21.15.47:0/75508910 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c03f030 con 0x7fd6a41037e0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a419bce0 con 0x7fd6a41037e0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a27fc640 1 -- 172.21.15.47:0/75508910 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd69c003cb0 con 0x7fd6a41037e0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6a27fc640 1 -- 172.21.15.47:0/75508910 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c035070 con 0x7fd6a41037e0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.906+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41a2270 con 0x7fd6a41037e0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.908+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a410a9c0 con 0x7fd6a41037e0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.909+0000 7fd6a27fc640 1 -- 172.21.15.47:0/75508910 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fd69c042030 con 0x7fd6a41037e0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.910+0000 7fd6a27fc640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd68c0b6480 0x7fd68c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.910+0000 7fd6a88ba640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd68c0b6480 0x7fd68c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.910+0000 7fd6a27fc640 1 -- 172.21.15.47:0/75508910 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd69c105d90 con 0x7fd6a41037e0 2024-09-21T00:50:50.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.910+0000 7fd6a88ba640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd68c0b6480 0x7fd68c0b8990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd698005fd0 tx=0x7fd698005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:50.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:50.914+0000 7fd6a27fc640 1 -- 172.21.15.47:0/75508910 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd69c109030 con 0x7fd6a41037e0 2024-09-21T00:50:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:50 smithi134 ceph-mon[34785]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:50 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2055509320' entity='client.admin' 2024-09-21T00:50:51.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.106+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd6a402e640 con 0x7fd6a41037e0 2024-09-21T00:50:51.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.107+0000 7fd6a27fc640 1 -- 172.21.15.47:0/75508910 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21518 (secure 0 0 0) 0x7fd69c003e60 con 0x7fd6a41037e0 2024-09-21T00:50:51.108 INFO:teuthology.orchestra.run.smithi047.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T00:50:51.108 INFO:teuthology.orchestra.run.smithi047.stdout:global dev auth_debug true 2024-09-21T00:50:51.108 INFO:teuthology.orchestra.run.smithi047.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T00:50:51.108 INFO:teuthology.orchestra.run.smithi047.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T00:50:51.108 INFO:teuthology.orchestra.run.smithi047.stdout:global basic log_to_file true 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global basic log_to_journald false 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global basic log_to_stderr false 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_allow_pool_delete true 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T00:50:51.109 INFO:teuthology.orchestra.run.smithi047.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:global dev ms_die_on_bug true 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:global dev ms_die_on_old_message true 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:global dev ms_die_on_skipped_message false 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced debug_mon 20/20 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced debug_ms 1/1 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced debug_paxos 20/20 2024-09-21T00:50:51.110 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced client_mount_timeout 30 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced debug_client 20/20 2024-09-21T00:50:51.111 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced debug_mgr 20/20 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced debug_ms 1/1 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev bdev_debug_aio true 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced bdev_enable_discard true 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced bluestore_allocator bitmap * 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T00:50:51.112 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced debug_bluefs 1/20 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced debug_bluestore 1/20 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced debug_ms 1/1 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced debug_osd 20/20 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced debug_rocksdb 4/10 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev osd_debug_op_order true 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev osd_debug_shutdown true 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T00:50:51.113 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_heartbeat_grace 60 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T00:50:51.114 INFO:teuthology.orchestra.run.smithi047.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced debug_mds 20/20 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced debug_ms 2/2 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced mds_bal_split_size 100 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds dev mds_debug_frag true 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds dev mds_debug_scatterstat true 2024-09-21T00:50:51.115 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:mds dev mds_verify_scatter true 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:client advanced client_mount_timeout 600 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:client advanced debug_client 20/20 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:client advanced debug_ms 1/1 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T00:50:51.116 INFO:teuthology.orchestra.run.smithi047.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T00:50:51.117 INFO:teuthology.orchestra.run.smithi047.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T00:50:51.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd68c0b6480 msgr2=0x7fd68c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:51.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd68c0b6480 0x7fd68c0b8990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd698005fd0 tx=0x7fd698005e20 comp rx=0 tx=0).stop 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 msgr2=0x7fd6a419a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 0x7fd6a419a020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd69c006010 tx=0x7fd69c004340 comp rx=0 tx=0).stop 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 shutdown_connections 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd68c0b6480 0x7fd68c0b8990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a4105210 0x7fd6a419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a4104870 0x7fd6a419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 --2- 172.21.15.47:0/75508910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a41037e0 0x7fd6a419a020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 >> 172.21.15.47:0/75508910 conn(0x7fd6a40ff150 msgr2=0x7fd6a4107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 shutdown_connections 2024-09-21T00:50:51.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:51.110+0000 7fd6ab31f640 1 -- 172.21.15.47:0/75508910 wait complete. 2024-09-21T00:50:51.740 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T00:50:51.740 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:50:51.740 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:50:51.757 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:50:51.757 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-21 00:49:37.267693586 +0000 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-21 00:45:01.545142141 +0000 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-21 00:45:01.545142141 +0000 2024-09-21T00:50:51.814 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-21 00:45:01.545142141 +0000 2024-09-21T00:50:51.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:50:51.876 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:51 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/75508910' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:50:51.879 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-21T00:50:51.880 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-21T00:50:51.880 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00011147 s, 4.6 MB/s 2024-09-21T00:50:51.881 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:50:51.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:51 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/75508910' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:50:51.939 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-09-21T00:50:51.995 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:50:51.995 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:51.995 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T00:50:51.995 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:51.995 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:51.995 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-21 00:49:37.307692792 +0000 2024-09-21T00:50:51.995 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-21 00:45:01.853136026 +0000 2024-09-21T00:50:51.996 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-21 00:45:01.853136026 +0000 2024-09-21T00:50:51.996 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-21 00:45:01.853136026 +0000 2024-09-21T00:50:51.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:50:52.060 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-21T00:50:52.060 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-21T00:50:52.060 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000113645 s, 4.5 MB/s 2024-09-21T00:50:52.061 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:50:52.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:51 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/75508910' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T00:50:52.119 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-09-21T00:50:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:50:52.176 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:52.176 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T00:50:52.176 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:52.176 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:52.176 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-21 00:49:37.344692058 +0000 2024-09-21T00:50:52.176 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-21 00:45:02.168129773 +0000 2024-09-21T00:50:52.177 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-21 00:45:02.168129773 +0000 2024-09-21T00:50:52.177 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-21 00:45:02.168129773 +0000 2024-09-21T00:50:52.177 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:50:52.241 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-21T00:50:52.241 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-21T00:50:52.241 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000128196 s, 4.0 MB/s 2024-09-21T00:50:52.242 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:50:52.299 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-09-21T00:50:52.355 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:50:52.355 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:52.355 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T00:50:52.356 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:52.356 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:52.356 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-21 00:49:37.378691384 +0000 2024-09-21T00:50:52.356 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-21 00:45:02.476123658 +0000 2024-09-21T00:50:52.356 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-21 00:45:02.476123658 +0000 2024-09-21T00:50:52.356 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-21 00:45:02.476123658 +0000 2024-09-21T00:50:52.356 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:50:52.419 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-21T00:50:52.420 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-21T00:50:52.420 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000111218 s, 4.6 MB/s 2024-09-21T00:50:52.421 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:50:52.478 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-21T00:50:52.478 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:50:52.498 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:50:52.498 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-09-21T00:50:52.556 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:50:52.557 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:52.557 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T00:50:52.557 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:52.557 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:52.557 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-21 00:50:25.843113709 +0000 2024-09-21T00:50:52.557 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-21 00:45:16.466993763 +0000 2024-09-21T00:50:52.557 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-21 00:45:16.466993763 +0000 2024-09-21T00:50:52.558 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-21 00:45:16.466993763 +0000 2024-09-21T00:50:52.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:50:52.627 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-21T00:50:52.627 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-21T00:50:52.627 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000302768 s, 1.7 MB/s 2024-09-21T00:50:52.628 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:50:52.687 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-09-21T00:50:52.744 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:50:52.745 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:52.745 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T00:50:52.745 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:52.745 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:52.745 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-21 00:50:25.843113709 +0000 2024-09-21T00:50:52.745 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-21 00:45:16.789986375 +0000 2024-09-21T00:50:52.745 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-21 00:45:16.790986352 +0000 2024-09-21T00:50:52.745 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-21 00:45:16.789986375 +0000 2024-09-21T00:50:52.745 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:50:52.810 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-21T00:50:52.810 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-21T00:50:52.810 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000202977 s, 2.5 MB/s 2024-09-21T00:50:52.811 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:50:52.869 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-09-21T00:50:52.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:52 smithi114 ceph-mon[34309]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-21 00:50:25.844113687 +0000 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-21 00:45:17.101979239 +0000 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-21 00:45:17.101979239 +0000 2024-09-21T00:50:52.925 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-21 00:45:17.101979239 +0000 2024-09-21T00:50:52.925 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:50:52.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:52 smithi047 ceph-mon[30960]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:52.989 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-21T00:50:52.989 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-21T00:50:52.989 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000222441 s, 2.3 MB/s 2024-09-21T00:50:52.990 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:50:53.047 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-09-21T00:50:53.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:52 smithi134 ceph-mon[34785]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:53.103 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:50:53.103 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:53.103 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-21T00:50:53.104 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:53.104 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:53.104 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-21 00:50:25.844113687 +0000 2024-09-21T00:50:53.104 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-21 00:45:17.418971988 +0000 2024-09-21T00:50:53.104 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-21 00:45:17.418971988 +0000 2024-09-21T00:50:53.104 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-21 00:45:17.418971988 +0000 2024-09-21T00:50:53.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:50:53.167 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-21T00:50:53.167 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-21T00:50:53.167 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000231659 s, 2.2 MB/s 2024-09-21T00:50:53.169 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:50:53.225 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T00:50:53.225 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T00:50:53.245 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T00:50:53.246 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-21T00:50:53.304 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T00:50:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:53.305 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T00:50:53.305 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:53.305 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:53.305 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 00:50:23.474353958 +0000 2024-09-21T00:50:53.305 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 00:45:16.056057041 +0000 2024-09-21T00:50:53.305 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 00:45:16.056057041 +0000 2024-09-21T00:50:53.305 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-21 00:45:16.056057041 +0000 2024-09-21T00:50:53.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T00:50:53.375 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T00:50:53.375 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T00:50:53.375 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000291845 s, 1.8 MB/s 2024-09-21T00:50:53.376 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T00:50:53.435 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-21T00:50:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T00:50:53.491 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:53.491 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T00:50:53.491 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:53.492 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:53.492 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 00:50:23.474353958 +0000 2024-09-21T00:50:53.492 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 00:45:16.383049025 +0000 2024-09-21T00:50:53.492 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 00:45:16.383049025 +0000 2024-09-21T00:50:53.492 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-21 00:45:16.383049025 +0000 2024-09-21T00:50:53.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T00:50:53.557 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T00:50:53.557 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T00:50:53.557 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000198498 s, 2.6 MB/s 2024-09-21T00:50:53.559 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T00:50:53.618 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-21T00:50:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T00:50:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:53.674 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T00:50:53.674 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:53.674 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:53.674 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 00:50:23.475353934 +0000 2024-09-21T00:50:53.674 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 00:45:16.732040470 +0000 2024-09-21T00:50:53.675 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 00:45:16.732040470 +0000 2024-09-21T00:50:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-21 00:45:16.732040470 +0000 2024-09-21T00:50:53.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T00:50:53.738 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T00:50:53.738 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T00:50:53.738 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000230317 s, 2.2 MB/s 2024-09-21T00:50:53.740 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T00:50:53.796 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-21T00:50:53.852 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T00:50:53.852 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T00:50:53.852 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T00:50:53.852 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:50:53.852 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T00:50:53.852 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 00:50:23.475353934 +0000 2024-09-21T00:50:53.852 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 00:45:17.056032527 +0000 2024-09-21T00:50:53.853 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 00:45:17.056032527 +0000 2024-09-21T00:50:53.853 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-21 00:45:17.056032527 +0000 2024-09-21T00:50:53.853 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T00:50:53.916 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T00:50:53.916 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T00:50:53.916 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00023627 s, 2.2 MB/s 2024-09-21T00:50:53.918 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T00:50:53.974 INFO:tasks.cephadm:Deploying osd.0 on smithi047 with /dev/vg_nvme/lv_4... 2024-09-21T00:50:53.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:50:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:54.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:54 smithi114 ceph-mon[34309]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:54.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:54 smithi047 ceph-mon[30960]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:55.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:54 smithi134 ceph-mon[34785]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:56.667 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:50:56.693 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:56 smithi047 ceph-mon[30960]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:56.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-09-21T00:50:56.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:56 smithi114 ceph-mon[34309]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:56.948 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:50:57.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:56 smithi134 ceph-mon[34785]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.420+0000 7fce00409640 1 -- 172.21.15.47:0/2963199637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf81036f0 msgr2=0x7fcdf8103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.420+0000 7fce00409640 1 --2- 172.21.15.47:0/2963199637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf81036f0 0x7fcdf8103b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009900 tx=0x7fcde802a480 comp rx=0 tx=0).stop 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.420+0000 7fce00409640 1 -- 172.21.15.47:0/2963199637 shutdown_connections 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.420+0000 7fce00409640 1 --2- 172.21.15.47:0/2963199637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf8104090 0x7fcdf810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.420+0000 7fce00409640 1 --2- 172.21.15.47:0/2963199637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf81036f0 0x7fcdf8103b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.420+0000 7fce00409640 1 --2- 172.21.15.47:0/2963199637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf8102660 0x7fcdf8102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.421+0000 7fce00409640 1 -- 172.21.15.47:0/2963199637 >> 172.21.15.47:0/2963199637 conn(0x7fcdf80fdfd0 msgr2=0x7fcdf8100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.421+0000 7fce00409640 1 -- 172.21.15.47:0/2963199637 shutdown_connections 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.421+0000 7fce00409640 1 -- 172.21.15.47:0/2963199637 wait complete. 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.421+0000 7fce00409640 1 Processor -- start 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.421+0000 7fce00409640 1 -- start start 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fce00409640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf8102660 0x7fcdf806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fce00409640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf81036f0 0x7fcdf819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fce00409640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf8104090 0x7fcdf81a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fce00409640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf810e300 con 0x7fcdf8102660 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fce00409640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf810e180 con 0x7fcdf81036f0 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fce00409640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf810e480 con 0x7fcdf8104090 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf8102660 0x7fcdf806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf8102660 0x7fcdf806c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40440/0 (socket says 172.21.15.47:40440) 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 -- 172.21.15.47:0/662776229 learned_addr learned my addr 172.21.15.47:0/662776229 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe9a6640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf8104090 0x7fcdf81a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfd9a4640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf81036f0 0x7fcdf819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 -- 172.21.15.47:0/662776229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf8104090 msgr2=0x7fcdf81a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf8104090 0x7fcdf81a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 -- 172.21.15.47:0/662776229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf81036f0 msgr2=0x7fcdf819ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:50:57.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf81036f0 0x7fcdf819ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 -- 172.21.15.47:0/662776229 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf81a1af0 con 0x7fcdf8102660 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfd9a4640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf81036f0 0x7fcdf819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe9a6640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf8104090 0x7fcdf81a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdfe1a5640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf8102660 0x7fcdf806c3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400b4a0 tx=0x7fcdf400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.422+0000 7fcdef7fe640 1 -- 172.21.15.47:0/662776229 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4014070 con 0x7fcdf8102660 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.423+0000 7fcdef7fe640 1 -- 172.21.15.47:0/662776229 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdf4010ac0 con 0x7fcdf8102660 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.423+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf81a1de0 con 0x7fcdf8102660 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.423+0000 7fcdef7fe640 1 -- 172.21.15.47:0/662776229 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4017c30 con 0x7fcdf8102660 2024-09-21T00:50:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.423+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf81a22c0 con 0x7fcdf8102660 2024-09-21T00:50:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.424+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf8109840 con 0x7fcdf8102660 2024-09-21T00:50:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.425+0000 7fcdef7fe640 1 -- 172.21.15.47:0/662776229 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fcdf4017070 con 0x7fcdf8102660 2024-09-21T00:50:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.426+0000 7fcdef7fe640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fcde40b6480 0x7fcde40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:50:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.426+0000 7fcdfd9a4640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fcde40b6480 0x7fcde40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:50:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.426+0000 7fcdef7fe640 1 -- 172.21.15.47:0/662776229 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcdf40e4cb0 con 0x7fcdf8102660 2024-09-21T00:50:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.426+0000 7fcdfd9a4640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fcde40b6480 0x7fcde40b8990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcde8031440 tx=0x7fcde80314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:50:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.429+0000 7fcdef7fe640 1 -- 172.21.15.47:0/662776229 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdf40ad210 con 0x7fcdf8102660 2024-09-21T00:50:57.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:50:57.626+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcdf8063800 con 0x7fcde40b6480 2024-09-21T00:50:58.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:58 smithi114 ceph-mon[34309]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:58.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:58 smithi114 ceph-mon[34309]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:58.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:58.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:58.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:50:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:58.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:58 smithi047 ceph-mon[30960]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:58 smithi047 ceph-mon[30960]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:50:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:50:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:58 smithi134 ceph-mon[34785]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:50:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:58 smithi134 ceph-mon[34785]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:50:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:50:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:50:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:50:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:00.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:00 smithi114 ceph-mon[34309]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:00.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:00 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/58864278' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de86c79d-f53b-4eab-800e-4d753d91edcb"} : dispatch 2024-09-21T00:51:00.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:00 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/58864278' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de86c79d-f53b-4eab-800e-4d753d91edcb"}]': finished 2024-09-21T00:51:00.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:00 smithi114 ceph-mon[34309]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:51:00.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:00 smithi047 ceph-mon[30960]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:00 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/58864278' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de86c79d-f53b-4eab-800e-4d753d91edcb"} : dispatch 2024-09-21T00:51:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:00 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/58864278' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de86c79d-f53b-4eab-800e-4d753d91edcb"}]': finished 2024-09-21T00:51:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:00 smithi047 ceph-mon[30960]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:51:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:00 smithi134 ceph-mon[34785]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:00 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/58864278' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de86c79d-f53b-4eab-800e-4d753d91edcb"} : dispatch 2024-09-21T00:51:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:00 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/58864278' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de86c79d-f53b-4eab-800e-4d753d91edcb"}]': finished 2024-09-21T00:51:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:00 smithi134 ceph-mon[34785]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T00:51:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:01.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:01 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1315216348' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:01.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:01 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1315216348' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:02.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:01 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1315216348' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:02.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:02 smithi114 ceph-mon[34309]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:02.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:02 smithi047 ceph-mon[30960]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:03.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:02 smithi134 ceph-mon[34785]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:04.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:04 smithi047 ceph-mon[30960]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:04.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:04 smithi114 ceph-mon[34309]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:05.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:04 smithi134 ceph-mon[34785]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:06.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:06 smithi047 ceph-mon[30960]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:06.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:06 smithi114 ceph-mon[34309]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:06 smithi134 ceph-mon[34785]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:08.763 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:08 smithi047 ceph-mon[30960]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:08.764 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:08 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:51:08.764 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:08 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:08.896 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:08 smithi134 ceph-mon[34785]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:08.896 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:08 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:51:08.897 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:08 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:08.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:08 smithi114 ceph-mon[34309]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:08.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:08 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T00:51:08.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:08 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:09.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:09 smithi047 ceph-mon[30960]: Deploying daemon osd.0 on smithi047 2024-09-21T00:51:09.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:09 smithi114 ceph-mon[34309]: Deploying daemon osd.0 on smithi047 2024-09-21T00:51:10.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:09 smithi134 ceph-mon[34785]: Deploying daemon osd.0 on smithi047 2024-09-21T00:51:10.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:10 smithi114 ceph-mon[34309]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:10.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:10 smithi047 ceph-mon[30960]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:10 smithi134 ceph-mon[34785]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:12.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:12 smithi114 ceph-mon[34309]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:12.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:12 smithi047 ceph-mon[30960]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:12 smithi134 ceph-mon[34785]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:14.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:14 smithi114 ceph-mon[34309]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:14.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:14 smithi047 ceph-mon[30960]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:15.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:14 smithi134 ceph-mon[34785]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:15.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:15.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:15.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:15.931 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:15.931 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:15.931 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:17.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:16 smithi047 ceph-mon[30960]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:16 smithi134 ceph-mon[34785]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:16 smithi114 ceph-mon[34309]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:18.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:18.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:18.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:18 smithi114 ceph-mon[34309]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:18.423 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.423 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.423 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:18.423 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:18.423 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.423 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:18 smithi047 ceph-mon[30960]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:18.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:18.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:18.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:18.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:18 smithi134 ceph-mon[34785]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:19.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.090+0000 7fcdef7fe640 1 -- 172.21.15.47:0/662776229 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcdf8063800 con 0x7fcde40b6480 2024-09-21T00:51:19.092 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 0 on host 'smithi047' 2024-09-21T00:51:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fcde40b6480 msgr2=0x7fcde40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fcde40b6480 0x7fcde40b8990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcde8031440 tx=0x7fcde80314a0 comp rx=0 tx=0).stop 2024-09-21T00:51:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf8102660 msgr2=0x7fcdf806c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf8102660 0x7fcdf806c3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400b4a0 tx=0x7fcdf400b960 comp rx=0 tx=0).stop 2024-09-21T00:51:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 shutdown_connections 2024-09-21T00:51:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fcde40b6480 0x7fcde40b8990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdf8104090 0x7fcdf81a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf81036f0 0x7fcdf819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 --2- 172.21.15.47:0/662776229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdf8102660 0x7fcdf806c3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 >> 172.21.15.47:0/662776229 conn(0x7fcdf80fdfd0 msgr2=0x7fcdf8106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:19.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.093+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 shutdown_connections 2024-09-21T00:51:19.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:51:19.094+0000 7fce00409640 1 -- 172.21.15.47:0/662776229 wait complete. 2024-09-21T00:51:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:19 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:19 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:19 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:19.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:19 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:19.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:19 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:19.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:19 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:19.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:19 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:19.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:19 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:19.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:19 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:19.771 DEBUG:teuthology.orchestra.run.smithi047:osd.0> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T00:51:19.774 INFO:tasks.cephadm:Deploying osd.1 on smithi114 with /dev/vg_nvme/lv_4... 2024-09-21T00:51:19.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:51:20.027 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:51:20.178 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:20 smithi047 ceph-mon[30960]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:20.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:20 smithi114 ceph-mon[34309]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:20 smithi134 ceph-mon[34785]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:21.195 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:21 smithi047 ceph-mon[30960]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:51:21.195 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:51:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0[44322]: 2024-09-21T00:51:20.906+0000 7f8666407640 -1 osd.0 0 log_to_monitors true 2024-09-21T00:51:21.247 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:21 smithi114 ceph-mon[34309]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:51:21.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:21 smithi134 ceph-mon[34785]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T00:51:22.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:22 smithi047 ceph-mon[30960]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:51:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:22 smithi047 ceph-mon[30960]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:51:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:22 smithi047 ceph-mon[30960]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:51:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:22 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:22 smithi047 ceph-mon[30960]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:51:22.368 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi114:vg_nvme/lv_4 2024-09-21T00:51:22.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:22 smithi134 ceph-mon[34785]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:51:22.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:22 smithi134 ceph-mon[34785]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:51:22.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:22 smithi134 ceph-mon[34785]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:51:22.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:22 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:22.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:22 smithi134 ceph-mon[34785]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:22.639 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:51:22.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:22 smithi114 ceph-mon[34309]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T00:51:22.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:22 smithi114 ceph-mon[34309]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T00:51:22.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:22 smithi114 ceph-mon[34309]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:51:22.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:22 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:22.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:22 smithi114 ceph-mon[34309]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:23.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.096+0000 7f3e5681c640 1 -- 172.21.15.114:0/242608846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 msgr2=0x7f3e50102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.096+0000 7f3e5681c640 1 --2- 172.21.15.114:0/242608846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 0x7f3e50102ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009900 tx=0x7f3e4002a480 comp rx=0 tx=0).stop 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.096+0000 7f3e5681c640 1 -- 172.21.15.114:0/242608846 shutdown_connections 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.096+0000 7f3e5681c640 1 --2- 172.21.15.114:0/242608846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e501040a0 0x7f3e5010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.096+0000 7f3e5681c640 1 --2- 172.21.15.114:0/242608846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e50103700 0x7f3e50103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.096+0000 7f3e5681c640 1 --2- 172.21.15.114:0/242608846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 0x7f3e50102ae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.096+0000 7f3e5681c640 1 -- 172.21.15.114:0/242608846 >> 172.21.15.114:0/242608846 conn(0x7f3e500fe000 msgr2=0x7f3e50100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.097+0000 7f3e5681c640 1 -- 172.21.15.114:0/242608846 shutdown_connections 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.097+0000 7f3e5681c640 1 -- 172.21.15.114:0/242608846 wait complete. 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.097+0000 7f3e5681c640 1 Processor -- start 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.097+0000 7f3e5681c640 1 -- start start 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e5681c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 0x7f3e5006c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e5681c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e50103700 0x7f3e5019ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e5681c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e501040a0 0x7f3e501a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e5681c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e2e0 con 0x7f3e501040a0 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e5681c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e160 con 0x7f3e50102670 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e5681c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e460 con 0x7f3e50103700 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 0x7f3e5006c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 0x7f3e5006c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50218/0 (socket says 172.21.15.114:50218) 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 -- 172.21.15.114:0/3572695196 learned_addr learned my addr 172.21.15.114:0/3572695196 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4f7fe640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e50103700 0x7f3e5019ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e54db9640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e501040a0 0x7f3e501a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 -- 172.21.15.114:0/3572695196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e50103700 msgr2=0x7f3e5019ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e50103700 0x7f3e5019ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 -- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e501040a0 msgr2=0x7f3e501a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e501040a0 0x7f3e501a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 -- 172.21.15.114:0/3572695196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e501a1980 con 0x7f3e50102670 2024-09-21T00:51:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4ffff640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 0x7f3e5006c420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e4002aa70 tx=0x7f3e40003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.098+0000 7f3e4d7fa640 1 -- 172.21.15.114:0/3572695196 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4003f070 con 0x7f3e50102670 2024-09-21T00:51:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.099+0000 7f3e4d7fa640 1 -- 172.21.15.114:0/3572695196 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e40003e70 con 0x7f3e50102670 2024-09-21T00:51:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.099+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e501a1c10 con 0x7f3e50102670 2024-09-21T00:51:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.099+0000 7f3e4d7fa640 1 -- 172.21.15.114:0/3572695196 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40035030 con 0x7f3e50102670 2024-09-21T00:51:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.099+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e501a20f0 con 0x7f3e50102670 2024-09-21T00:51:23.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.100+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e50109850 con 0x7f3e50102670 2024-09-21T00:51:23.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.101+0000 7f3e4d7fa640 1 -- 172.21.15.114:0/3572695196 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f3e40042070 con 0x7f3e50102670 2024-09-21T00:51:23.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.102+0000 7f3e4d7fa640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e380b6480 0x7f3e380b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:23.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.102+0000 7f3e4d7fa640 1 -- 172.21.15.114:0/3572695196 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f3e401066d0 con 0x7f3e50102670 2024-09-21T00:51:23.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.102+0000 7f3e4f7fe640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e380b6480 0x7f3e380b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:23.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.103+0000 7f3e4f7fe640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e380b6480 0x7f3e380b8990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e44005e10 tx=0x7f3e44005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:23.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.105+0000 7f3e4d7fa640 1 -- 172.21.15.114:0/3572695196 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e4003be20 con 0x7f3e50102670 2024-09-21T00:51:23.171 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:51:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0[44322]: 2024-09-21T00:51:22.884+0000 7f8662389640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T00:51:23.171 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:51:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0[44322]: 2024-09-21T00:51:22.888+0000 7f865a17f640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:51:23.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:23.296+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3e50063800 con 0x7f3e380b6480 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi047 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi047 to 17092M 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.298 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:23.299 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:23.299 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.299 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:23 smithi114 ceph-mon[34309]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi047 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi047 to 17092M 2024-09-21T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:23 smithi047 ceph-mon[30960]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' 2024-09-21T00:51:23.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:51:23.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T00:51:23.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:23.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi047 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi047 to 17092M 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:23.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:23 smithi134 ceph-mon[34785]: from='osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334]' entity='osd.0' 2024-09-21T00:51:24.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:51:24.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:51:24.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:24.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:24.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:24.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:24.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:24.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:24.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] boot 2024-09-21T00:51:24.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:51:24.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:51:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:51:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] boot 2024-09-21T00:51:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:51:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:24.609 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:51:24.610 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:51:24.610 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:24.610 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T00:51:24.610 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:24.610 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:24.610 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:24.610 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:24.610 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: osd.0 [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] boot 2024-09-21T00:51:24.611 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T00:51:24.611 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T00:51:26.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:26 smithi114 ceph-mon[34309]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:51:26.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:26 smithi114 ceph-mon[34309]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:26.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:26 smithi114 ceph-mon[34309]: from='client.? 172.21.15.114:0/3578245509' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"} : dispatch 2024-09-21T00:51:26.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:26 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"} : dispatch 2024-09-21T00:51:26.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:26 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"}]': finished 2024-09-21T00:51:26.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:26 smithi114 ceph-mon[34309]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:51:26.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:26.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:26 smithi114 ceph-mon[34309]: from='client.? 172.21.15.114:0/2656850520' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:26.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:26 smithi047 ceph-mon[30960]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:51:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:26 smithi047 ceph-mon[30960]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:26 smithi047 ceph-mon[30960]: from='client.? 172.21.15.114:0/3578245509' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"} : dispatch 2024-09-21T00:51:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:26 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"} : dispatch 2024-09-21T00:51:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:26 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"}]': finished 2024-09-21T00:51:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:26 smithi047 ceph-mon[30960]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:51:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:26.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:26 smithi047 ceph-mon[30960]: from='client.? 172.21.15.114:0/2656850520' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:26 smithi134 ceph-mon[34785]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T00:51:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:26 smithi134 ceph-mon[34785]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:26 smithi134 ceph-mon[34785]: from='client.? 172.21.15.114:0/3578245509' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"} : dispatch 2024-09-21T00:51:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:26 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"} : dispatch 2024-09-21T00:51:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:26 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb0a490d-37e6-4813-8581-97797d58186e"}]': finished 2024-09-21T00:51:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:26 smithi134 ceph-mon[34785]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T00:51:26.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:26.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:26 smithi134 ceph-mon[34785]: from='client.? 172.21.15.114:0/2656850520' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:28.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:28 smithi047 ceph-mon[30960]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:28.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:28 smithi134 ceph-mon[34785]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:28.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:28 smithi114 ceph-mon[34309]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:30.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:30 smithi047 ceph-mon[30960]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:30.486 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:30 smithi114 ceph-mon[34309]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:30.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:30 smithi134 ceph-mon[34785]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:32.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:32 smithi114 ceph-mon[34309]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:32.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:32 smithi047 ceph-mon[30960]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:32.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:32 smithi134 ceph-mon[34785]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:34.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:34 smithi047 ceph-mon[30960]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:34.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:51:34.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:34.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:34 smithi047 ceph-mon[30960]: Deploying daemon osd.1 on smithi114 2024-09-21T00:51:34.499 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:34 smithi114 ceph-mon[34309]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:34.499 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:51:34.499 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:34.500 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:34 smithi114 ceph-mon[34309]: Deploying daemon osd.1 on smithi114 2024-09-21T00:51:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:34 smithi134 ceph-mon[34785]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T00:51:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:34 smithi134 ceph-mon[34785]: Deploying daemon osd.1 on smithi114 2024-09-21T00:51:36.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:36 smithi047 ceph-mon[30960]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:36.583 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:36 smithi114 ceph-mon[34309]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:36.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:36 smithi134 ceph-mon[34785]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:38.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:38 smithi047 ceph-mon[30960]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:38.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:38 smithi134 ceph-mon[34785]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:38.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:38 smithi114 ceph-mon[34309]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:40.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:40 smithi114 ceph-mon[34309]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:40.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:40 smithi047 ceph-mon[30960]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:40.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:40 smithi134 ceph-mon[34785]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:41.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:41.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:41.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:41.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:41.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:41.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:41.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:41.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:41.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:42 smithi114 ceph-mon[34309]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:42 smithi047 ceph-mon[30960]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:42 smithi134 ceph-mon[34785]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:44.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:44 smithi114 ceph-mon[34309]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:44.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:44 smithi047 ceph-mon[30960]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:44.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.704+0000 7f3e4d7fa640 1 -- 172.21.15.114:0/3572695196 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3e50063800 con 0x7f3e380b6480 2024-09-21T00:51:44.706 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 1 on host 'smithi114' 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e380b6480 msgr2=0x7f3e380b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e380b6480 0x7f3e380b8990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e44005e10 tx=0x7f3e44005da0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 msgr2=0x7f3e5006c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 0x7f3e5006c420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e4002aa70 tx=0x7f3e40003c80 comp rx=0 tx=0).stop 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 shutdown_connections 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e380b6480 0x7f3e380b8990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e501040a0 0x7f3e501a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e50103700 0x7f3e5019ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 --2- 172.21.15.114:0/3572695196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e50102670 0x7f3e5006c420 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 >> 172.21.15.114:0/3572695196 conn(0x7f3e500fe000 msgr2=0x7f3e50106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 shutdown_connections 2024-09-21T00:51:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:51:44.707+0000 7f3e5681c640 1 -- 172.21.15.114:0/3572695196 wait complete. 2024-09-21T00:51:44.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:44 smithi134 ceph-mon[34785]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:45.376 DEBUG:teuthology.orchestra.run.smithi114:osd.1> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T00:51:45.552 INFO:tasks.cephadm:Deploying osd.2 on smithi134 with /dev/vg_nvme/lv_4... 2024-09-21T00:51:45.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T00:51:45.612 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:45.612 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:45.612 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:45.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:45.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:45.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:45.807 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:51:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:51:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:46.702 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:51:46 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1[38249]: 2024-09-21T00:51:46.668+0000 7f214268b640 -1 osd.1 0 log_to_monitors true 2024-09-21T00:51:46.985 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:46 smithi134 ceph-mon[34785]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:46.986 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:46 smithi134 ceph-mon[34785]: from='osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:51:46.986 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:46 smithi134 ceph-mon[34785]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:51:47.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:46 smithi114 ceph-mon[34309]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:47.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:46 smithi114 ceph-mon[34309]: from='osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:51:47.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:46 smithi114 ceph-mon[34309]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:51:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:46 smithi047 ceph-mon[30960]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:46 smithi047 ceph-mon[30960]: from='osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:51:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:46 smithi047 ceph-mon[30960]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T00:51:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:47 smithi134 ceph-mon[34785]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:51:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:47 smithi134 ceph-mon[34785]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:51:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:47 smithi134 ceph-mon[34785]: from='osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:51:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:47 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:47 smithi134 ceph-mon[34785]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:51:47.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:47 smithi134 ceph-mon[34785]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:51:47.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:47 smithi134 ceph-mon[34785]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:51:47.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:47 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:48.061 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1[38249]: 2024-09-21T00:51:47.711+0000 7f213e60d640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T00:51:48.061 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1[38249]: 2024-09-21T00:51:47.717+0000 7f213a40b640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:51:48.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-mon[34309]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:51:48.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-mon[34309]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:51:48.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-mon[34309]: from='osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:51:48.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:48.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-mon[34309]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:51:48.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-mon[34309]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:51:48.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-mon[34309]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:51:48.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:47 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:51:48.161 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-09-21T00:51:48.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:47 smithi047 ceph-mon[30960]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T00:51:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:47 smithi047 ceph-mon[30960]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T00:51:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:47 smithi047 ceph-mon[30960]: from='osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:51:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:47 smithi047 ceph-mon[30960]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:51:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:47 smithi047 ceph-mon[30960]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:51:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:47 smithi047 ceph-mon[30960]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T00:51:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:48.407 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:51:48.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 -- 172.21.15.134:0/1719435005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 msgr2=0x7f7afc102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:48.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 --2- 172.21.15.134:0/1719435005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 0x7f7afc102ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009900 tx=0x7f7aec02a480 comp rx=0 tx=0).stop 2024-09-21T00:51:48.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 -- 172.21.15.134:0/1719435005 shutdown_connections 2024-09-21T00:51:48.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 --2- 172.21.15.134:0/1719435005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7afc104070 0x7f7afc10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 --2- 172.21.15.134:0/1719435005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7afc1036d0 0x7f7afc103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 --2- 172.21.15.134:0/1719435005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 0x7f7afc102ab0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 -- 172.21.15.134:0/1719435005 >> 172.21.15.134:0/1719435005 conn(0x7f7afc0fdfb0 msgr2=0x7f7afc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 -- 172.21.15.134:0/1719435005 shutdown_connections 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.854+0000 7f7b00970640 1 -- 172.21.15.134:0/1719435005 wait complete. 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7b00970640 1 Processor -- start 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7b00970640 1 -- start start 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7b00970640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 0x7f7afc199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7b00970640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7afc1036d0 0x7f7afc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7b00970640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7afc104070 0x7f7afc19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7b00970640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc10e260 con 0x7f7afc104070 2024-09-21T00:51:48.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7b00970640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc10e0e0 con 0x7f7afc1036d0 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7b00970640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc10e3e0 con 0x7f7afc102640 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7afa59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 0x7f7afc199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7afa59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 0x7f7afc199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43250/0 (socket says 172.21.15.134:43250) 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.855+0000 7f7afa59c640 1 -- 172.21.15.134:0/1363190464 learned_addr learned my addr 172.21.15.134:0/1363190464 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7af9d9b640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7afc1036d0 0x7f7afc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7afad9d640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7afc104070 0x7f7afc19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7afa59c640 1 -- 172.21.15.134:0/1363190464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7afc1036d0 msgr2=0x7f7afc19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7afa59c640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7afc1036d0 0x7f7afc19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7afa59c640 1 -- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7afc104070 msgr2=0x7f7afc19b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7afa59c640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7afc104070 0x7f7afc19b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7afa59c640 1 -- 172.21.15.134:0/1363190464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc19b950 con 0x7f7afc102640 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7afa59c640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 0x7f7afc199fb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006010 tx=0x7f7aec004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:48.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7aeb7fe640 1 -- 172.21.15.134:0/1363190464 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec03f030 con 0x7f7afc102640 2024-09-21T00:51:48.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc19bbe0 con 0x7f7afc102640 2024-09-21T00:51:48.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7aeb7fe640 1 -- 172.21.15.134:0/1363190464 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aec003cb0 con 0x7f7afc102640 2024-09-21T00:51:48.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7aeb7fe640 1 -- 172.21.15.134:0/1363190464 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec035070 con 0x7f7afc102640 2024-09-21T00:51:48.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.856+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc1a2200 con 0x7f7afc102640 2024-09-21T00:51:48.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.857+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc1a2430 con 0x7f7afc102640 2024-09-21T00:51:48.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.859+0000 7f7aeb7fe640 1 -- 172.21.15.134:0/1363190464 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f7aec042030 con 0x7f7afc102640 2024-09-21T00:51:48.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.860+0000 7f7aeb7fe640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ae40b6500 0x7f7ae40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:51:48.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.860+0000 7f7aeb7fe640 1 -- 172.21.15.134:0/1363190464 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7f7aec1066c0 con 0x7f7afc102640 2024-09-21T00:51:48.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.860+0000 7f7af9d9b640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ae40b6500 0x7f7ae40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:51:48.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.861+0000 7f7af9d9b640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ae40b6500 0x7f7ae40b8a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7af000bbe0 tx=0x7f7af000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:51:48.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:48.863+0000 7f7aeb7fe640 1 -- 172.21.15.134:0/1363190464 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7aec003e60 con 0x7f7afc102640 2024-09-21T00:51:49.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:51:49.054+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7afc0ffff0 con 0x7f7ae40b6500 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.056 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:49.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:49.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:51:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:49.990 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi114 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi114 to 17088M 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] boot 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:49.991 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:49 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:50.057 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:51:50.057 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:51:50.057 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi114 2024-09-21T00:51:50.057 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi114 to 17088M 2024-09-21T00:51:50.057 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] boot 2024-09-21T00:51:50.058 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:51:50.058 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:50.058 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:50.058 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:50.058 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:49 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi114 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi114 to 17088M 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: osd.1 [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] boot 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:51:50.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:51:50.930 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:50 smithi134 ceph-mon[34785]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:50.930 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:50 smithi134 ceph-mon[34785]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:50.930 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:50 smithi134 ceph-mon[34785]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T00:51:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:50 smithi114 ceph-mon[34309]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:50 smithi114 ceph-mon[34309]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:50 smithi114 ceph-mon[34309]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T00:51:51.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:50 smithi047 ceph-mon[30960]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:51:51.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:50 smithi047 ceph-mon[30960]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T00:51:51.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:50 smithi047 ceph-mon[30960]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T00:51:51.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:51 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/4062618889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"} : dispatch 2024-09-21T00:51:51.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:51 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"} : dispatch 2024-09-21T00:51:51.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:51 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"}]': finished 2024-09-21T00:51:51.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:51 smithi134 ceph-mon[34785]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:51:51.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:51:52.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:51 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/4062618889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"} : dispatch 2024-09-21T00:51:52.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:51 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"} : dispatch 2024-09-21T00:51:52.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:51 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"}]': finished 2024-09-21T00:51:52.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:51 smithi114 ceph-mon[34309]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:51:52.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:51:52.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:51 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/4062618889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"} : dispatch 2024-09-21T00:51:52.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:51 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"} : dispatch 2024-09-21T00:51:52.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:51 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b64b789-55fa-4e4e-bb5d-d853fd5f466c"}]': finished 2024-09-21T00:51:52.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:51 smithi047 ceph-mon[30960]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T00:51:52.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:51:53.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:52 smithi134 ceph-mon[34785]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:53.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:52 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/4081957585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:53.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:52 smithi114 ceph-mon[34309]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:53.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:52 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/4081957585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:53.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:52 smithi047 ceph-mon[30960]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:53.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:52 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/4081957585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:51:55.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:54 smithi134 ceph-mon[34785]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:55.162 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:54 smithi114 ceph-mon[34309]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:55.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:54 smithi047 ceph-mon[30960]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:57.024 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:56 smithi134 ceph-mon[34785]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:56 smithi114 ceph-mon[34309]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:57.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:56 smithi047 ceph-mon[30960]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:59.063 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:58 smithi134 ceph-mon[34785]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:59.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:58 smithi114 ceph-mon[34309]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:51:59.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:58 smithi047 ceph-mon[30960]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:00.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:52:00.014 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:51:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:00.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:52:00.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:51:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:00.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T00:52:00.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:51:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:01.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:00 smithi134 ceph-mon[34785]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:01.031 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:00 smithi134 ceph-mon[34785]: Deploying daemon osd.2 on smithi134 2024-09-21T00:52:01.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:00 smithi114 ceph-mon[34309]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:01.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:00 smithi114 ceph-mon[34309]: Deploying daemon osd.2 on smithi134 2024-09-21T00:52:01.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:00 smithi047 ceph-mon[30960]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:01.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:00 smithi047 ceph-mon[30960]: Deploying daemon osd.2 on smithi134 2024-09-21T00:52:02.976 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:02 smithi134 ceph-mon[34785]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:03.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:02 smithi114 ceph-mon[34309]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:03.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:02 smithi047 ceph-mon[30960]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:04.893 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:04 smithi134 ceph-mon[34785]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:05.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:04 smithi114 ceph-mon[34309]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:05.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:04 smithi047 ceph-mon[30960]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:06.829 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:06 smithi134 ceph-mon[34785]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:06.829 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:06.829 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:06.829 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:07.026 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:06 smithi047 ceph-mon[30960]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:07.026 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:07.026 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:07.026 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:06 smithi114 ceph-mon[34309]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:07.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:08 smithi134 ceph-mon[34785]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:09.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:08 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:08 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:08 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:09.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:08 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:09.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:08 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:08 smithi114 ceph-mon[34309]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:09.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:08 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:08 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:08 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:09.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:08 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:09.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:08 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:08 smithi047 ceph-mon[30960]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:08 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:08 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:08 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:08 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:08 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:10.259 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 2 on host 'smithi134' 2024-09-21T00:52:10.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.258+0000 7f7aeb7fe640 1 -- 172.21.15.134:0/1363190464 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7afc0ffff0 con 0x7f7ae40b6500 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.260+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ae40b6500 msgr2=0x7f7ae40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.260+0000 7f7b00970640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ae40b6500 0x7f7ae40b8a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7af000bbe0 tx=0x7f7af000b390 comp rx=0 tx=0).stop 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 msgr2=0x7f7afc199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 0x7f7afc199fb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006010 tx=0x7f7aec004340 comp rx=0 tx=0).stop 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 shutdown_connections 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ae40b6500 0x7f7ae40b8a10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7afc104070 0x7f7afc19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7afc1036d0 0x7f7afc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 --2- 172.21.15.134:0/1363190464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7afc102640 0x7f7afc199fb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:10.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 >> 172.21.15.134:0/1363190464 conn(0x7f7afc0fdfb0 msgr2=0x7f7afc0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:10.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 shutdown_connections 2024-09-21T00:52:10.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:52:10.261+0000 7f7b00970640 1 -- 172.21.15.134:0/1363190464 wait complete. 2024-09-21T00:52:10.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:10 smithi134 ceph-mon[34785]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:10.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:10.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:10.812 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:10.846 DEBUG:teuthology.orchestra.run.smithi134:osd.2> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T00:52:10.848 INFO:tasks.cephadm:Deploying osd.3 on smithi047 with /dev/vg_nvme/lv_3... 2024-09-21T00:52:10.849 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:52:11.113 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:52:11.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:10 smithi114 ceph-mon[34309]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:11.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:11.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:11.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:11.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:10 smithi047 ceph-mon[30960]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:11.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:11.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:11.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:12.766 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2[39152]: 2024-09-21T00:52:12.462+0000 7fd461e0b640 -1 osd.2 0 log_to_monitors true 2024-09-21T00:52:13.039 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:12 smithi047 ceph-mon[30960]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:13.039 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:12 smithi047 ceph-mon[30960]: from='osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:52:13.039 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:12 smithi047 ceph-mon[30960]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:52:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:12 smithi134 ceph-mon[34785]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:12 smithi134 ceph-mon[34785]: from='osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:52:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:12 smithi134 ceph-mon[34785]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:52:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:12 smithi114 ceph-mon[34309]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:12 smithi114 ceph-mon[34309]: from='osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:52:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:12 smithi114 ceph-mon[34309]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T00:52:13.655 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:52:13.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2024-09-21T00:52:13.937 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:52:13.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:13.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:52:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:52:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:52:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:52:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:14.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:14.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:14.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T00:52:14.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T00:52:14.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:14.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:52:14.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:52:14.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:14.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:14.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:14.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 -- 172.21.15.47:0/1278729747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 msgr2=0x7f3280103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 --2- 172.21.15.47:0/1278729747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 0x7f3280103ae0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3270009900 tx=0x7f327002a480 comp rx=0 tx=0).stop 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 -- 172.21.15.47:0/1278729747 shutdown_connections 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 --2- 172.21.15.47:0/1278729747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3280104070 0x7f328010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 --2- 172.21.15.47:0/1278729747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 0x7f3280103ae0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 --2- 172.21.15.47:0/1278729747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280102640 0x7f3280102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 -- 172.21.15.47:0/1278729747 >> 172.21.15.47:0/1278729747 conn(0x7f32800fdfb0 msgr2=0x7f3280100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 -- 172.21.15.47:0/1278729747 shutdown_connections 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.391+0000 7f3288787640 1 -- 172.21.15.47:0/1278729747 wait complete. 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3288787640 1 Processor -- start 2024-09-21T00:52:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3288787640 1 -- start start 2024-09-21T00:52:14.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3288787640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280102640 0x7f3280199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:14.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3288787640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 0x7f328019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:14.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3288787640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3280104070 0x7f328019b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:14.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3288787640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f328010e290 con 0x7f32801036d0 2024-09-21T00:52:14.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3288787640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f328010e110 con 0x7f3280102640 2024-09-21T00:52:14.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3288787640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f328010e410 con 0x7f3280104070 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3285d22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 0x7f328019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3285d22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 0x7f328019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51684/0 (socket says 172.21.15.47:51684) 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3285d22640 1 -- 172.21.15.47:0/2465801917 learned_addr learned my addr 172.21.15.47:0/2465801917 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.392+0000 7f3286d24640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3280104070 0x7f328019b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3286523640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280102640 0x7f3280199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3285d22640 1 -- 172.21.15.47:0/2465801917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3280104070 msgr2=0x7f328019b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3285d22640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3280104070 0x7f328019b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3285d22640 1 -- 172.21.15.47:0/2465801917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280102640 msgr2=0x7f3280199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3285d22640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280102640 0x7f3280199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3285d22640 1 -- 172.21.15.47:0/2465801917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328019b9e0 con 0x7f32801036d0 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3285d22640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 0x7f328019a620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3270006010 tx=0x7f3270031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f32777fe640 1 -- 172.21.15.47:0/2465801917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327003f030 con 0x7f32801036d0 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f32777fe640 1 -- 172.21.15.47:0/2465801917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3270003aa0 con 0x7f32801036d0 2024-09-21T00:52:14.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f32777fe640 1 -- 172.21.15.47:0/2465801917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270035070 con 0x7f32801036d0 2024-09-21T00:52:14.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328019bc70 con 0x7f32801036d0 2024-09-21T00:52:14.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.393+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32801a2200 con 0x7f32801036d0 2024-09-21T00:52:14.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.394+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32801a2430 con 0x7f32801036d0 2024-09-21T00:52:14.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.396+0000 7f32777fe640 1 -- 172.21.15.47:0/2465801917 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f3270042030 con 0x7f32801036d0 2024-09-21T00:52:14.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.397+0000 7f32777fe640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f326c0b6500 0x7f326c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:14.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.397+0000 7f3286523640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f326c0b6500 0x7f326c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:14.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.397+0000 7f32777fe640 1 -- 172.21.15.47:0/2465801917 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f3270106870 con 0x7f32801036d0 2024-09-21T00:52:14.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.398+0000 7f3286523640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f326c0b6500 0x7f326c0b8a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f327c005d00 tx=0x7f327c005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:14.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.400+0000 7f32777fe640 1 -- 172.21.15.47:0/2465801917 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32700ce7b0 con 0x7f32801036d0 2024-09-21T00:52:14.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:14.595+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f32800ffff0 con 0x7f326c0b6500 2024-09-21T00:52:15.094 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2[39152]: 2024-09-21T00:52:14.698+0000 7fd45dd8d640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T00:52:15.094 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2[39152]: 2024-09-21T00:52:14.880+0000 7fd455b83640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi134 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:15.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:14 smithi134 ceph-mon[34785]: from='osd.2 ' entity='osd.2' 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi134 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:15.107 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:14 smithi047 ceph-mon[30960]: from='osd.2 ' entity='osd.2' 2024-09-21T00:52:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi134 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:15.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:14 smithi114 ceph-mon[34309]: from='osd.2 ' entity='osd.2' 2024-09-21T00:52:15.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:15 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:52:15.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:15 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:52:15.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:15 smithi047 ceph-mon[30960]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:15.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:15 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:52:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:15 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:52:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:15 smithi134 ceph-mon[34785]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:16.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:15 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:52:16.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:15 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:52:16.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:15 smithi114 ceph-mon[34309]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:16.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:16.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:16 smithi047 ceph-mon[30960]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:16.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:16.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:16 smithi047 ceph-mon[30960]: osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] boot 2024-09-21T00:52:16.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:16 smithi047 ceph-mon[30960]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:52:16.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:16 smithi134 ceph-mon[34785]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:16 smithi134 ceph-mon[34785]: osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] boot 2024-09-21T00:52:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:16 smithi134 ceph-mon[34785]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:52:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:16 smithi114 ceph-mon[34309]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T00:52:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:16 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:17.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:16 smithi114 ceph-mon[34309]: osd.2 [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] boot 2024-09-21T00:52:17.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:16 smithi114 ceph-mon[34309]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T00:52:17.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:16 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T00:52:17.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:17 smithi047 ceph-mon[30960]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T00:52:17.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:17 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2177367814' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a93ad02-8a42-41ef-9eb8-6f787f0ae186"} : dispatch 2024-09-21T00:52:17.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:17 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2177367814' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a93ad02-8a42-41ef-9eb8-6f787f0ae186"}]': finished 2024-09-21T00:52:17.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:17 smithi047 ceph-mon[30960]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:52:17.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:17 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:17.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:17 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:52:17.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:17 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1903839181' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:18.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:17 smithi134 ceph-mon[34785]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T00:52:18.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:17 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2177367814' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a93ad02-8a42-41ef-9eb8-6f787f0ae186"} : dispatch 2024-09-21T00:52:18.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:17 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2177367814' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a93ad02-8a42-41ef-9eb8-6f787f0ae186"}]': finished 2024-09-21T00:52:18.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:17 smithi134 ceph-mon[34785]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:52:18.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:17 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:18.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:17 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:52:18.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:17 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1903839181' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:18.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:17 smithi114 ceph-mon[34309]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T00:52:18.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:17 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2177367814' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a93ad02-8a42-41ef-9eb8-6f787f0ae186"} : dispatch 2024-09-21T00:52:18.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:17 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2177367814' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a93ad02-8a42-41ef-9eb8-6f787f0ae186"}]': finished 2024-09-21T00:52:18.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:17 smithi114 ceph-mon[34309]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T00:52:18.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:18.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:52:18.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:17 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1903839181' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:19.206 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 ceph-mon[34785]: pgmap v96: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:19.207 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:52:19.207 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 ceph-mon[34785]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:52:19.207 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:19.207 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:52:19.275 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 ceph-mon[30960]: pgmap v96: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:19.275 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:52:19.275 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 ceph-mon[30960]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:52:19.275 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:19.275 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:52:19.275 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49357]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:52:19.275 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49351]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:52:19.276 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49351]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.276 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.276 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49351]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.276 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49354]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:52:19.276 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49354]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.276 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.276 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49354]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.357 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 ceph-mon[34309]: pgmap v96: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:19.357 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T00:52:19.357 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 ceph-mon[34309]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T00:52:19.357 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:19.358 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T00:52:19.358 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42093]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:52:19.358 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42087]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:52:19.358 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42087]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.358 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.358 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42087]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.358 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42090]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:52:19.358 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42090]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.358 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.358 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42090]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42804]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:52:19.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42804]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42804]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42807]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:52:19.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42807]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42807]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.595 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42798]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T00:52:19.595 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42798]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.595 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.595 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42798]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.595 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42801]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:52:19.595 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42801]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.595 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.596 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 00:52:19 smithi134 sudo[42801]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42093]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42093]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42096]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:52:19.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42096]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:19 smithi114 sudo[42096]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49357]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49357]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:19.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49360]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T00:52:19.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49360]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T00:52:19.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T00:52:19.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:19 smithi047 sudo[49360]: pam_unix(sudo:session): session closed for user root 2024-09-21T00:52:20.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:20.203+0000 7f32777fe640 1 -- 172.21.15.47:0/2465801917 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f32700ca320 con 0x7f32801036d0 2024-09-21T00:52:20.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.346 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:20 smithi134 ceph-mon[34785]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:20.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:20.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:20 smithi114 ceph-mon[34309]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T00:52:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T00:52:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T00:52:20.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T00:52:20.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:20 smithi047 ceph-mon[30960]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T00:52:21.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:21 smithi134 ceph-mon[34785]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T00:52:21.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:21.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:21 smithi134 ceph-mon[34785]: mgrmap e17: x(active, since 2m), standbys: z, y 2024-09-21T00:52:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:21 smithi114 ceph-mon[34309]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T00:52:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:21 smithi114 ceph-mon[34309]: mgrmap e17: x(active, since 2m), standbys: z, y 2024-09-21T00:52:21.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:21 smithi047 ceph-mon[30960]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T00:52:21.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:21.426 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:21 smithi047 ceph-mon[30960]: mgrmap e17: x(active, since 2m), standbys: z, y 2024-09-21T00:52:22.136 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:22 smithi047 ceph-mon[30960]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:22.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:22 smithi134 ceph-mon[34785]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:22.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:22 smithi114 ceph-mon[34309]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:24.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:24 smithi047 ceph-mon[30960]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:24 smithi134 ceph-mon[34785]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:24.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:24 smithi114 ceph-mon[34309]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:25.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:52:25.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:25.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:52:25.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:25.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T00:52:25.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:26 smithi134 ceph-mon[34785]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:26 smithi134 ceph-mon[34785]: Deploying daemon osd.3 on smithi047 2024-09-21T00:52:26.602 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:26 smithi047 ceph-mon[30960]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:26.602 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:26 smithi047 ceph-mon[30960]: Deploying daemon osd.3 on smithi047 2024-09-21T00:52:26.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:26 smithi114 ceph-mon[34309]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:26.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:26 smithi114 ceph-mon[34309]: Deploying daemon osd.3 on smithi047 2024-09-21T00:52:28.550 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:28 smithi047 ceph-mon[30960]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:28.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:28 smithi134 ceph-mon[34785]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:28.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:28 smithi114 ceph-mon[34309]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:30 smithi047 ceph-mon[30960]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:30.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:30 smithi134 ceph-mon[34785]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:30.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:30 smithi114 ceph-mon[34309]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:32.283 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:32 smithi047 ceph-mon[30960]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:32.283 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:32 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:32.283 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:32 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:32.283 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:32 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:32.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:32 smithi134 ceph-mon[34785]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:32.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:32 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:32.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:32 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:32.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:32 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:32.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:32 smithi114 ceph-mon[34309]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:32.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:32 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:32.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:32 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:32.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:32 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:34 smithi134 ceph-mon[34785]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:34.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:34 smithi114 ceph-mon[34309]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:34.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:34.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:34.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:34 smithi047 ceph-mon[30960]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:34.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:34.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:34.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:34.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:35.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.160+0000 7f32777fe640 1 -- 172.21.15.47:0/2465801917 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f32800ffff0 con 0x7f326c0b6500 2024-09-21T00:52:35.162 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 3 on host 'smithi047' 2024-09-21T00:52:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f326c0b6500 msgr2=0x7f326c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f326c0b6500 0x7f326c0b8a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f327c005d00 tx=0x7f327c005c50 comp rx=0 tx=0).stop 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 msgr2=0x7f328019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 0x7f328019a620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3270006010 tx=0x7f3270031a50 comp rx=0 tx=0).stop 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 shutdown_connections 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f326c0b6500 0x7f326c0b8a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3280104070 0x7f328019b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32801036d0 0x7f328019a620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 --2- 172.21.15.47:0/2465801917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280102640 0x7f3280199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 >> 172.21.15.47:0/2465801917 conn(0x7f32800fdfb0 msgr2=0x7f32800ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 shutdown_connections 2024-09-21T00:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:52:35.163+0000 7f3288787640 1 -- 172.21.15.47:0/2465801917 wait complete. 2024-09-21T00:52:35.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:35.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:35.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:35.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:35.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:35.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:35.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:35.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:35.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:35.794 DEBUG:teuthology.orchestra.run.smithi047:osd.3> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T00:52:35.797 INFO:tasks.cephadm:Deploying osd.4 on smithi114 with /dev/vg_nvme/lv_3... 2024-09-21T00:52:35.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:52:36.053 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:52:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:36 smithi047 ceph-mon[30960]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:36.462 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:36 smithi114 ceph-mon[34309]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:36.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:36 smithi134 ceph-mon[34785]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:37.948 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 00:52:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T00:52:37.685+0000 7f6b83424640 -1 osd.3 0 log_to_monitors true 2024-09-21T00:52:38.422 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:38 smithi114 ceph-mon[34309]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:38.422 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:38 smithi114 ceph-mon[34309]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:52:38.460 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:52:38.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi114:vg_nvme/lv_3 2024-09-21T00:52:38.562 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:38 smithi047 ceph-mon[30960]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:38.562 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:38 smithi047 ceph-mon[30960]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:52:38.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:38 smithi134 ceph-mon[34785]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:38.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:38 smithi134 ceph-mon[34785]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T00:52:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:52:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 -- 172.21.15.114:0/1684017131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb141036e0 msgr2=0x7feb14103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/1684017131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb141036e0 0x7feb14103af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feb04009900 tx=0x7feb0402a480 comp rx=0 tx=0).stop 2024-09-21T00:52:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 -- 172.21.15.114:0/1684017131 shutdown_connections 2024-09-21T00:52:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/1684017131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb14104080 0x7feb1410aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/1684017131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb141036e0 0x7feb14103af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/1684017131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb14102650 0x7feb14102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 -- 172.21.15.114:0/1684017131 >> 172.21.15.114:0/1684017131 conn(0x7feb140fdfa0 msgr2=0x7feb14100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:52:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 -- 172.21.15.114:0/1684017131 shutdown_connections 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.163+0000 7feb1b4bd640 1 -- 172.21.15.114:0/1684017131 wait complete. 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb1b4bd640 1 Processor -- start 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb1b4bd640 1 -- start start 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb1b4bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb14102650 0x7feb14198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb1b4bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb141036e0 0x7feb14199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb1b4bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb14104080 0x7feb1419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb1b4bd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb1410e280 con 0x7feb141036e0 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb1b4bd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feb1410e100 con 0x7feb14104080 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb1b4bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb1410e400 con 0x7feb14102650 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19a5a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb14104080 0x7feb1419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19259640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb14102650 0x7feb14198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19a5a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb14104080 0x7feb1419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59400/0 (socket says 172.21.15.114:59400) 2024-09-21T00:52:39.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19a5a640 1 -- 172.21.15.114:0/2781329035 learned_addr learned my addr 172.21.15.114:0/2781329035 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb18a58640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb141036e0 0x7feb14199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19259640 1 -- 172.21.15.114:0/2781329035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb14104080 msgr2=0x7feb1419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19259640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb14104080 0x7feb1419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19259640 1 -- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb141036e0 msgr2=0x7feb14199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19259640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb141036e0 0x7feb14199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19259640 1 -- 172.21.15.114:0/2781329035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1419a930 con 0x7feb14102650 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.164+0000 7feb19a5a640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb14104080 0x7feb1419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.165+0000 7feb19259640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb14102650 0x7feb14198f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb1000e9f0 tx=0x7feb1000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.165+0000 7feb0a7fc640 1 -- 172.21.15.114:0/2781329035 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1000ccc0 con 0x7feb14102650 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.165+0000 7feb0a7fc640 1 -- 172.21.15.114:0/2781329035 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb100108e0 con 0x7feb14102650 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.165+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1419ac20 con 0x7feb14102650 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.165+0000 7feb0a7fc640 1 -- 172.21.15.114:0/2781329035 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10018880 con 0x7feb14102650 2024-09-21T00:52:39.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.165+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb141a1320 con 0x7feb14102650 2024-09-21T00:52:39.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.166+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb14109810 con 0x7feb14102650 2024-09-21T00:52:39.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.167+0000 7feb0a7fc640 1 -- 172.21.15.114:0/2781329035 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7feb10010430 con 0x7feb14102650 2024-09-21T00:52:39.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.168+0000 7feb0a7fc640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb000b6590 0x7feb000b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:52:39.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.168+0000 7feb0a7fc640 1 -- 172.21.15.114:0/2781329035 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3373+0+0 (secure 0 0 0) 0x7feb100e6730 con 0x7feb14102650 2024-09-21T00:52:39.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.168+0000 7feb18a58640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb000b6590 0x7feb000b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:52:39.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.169+0000 7feb18a58640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb000b6590 0x7feb000b8aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb04000c00 tx=0x7feb04031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:52:39.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.171+0000 7feb0a7fc640 1 -- 172.21.15.114:0/2781329035 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb100b2650 con 0x7feb14102650 2024-09-21T00:52:39.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:52:39.370+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7feb14063800 con 0x7feb000b6590 2024-09-21T00:52:39.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:52:39.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi047 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi047 to 8546M 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:39.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:39.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:39 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi047 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi047 to 8546M 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:39.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:39 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.705 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T00:52:39.283+0000 7f6b7f3a6640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T00:52:39.706 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T00:52:39.292+0000 7f6b7b1a4640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:52:39.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T00:52:39.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T00:52:39.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:52:39.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:39.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi047 2024-09-21T00:52:39.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:39.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:52:39.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi047 to 8546M 2024-09-21T00:52:39.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:39.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:39.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:52:39.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:39 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:40.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:40.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:52:40.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T00:52:40.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:40.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:40.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:40.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:40.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:40.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:40.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:40.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:52:40.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T00:52:40.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:40.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:40.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:40.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:40.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:40.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: from='osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:52:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T00:52:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:52:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:52:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:52:40.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:41.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:41 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:52:41.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:41 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:52:41.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:41 smithi134 ceph-mon[34785]: osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] boot 2024-09-21T00:52:41.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:41 smithi134 ceph-mon[34785]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T00:52:41.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:41.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:41 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:52:41.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:41 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:52:41.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:41 smithi114 ceph-mon[34309]: osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] boot 2024-09-21T00:52:41.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:41 smithi114 ceph-mon[34309]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T00:52:41.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:41.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:41 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:52:41.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:41 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:52:41.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:41 smithi047 ceph-mon[30960]: osd.3 [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] boot 2024-09-21T00:52:41.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:41 smithi047 ceph-mon[30960]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T00:52:41.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T00:52:42.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:42 smithi134 ceph-mon[34785]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:42.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:42 smithi134 ceph-mon[34785]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T00:52:42.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:42 smithi134 ceph-mon[34785]: from='client.? 172.21.15.114:0/2168093529' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"} : dispatch 2024-09-21T00:52:42.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:42 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"} : dispatch 2024-09-21T00:52:42.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:42 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"}]': finished 2024-09-21T00:52:42.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:42 smithi134 ceph-mon[34785]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T00:52:42.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:52:42.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:42 smithi114 ceph-mon[34309]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:42.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:42 smithi114 ceph-mon[34309]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T00:52:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:42 smithi114 ceph-mon[34309]: from='client.? 172.21.15.114:0/2168093529' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"} : dispatch 2024-09-21T00:52:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:42 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"} : dispatch 2024-09-21T00:52:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:42 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"}]': finished 2024-09-21T00:52:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:42 smithi114 ceph-mon[34309]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T00:52:42.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:52:42.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:42 smithi047 ceph-mon[30960]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T00:52:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:42 smithi047 ceph-mon[30960]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T00:52:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:42 smithi047 ceph-mon[30960]: from='client.? 172.21.15.114:0/2168093529' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"} : dispatch 2024-09-21T00:52:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:42 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"} : dispatch 2024-09-21T00:52:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:42 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fefab4d-27ed-43e7-bc5e-8438c93a827c"}]': finished 2024-09-21T00:52:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:42 smithi047 ceph-mon[30960]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T00:52:42.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:52:43.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:43 smithi134 ceph-mon[34785]: from='client.? 172.21.15.114:0/2803864035' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:43.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:43 smithi114 ceph-mon[34309]: from='client.? 172.21.15.114:0/2803864035' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:43.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:43 smithi047 ceph-mon[30960]: from='client.? 172.21.15.114:0/2803864035' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:52:44.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:44 smithi134 ceph-mon[34785]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:44.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:44 smithi114 ceph-mon[34309]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:44.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:44 smithi047 ceph-mon[30960]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:46.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:46 smithi134 ceph-mon[34785]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T00:52:46.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:46 smithi114 ceph-mon[34309]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T00:52:46.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:46 smithi047 ceph-mon[30960]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T00:52:48.493 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:48 smithi114 ceph-mon[34309]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T00:52:48.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:48 smithi134 ceph-mon[34785]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T00:52:48.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:48 smithi047 ceph-mon[30960]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T00:52:50.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:50 smithi134 ceph-mon[34785]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:52:50.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:50 smithi114 ceph-mon[34309]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:52:50.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:50 smithi047 ceph-mon[30960]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:52:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:52:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:51 smithi114 ceph-mon[34309]: Deploying daemon osd.4 on smithi114 2024-09-21T00:52:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:52:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:51 smithi134 ceph-mon[34785]: Deploying daemon osd.4 on smithi114 2024-09-21T00:52:51.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T00:52:51.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:52:51.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:51 smithi047 ceph-mon[30960]: Deploying daemon osd.4 on smithi114 2024-09-21T00:52:52.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:52 smithi134 ceph-mon[34785]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:52:52.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:52 smithi114 ceph-mon[34309]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:52:52.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:52 smithi047 ceph-mon[30960]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:52:54.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:54 smithi114 ceph-mon[34309]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:52:54.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:54 smithi134 ceph-mon[34785]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:52:54.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:54 smithi047 ceph-mon[30960]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:52:56.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:56 smithi114 ceph-mon[34309]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:56.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:56 smithi134 ceph-mon[34785]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:56.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:56 smithi047 ceph-mon[30960]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:52:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:57.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:57.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:57.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:57.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:57.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:57.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:52:57.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:57.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:52:58.892 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:52:58 smithi114 ceph-mon[34309]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:52:58 smithi047 ceph-mon[30960]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:52:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:52:58 smithi134 ceph-mon[34785]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:00.342 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:00 smithi114 ceph-mon[34309]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:00.342 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:00.343 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:00.343 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:00.343 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:00.343 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:00 smithi134 ceph-mon[34785]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:00.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.660+0000 7feb0a7fc640 1 -- 172.21.15.114:0/2781329035 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feb14063800 con 0x7feb000b6590 2024-09-21T00:53:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 4 on host 'smithi114' 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb000b6590 msgr2=0x7feb000b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb000b6590 0x7feb000b8aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb04000c00 tx=0x7feb04031400 comp rx=0 tx=0).stop 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb14102650 msgr2=0x7feb14198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb14102650 0x7feb14198f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb1000e9f0 tx=0x7feb1000eeb0 comp rx=0 tx=0).stop 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 shutdown_connections 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb000b6590 0x7feb000b8aa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb14104080 0x7feb1419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb141036e0 0x7feb14199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 --2- 172.21.15.114:0/2781329035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb14102650 0x7feb14198f00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 >> 172.21.15.114:0/2781329035 conn(0x7feb140fdfa0 msgr2=0x7feb141069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 shutdown_connections 2024-09-21T00:53:00.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:00.663+0000 7feb1b4bd640 1 -- 172.21.15.114:0/2781329035 wait complete. 2024-09-21T00:53:00.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:00 smithi047 ceph-mon[30960]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:00.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:00.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:00.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:00.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:00.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:01.326 DEBUG:teuthology.orchestra.run.smithi114:osd.4> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T00:53:01.328 INFO:tasks.cephadm:Deploying osd.5 on smithi134 with /dev/vg_nvme/lv_3... 2024-09-21T00:53:01.328 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T00:53:01.567 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:01.567 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:01.567 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:01.582 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:53:01.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:01.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:01.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:01.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:01.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:01.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:02.671 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:02 smithi114 ceph-mon[34309]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:02.943 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:02 smithi134 ceph-mon[34785]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:02.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:02 smithi047 ceph-mon[30960]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:03.159 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 00:53:02 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4[44689]: 2024-09-21T00:53:02.752+0000 7f401f1de640 -1 osd.4 0 log_to_monitors true 2024-09-21T00:53:03.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:03 smithi134 ceph-mon[34785]: from='osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:53:03.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:03 smithi134 ceph-mon[34785]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:53:03.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:03 smithi114 ceph-mon[34309]: from='osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:53:03.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:03 smithi114 ceph-mon[34309]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:53:03.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:03 smithi047 ceph-mon[30960]: from='osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:53:03.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:03 smithi047 ceph-mon[30960]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T00:53:04.186 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:53:04.212 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-09-21T00:53:04.462 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi114 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:04.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:04.839 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:04.839 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:04.839 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi114 to 8544M 2024-09-21T00:53:04.839 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:04.839 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:04.839 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:04.839 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:04 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.931+0000 7f9769b3b640 1 -- 172.21.15.134:0/2653605769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764104080 msgr2=0x7f976410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.931+0000 7f9769b3b640 1 --2- 172.21.15.134:0/2653605769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764104080 0x7f976410aa20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f975c009ca0 tx=0x7f975c02a950 comp rx=0 tx=0).stop 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.931+0000 7f9769b3b640 1 -- 172.21.15.134:0/2653605769 shutdown_connections 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.931+0000 7f9769b3b640 1 --2- 172.21.15.134:0/2653605769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764104080 0x7f976410aa20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.931+0000 7f9769b3b640 1 --2- 172.21.15.134:0/2653605769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97641036e0 0x7f9764103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.931+0000 7f9769b3b640 1 --2- 172.21.15.134:0/2653605769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9764102650 0x7f9764102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.931+0000 7f9769b3b640 1 -- 172.21.15.134:0/2653605769 >> 172.21.15.134:0/2653605769 conn(0x7f97640fdfa0 msgr2=0x7f9764100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.932+0000 7f9769b3b640 1 -- 172.21.15.134:0/2653605769 shutdown_connections 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.932+0000 7f9769b3b640 1 -- 172.21.15.134:0/2653605769 wait complete. 2024-09-21T00:53:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.932+0000 7f9769b3b640 1 Processor -- start 2024-09-21T00:53:04.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.932+0000 7f9769b3b640 1 -- start start 2024-09-21T00:53:04.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f9769b3b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764102650 0x7f976406c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:04.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f9769b3b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97641036e0 0x7f976419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:04.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f9769b3b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9764104080 0x7f97641a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:04.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f9769b3b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f976410e2a0 con 0x7f97641036e0 2024-09-21T00:53:04.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f9769b3b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f976410e120 con 0x7f9764104080 2024-09-21T00:53:04.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f9769b3b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f976410e420 con 0x7f9764102650 2024-09-21T00:53:04.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764102650 0x7f976406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764102650 0x7f976406c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41240/0 (socket says 172.21.15.134:41240) 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 -- 172.21.15.134:0/3295359726 learned_addr learned my addr 172.21.15.134:0/3295359726 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f9763fff640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9764104080 0x7f97641a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f975bfff640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97641036e0 0x7f976419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 -- 172.21.15.134:0/3295359726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9764104080 msgr2=0x7f97641a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9764104080 0x7f97641a1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 -- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97641036e0 msgr2=0x7f976419ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97641036e0 0x7f976419ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 -- 172.21.15.134:0/3295359726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97641a19a0 con 0x7f9764102650 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97637fe640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764102650 0x7f976406c340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f975400c920 tx=0x7f975400cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97617fa640 1 -- 172.21.15.134:0/3295359726 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754007c70 con 0x7f9764102650 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97617fa640 1 -- 172.21.15.134:0/3295359726 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9754007e10 con 0x7f9764102650 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97641a1c90 con 0x7f9764102650 2024-09-21T00:53:04.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.933+0000 7f97617fa640 1 -- 172.21.15.134:0/3295359726 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754018820 con 0x7f9764102650 2024-09-21T00:53:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.934+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97641a2180 con 0x7f9764102650 2024-09-21T00:53:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.935+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9764109810 con 0x7f9764102650 2024-09-21T00:53:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.936+0000 7f97617fa640 1 -- 172.21.15.134:0/3295359726 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f975400f450 con 0x7f9764102650 2024-09-21T00:53:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.937+0000 7f97617fa640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97500b6510 0x7f97500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.938+0000 7f97617fa640 1 -- 172.21.15.134:0/3295359726 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f97540e62c0 con 0x7f9764102650 2024-09-21T00:53:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.938+0000 7f975bfff640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97500b6510 0x7f97500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.938+0000 7f975bfff640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97500b6510 0x7f97500b8a20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f974c005fd0 tx=0x7f974c005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:04.942+0000 7f97617fa640 1 -- 172.21.15.134:0/3295359726 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9754014030 con 0x7f9764102650 2024-09-21T00:53:04.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi114 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi114 to 8544M 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:04.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:04.959 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:04.959 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:04 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:05.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:05.132+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9764063800 con 0x7f97500b6510 2024-09-21T00:53:05.160 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4[44689]: 2024-09-21T00:53:04.677+0000 7f401b160640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T00:53:05.160 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4[44689]: 2024-09-21T00:53:04.686+0000 7f4016f5e640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:53:05.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:05.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T00:53:05.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T00:53:05.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:05.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:53:05.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:53:05.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi114 2024-09-21T00:53:05.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:05.162 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:05.162 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:05.162 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:05.162 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi114 to 8544M 2024-09-21T00:53:05.162 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:05.162 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:05.163 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:05.163 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:04 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:05.806 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:05 smithi134 ceph-mon[34785]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:53:05.806 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:05 smithi134 ceph-mon[34785]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T00:53:05.807 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:05 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:05.807 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:05 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:05.807 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:05 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:05.807 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:05 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:05.807 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:05 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:05.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:05 smithi047 ceph-mon[30960]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:53:05.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:05 smithi047 ceph-mon[30960]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T00:53:05.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:05 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:05.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:05 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:05.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:05 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:05.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:05 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:05.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:05 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:06.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:05 smithi114 ceph-mon[34309]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:53:06.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:05 smithi114 ceph-mon[34309]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T00:53:06.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:05 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:06.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:05 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:06.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:05 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:06.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:05 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:06.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:05 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:06 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:53:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:06 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:53:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:06 smithi134 ceph-mon[34785]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:06 smithi134 ceph-mon[34785]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:06 smithi134 ceph-mon[34785]: osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] boot 2024-09-21T00:53:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:06 smithi134 ceph-mon[34785]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T00:53:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:06.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:06 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:53:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:06 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:53:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:06 smithi047 ceph-mon[30960]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:06 smithi047 ceph-mon[30960]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:06 smithi047 ceph-mon[30960]: osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] boot 2024-09-21T00:53:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:06 smithi047 ceph-mon[30960]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T00:53:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:06 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:53:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:06 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:53:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:06 smithi114 ceph-mon[34309]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:07.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:06 smithi114 ceph-mon[34309]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T00:53:07.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:06 smithi114 ceph-mon[34309]: osd.4 [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] boot 2024-09-21T00:53:07.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:06 smithi114 ceph-mon[34309]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T00:53:07.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T00:53:07.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:07 smithi047 ceph-mon[30960]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T00:53:07.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:07 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/96974395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"} : dispatch 2024-09-21T00:53:07.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:07 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"} : dispatch 2024-09-21T00:53:07.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:07 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"}]': finished 2024-09-21T00:53:07.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:07 smithi047 ceph-mon[30960]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T00:53:07.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:07 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:08.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:07 smithi134 ceph-mon[34785]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T00:53:08.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:07 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/96974395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"} : dispatch 2024-09-21T00:53:08.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:07 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"} : dispatch 2024-09-21T00:53:08.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:07 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"}]': finished 2024-09-21T00:53:08.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:07 smithi134 ceph-mon[34785]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T00:53:08.040 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:07 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:08.060 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:07 smithi114 ceph-mon[34309]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T00:53:08.060 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:07 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/96974395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"} : dispatch 2024-09-21T00:53:08.061 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:07 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"} : dispatch 2024-09-21T00:53:08.061 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:07 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e32d102e-b303-4ecd-83af-60bcb38996d2"}]': finished 2024-09-21T00:53:08.061 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:07 smithi114 ceph-mon[34309]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T00:53:08.061 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:07 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:09.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:08 smithi134 ceph-mon[34785]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:09.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:08 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/2447856014' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:09.137 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:08 smithi047 ceph-mon[30960]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:09.137 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:08 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/2447856014' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:09.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:08 smithi114 ceph-mon[34309]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:09.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:08 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/2447856014' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:10 smithi134 ceph-mon[34785]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:11.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:10 smithi114 ceph-mon[34309]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:11.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:10 smithi047 ceph-mon[30960]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:13.026 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:12 smithi134 ceph-mon[34785]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:12 smithi114 ceph-mon[34309]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:13.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:12 smithi047 ceph-mon[30960]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:14.937 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:14 smithi134 ceph-mon[34785]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:14 smithi114 ceph-mon[34309]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:15.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:14 smithi047 ceph-mon[30960]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:15.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:53:15.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:16.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:53:16.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:16.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T00:53:16.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:17.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:16 smithi134 ceph-mon[34785]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:17.023 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:16 smithi134 ceph-mon[34785]: Deploying daemon osd.5 on smithi134 2024-09-21T00:53:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:16 smithi114 ceph-mon[34309]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:16 smithi114 ceph-mon[34309]: Deploying daemon osd.5 on smithi134 2024-09-21T00:53:17.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:16 smithi047 ceph-mon[30960]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:17.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:16 smithi047 ceph-mon[30960]: Deploying daemon osd.5 on smithi134 2024-09-21T00:53:18.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:18 smithi047 ceph-mon[30960]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:19.253 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:18 smithi114 ceph-mon[34309]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:19.253 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:18 smithi134 ceph-mon[34785]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:20.832 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:20 smithi134 ceph-mon[34785]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:21.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:20 smithi114 ceph-mon[34309]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:21.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:20 smithi047 ceph-mon[30960]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:22.053 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:22.054 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:22.054 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:22.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:22.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:22.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:22.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:23.051 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:22 smithi134 ceph-mon[34785]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:23.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:22 smithi114 ceph-mon[34309]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:22 smithi047 ceph-mon[30960]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:24 smithi134 ceph-mon[34785]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:24 smithi114 ceph-mon[34309]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:25.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:25.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:25.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:24 smithi047 ceph-mon[30960]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:25.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:25.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:25.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.510+0000 7f97617fa640 1 -- 172.21.15.134:0/3295359726 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9764063800 con 0x7f97500b6510 2024-09-21T00:53:25.511 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 5 on host 'smithi134' 2024-09-21T00:53:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97500b6510 msgr2=0x7f97500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97500b6510 0x7f97500b8a20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f974c005fd0 tx=0x7f974c005e20 comp rx=0 tx=0).stop 2024-09-21T00:53:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764102650 msgr2=0x7f976406c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764102650 0x7f976406c340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f975400c920 tx=0x7f975400cde0 comp rx=0 tx=0).stop 2024-09-21T00:53:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 shutdown_connections 2024-09-21T00:53:25.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97500b6510 0x7f97500b8a20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:25.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9764104080 0x7f97641a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:25.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97641036e0 0x7f976419ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:25.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 --2- 172.21.15.134:0/3295359726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9764102650 0x7f976406c340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:25.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 >> 172.21.15.134:0/3295359726 conn(0x7f97640fdfa0 msgr2=0x7f97641069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:25.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 shutdown_connections 2024-09-21T00:53:25.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:53:25.513+0000 7f9769b3b640 1 -- 172.21.15.134:0/3295359726 wait complete. 2024-09-21T00:53:25.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:25.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:25.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:26.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:26.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:26.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:26.179 DEBUG:teuthology.orchestra.run.smithi134:osd.5> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T00:53:26.181 INFO:tasks.cephadm:Deploying osd.6 on smithi047 with /dev/vg_nvme/lv_2... 2024-09-21T00:53:26.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:53:26.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:26.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:26.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:26.448 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:53:26.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:26 smithi047 ceph-mon[30960]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:27.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:26 smithi134 ceph-mon[34785]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:27.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:26 smithi114 ceph-mon[34309]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:28.345 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 00:53:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T00:53:27.969+0000 7f08508d4640 -1 osd.5 0 log_to_monitors true 2024-09-21T00:53:28.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:28 smithi047 ceph-mon[30960]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:28.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:28 smithi047 ceph-mon[30960]: from='osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:53:28.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:28 smithi047 ceph-mon[30960]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:53:29.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:28 smithi134 ceph-mon[34785]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:29.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:28 smithi134 ceph-mon[34785]: from='osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:53:29.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:28 smithi134 ceph-mon[34785]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:53:29.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:28 smithi114 ceph-mon[34309]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:29.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:28 smithi114 ceph-mon[34309]: from='osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:53:29.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:28 smithi114 ceph-mon[34309]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T00:53:29.477 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:53:29.503 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2024-09-21T00:53:29.802 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:53:30.027 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi134 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.028 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:30.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:30.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.094 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T00:53:29.778+0000 7f084c856640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T00:53:30.094 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T00:53:29.787+0000 7f0848654640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:53:30.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi134 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:30.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:30.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T00:53:30.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi134 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:30.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:30.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 -- 172.21.15.47:0/1635033082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 msgr2=0x7f357c103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:30.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 --2- 172.21.15.47:0/1635033082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 0x7f357c103b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3570009900 tx=0x7f357002a480 comp rx=0 tx=0).stop 2024-09-21T00:53:30.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 -- 172.21.15.47:0/1635033082 shutdown_connections 2024-09-21T00:53:30.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 --2- 172.21.15.47:0/1635033082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f357c1040a0 0x7f357c10aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:30.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 --2- 172.21.15.47:0/1635033082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 0x7f357c103b10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:30.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 --2- 172.21.15.47:0/1635033082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f357c102670 0x7f357c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:30.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 -- 172.21.15.47:0/1635033082 >> 172.21.15.47:0/1635033082 conn(0x7f357c0fdfe0 msgr2=0x7f357c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:30.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 -- 172.21.15.47:0/1635033082 shutdown_connections 2024-09-21T00:53:30.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.315+0000 7f3580daa640 1 -- 172.21.15.47:0/1635033082 wait complete. 2024-09-21T00:53:30.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3580daa640 1 Processor -- start 2024-09-21T00:53:30.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3580daa640 1 -- start start 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3580daa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f357c102670 0x7f357c06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3580daa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 0x7f357c19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3580daa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f357c1040a0 0x7f357c1a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3580daa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f357c10e2c0 con 0x7f357c103700 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3580daa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f357c10e140 con 0x7f357c102670 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3580daa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f357c10e440 con 0x7f357c1040a0 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3579d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 0x7f357c19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3579d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 0x7f357c19edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48936/0 (socket says 172.21.15.47:48936) 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f3579d9b640 1 -- 172.21.15.47:0/4247811401 learned_addr learned my addr 172.21.15.47:0/4247811401 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.316+0000 7f357a59c640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f357c102670 0x7f357c06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f357ad9d640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f357c1040a0 0x7f357c1a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:30.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f3579d9b640 1 -- 172.21.15.47:0/4247811401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f357c1040a0 msgr2=0x7f357c1a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f3579d9b640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f357c1040a0 0x7f357c1a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f3579d9b640 1 -- 172.21.15.47:0/4247811401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f357c102670 msgr2=0x7f357c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f3579d9b640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f357c102670 0x7f357c06c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f3579d9b640 1 -- 172.21.15.47:0/4247811401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357c1a1a90 con 0x7f357c103700 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f3579d9b640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 0x7f357c19edd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3570006010 tx=0x7f3570004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f356b7fe640 1 -- 172.21.15.47:0/4247811401 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357003f030 con 0x7f357c103700 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357c1a1d20 con 0x7f357c103700 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f356b7fe640 1 -- 172.21.15.47:0/4247811401 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3570003cb0 con 0x7f357c103700 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f356b7fe640 1 -- 172.21.15.47:0/4247811401 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570035070 con 0x7f357c103700 2024-09-21T00:53:30.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.317+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357c198d50 con 0x7f357c103700 2024-09-21T00:53:30.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.318+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357c109850 con 0x7f357c103700 2024-09-21T00:53:30.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.320+0000 7f356b7fe640 1 -- 172.21.15.47:0/4247811401 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f3570042030 con 0x7f357c103700 2024-09-21T00:53:30.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.321+0000 7f356b7fe640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f35640ba920 0x7f35640bce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:30.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.321+0000 7f357a59c640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f35640ba920 0x7f35640bce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:30.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.321+0000 7f356b7fe640 1 -- 172.21.15.47:0/4247811401 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7f3570106f90 con 0x7f357c103700 2024-09-21T00:53:30.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.321+0000 7f357a59c640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f35640ba920 0x7f35640bce30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f356c005fd0 tx=0x7f356c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:30.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.324+0000 7f356b7fe640 1 -- 172.21.15.47:0/4247811401 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3570003e60 con 0x7f357c103700 2024-09-21T00:53:30.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:30.520+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f357c063800 con 0x7f35640ba920 2024-09-21T00:53:31.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:31.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:53:31.029 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T00:53:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] boot 2024-09-21T00:53:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T00:53:31.030 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:53:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T00:53:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] boot 2024-09-21T00:53:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T00:53:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T00:53:31.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: osd.5 [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] boot 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T00:53:31.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T00:53:31.950 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:31 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:53:31.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:31 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:53:31.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:31 smithi047 ceph-mon[30960]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:31.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:31 smithi047 ceph-mon[30960]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T00:53:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:31 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:53:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:31 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:53:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:31 smithi134 ceph-mon[34785]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:31 smithi134 ceph-mon[34785]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T00:53:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:31 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:53:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:31 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:53:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:31 smithi114 ceph-mon[34309]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:31 smithi114 ceph-mon[34309]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T00:53:32.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:32 smithi047 ceph-mon[30960]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:32.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:32 smithi047 ceph-mon[30960]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T00:53:33.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:32 smithi134 ceph-mon[34785]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:33.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:32 smithi134 ceph-mon[34785]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T00:53:33.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:32 smithi114 ceph-mon[34309]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:33.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:32 smithi114 ceph-mon[34309]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T00:53:33.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:33 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3423425610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "775f48c6-25b0-4e62-b1dd-c132a13c72e0"} : dispatch 2024-09-21T00:53:33.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:33 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3423425610' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "775f48c6-25b0-4e62-b1dd-c132a13c72e0"}]': finished 2024-09-21T00:53:33.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:33 smithi047 ceph-mon[30960]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T00:53:33.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:33 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:33.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:33 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/892218990' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:34.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:33 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3423425610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "775f48c6-25b0-4e62-b1dd-c132a13c72e0"} : dispatch 2024-09-21T00:53:34.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:33 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3423425610' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "775f48c6-25b0-4e62-b1dd-c132a13c72e0"}]': finished 2024-09-21T00:53:34.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:33 smithi134 ceph-mon[34785]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T00:53:34.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:33 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:34.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:33 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/892218990' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:34.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:33 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3423425610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "775f48c6-25b0-4e62-b1dd-c132a13c72e0"} : dispatch 2024-09-21T00:53:34.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:33 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3423425610' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "775f48c6-25b0-4e62-b1dd-c132a13c72e0"}]': finished 2024-09-21T00:53:34.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:33 smithi114 ceph-mon[34309]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T00:53:34.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:33 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:34.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:33 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/892218990' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:53:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:34 smithi134 ceph-mon[34785]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:35.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:34 smithi114 ceph-mon[34309]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:35.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:34 smithi047 ceph-mon[30960]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:37.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:36 smithi134 ceph-mon[34785]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-21T00:53:37.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:36 smithi114 ceph-mon[34309]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-21T00:53:37.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:36 smithi047 ceph-mon[30960]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-21T00:53:39.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:38 smithi134 ceph-mon[34785]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:53:39.140 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:38 smithi047 ceph-mon[30960]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:53:39.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:38 smithi114 ceph-mon[34309]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:53:41.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:40 smithi134 ceph-mon[34785]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:53:41.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:40 smithi114 ceph-mon[34309]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:53:41.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:40 smithi047 ceph-mon[30960]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:53:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:53:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:53:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:42.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T00:53:42.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:42.904 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:42 smithi047 ceph-mon[30960]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:53:42.904 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:42 smithi047 ceph-mon[30960]: Deploying daemon osd.6 on smithi047 2024-09-21T00:53:43.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:42 smithi134 ceph-mon[34785]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:53:43.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:42 smithi134 ceph-mon[34785]: Deploying daemon osd.6 on smithi047 2024-09-21T00:53:43.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:42 smithi114 ceph-mon[34309]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T00:53:43.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:42 smithi114 ceph-mon[34309]: Deploying daemon osd.6 on smithi047 2024-09-21T00:53:44.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:44 smithi047 ceph-mon[30960]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T00:53:45.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:44 smithi134 ceph-mon[34785]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T00:53:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:44 smithi114 ceph-mon[34309]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T00:53:46.902 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:46 smithi047 ceph-mon[30960]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:47.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:46 smithi134 ceph-mon[34785]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:47.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:46 smithi114 ceph-mon[34309]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:53:48.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:48 smithi047 ceph-mon[30960]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:48.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:48.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:48.937 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:48 smithi134 ceph-mon[34785]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:49.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:48 smithi114 ceph-mon[34309]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:49.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:49.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.065 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:50 smithi047 ceph-mon[30960]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:51.065 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:50 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.066 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:50 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.066 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:50 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:51.066 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:50 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:51.066 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:50 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:50 smithi134 ceph-mon[34785]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:50 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:50 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:50 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:50 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:50 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:50 smithi114 ceph-mon[34309]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:50 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:50 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:50 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:51.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:50 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:51.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:50 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:51.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.755+0000 7f356b7fe640 1 -- 172.21.15.47:0/4247811401 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f357c063800 con 0x7f35640ba920 2024-09-21T00:53:51.756 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 6 on host 'smithi047' 2024-09-21T00:53:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f35640ba920 msgr2=0x7f35640bce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f35640ba920 0x7f35640bce30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f356c005fd0 tx=0x7f356c00b390 comp rx=0 tx=0).stop 2024-09-21T00:53:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 msgr2=0x7f357c19edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 0x7f357c19edd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3570006010 tx=0x7f3570004340 comp rx=0 tx=0).stop 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 shutdown_connections 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f35640ba920 0x7f35640bce30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f357c1040a0 0x7f357c1a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f357c103700 0x7f357c19edd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 --2- 172.21.15.47:0/4247811401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f357c102670 0x7f357c06c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.757+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 >> 172.21.15.47:0/4247811401 conn(0x7f357c0fdfe0 msgr2=0x7f357c106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.758+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 shutdown_connections 2024-09-21T00:53:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:53:51.758+0000 7f3580daa640 1 -- 172.21.15.47:0/4247811401 wait complete. 2024-09-21T00:53:52.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:52.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:52.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:52.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:52.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:52.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:52.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:53:52.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:52.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:52.447 DEBUG:teuthology.orchestra.run.smithi047:osd.6> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T00:53:52.449 INFO:tasks.cephadm:Deploying osd.7 on smithi114 with /dev/vg_nvme/lv_2... 2024-09-21T00:53:52.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:53:52.705 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:53:52.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:52 smithi047 ceph-mon[30960]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:53.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:52 smithi134 ceph-mon[34785]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:53.151 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:52 smithi114 ceph-mon[34309]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:54.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 00:53:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T00:53:53.945+0000 7f4069fb6640 -1 osd.6 0 log_to_monitors true 2024-09-21T00:53:55.064 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:54 smithi047 ceph-mon[30960]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:55.064 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:54 smithi047 ceph-mon[30960]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:53:55.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:54 smithi134 ceph-mon[34785]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:55.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:54 smithi134 ceph-mon[34785]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:53:55.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:54 smithi114 ceph-mon[34309]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:55.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:54 smithi114 ceph-mon[34309]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T00:53:55.248 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:53:55.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi114:vg_nvme/lv_2 2024-09-21T00:53:55.529 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:53:56.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 -- 172.21.15.114:0/1952175405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 msgr2=0x7fb5a8101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 --2- 172.21.15.114:0/1952175405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 0x7fb5a8101f10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009900 tx=0x7fb5a402a410 comp rx=0 tx=0).stop 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 -- 172.21.15.114:0/1952175405 shutdown_connections 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 --2- 172.21.15.114:0/1952175405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5a8109500 0x7fb5a810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 --2- 172.21.15.114:0/1952175405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a8106ba0 0x7fb5a8108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 --2- 172.21.15.114:0/1952175405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 0x7fb5a8101f10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 -- 172.21.15.114:0/1952175405 >> 172.21.15.114:0/1952175405 conn(0x7fb5a80fd770 msgr2=0x7fb5a80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 -- 172.21.15.114:0/1952175405 shutdown_connections 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.059+0000 7fb5af49b640 1 -- 172.21.15.114:0/1952175405 wait complete. 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5af49b640 1 Processor -- start 2024-09-21T00:53:56.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5af49b640 1 -- start start 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5af49b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 0x7fb5a8199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5af49b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5a8106ba0 0x7fb5a819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5ad237640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 0x7fb5a8199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5ad237640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 0x7fb5a8199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39100/0 (socket says 172.21.15.114:39100) 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5ad237640 1 -- 172.21.15.114:0/735754841 learned_addr learned my addr 172.21.15.114:0/735754841 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5af49b640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a8109500 0x7fb5a819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a810f360 con 0x7fb5a8106ba0 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a810f1e0 con 0x7fb5a8101b00 2024-09-21T00:53:56.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a810f4e0 con 0x7fb5a8109500 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.060+0000 7fb5aca36640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5a8106ba0 0x7fb5a819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb5ada38640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a8109500 0x7fb5a819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb5ad237640 1 -- 172.21.15.114:0/735754841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a8109500 msgr2=0x7fb5a819b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb5ad237640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a8109500 0x7fb5a819b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb5ad237640 1 -- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5a8106ba0 msgr2=0x7fb5a819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb5ad237640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5a8106ba0 0x7fb5a819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb5ad237640 1 -- 172.21.15.114:0/735754841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a819b930 con 0x7fb5a8101b00 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb5ad237640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 0x7fb5a8199f90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006010 tx=0x7fb5a4004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb59e7fc640 1 -- 172.21.15.114:0/735754841 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a403f030 con 0x7fb5a8101b00 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb59e7fc640 1 -- 172.21.15.114:0/735754841 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a4003cb0 con 0x7fb5a8101b00 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a819bbc0 con 0x7fb5a8101b00 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.061+0000 7fb59e7fc640 1 -- 172.21.15.114:0/735754841 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4035070 con 0x7fb5a8101b00 2024-09-21T00:53:56.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.062+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81a21e0 con 0x7fb5a8101b00 2024-09-21T00:53:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.063+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a8101f10 con 0x7fb5a8101b00 2024-09-21T00:53:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.065+0000 7fb59e7fc640 1 -- 172.21.15.114:0/735754841 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb5a4042030 con 0x7fb5a8101b00 2024-09-21T00:53:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.065+0000 7fb59e7fc640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb5940b6510 0x7fb5940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:53:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.065+0000 7fb59e7fc640 1 -- 172.21.15.114:0/735754841 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7fb5a4107160 con 0x7fb5a8101b00 2024-09-21T00:53:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.065+0000 7fb5aca36640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb5940b6510 0x7fb5940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:53:56.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.066+0000 7fb5aca36640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb5940b6510 0x7fb5940b8a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb59800abe0 tx=0x7fb59800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:53:56.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.069+0000 7fb59e7fc640 1 -- 172.21.15.114:0/735754841 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5a4003e60 con 0x7fb5a8101b00 2024-09-21T00:53:56.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:56.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:55 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:56.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:55 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:53:56.262+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb5a8063800 con 0x7fb5940b6510 2024-09-21T00:53:56.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T00:53:56.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T00:53:56.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:53:56.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:56.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:53:56.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:56.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:53:56.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:55 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:53:56.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T00:53:56.629+0000 7f4065f38640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T00:53:56.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T00:53:56.642+0000 7f405dd2e640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:53:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi047 2024-09-21T00:53:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi047 to 5697M 2024-09-21T00:53:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:53:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T00:53:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:56.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:56.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:56.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:56.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:56.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' 2024-09-21T00:53:56.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi047 2024-09-21T00:53:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi047 to 5697M 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' 2024-09-21T00:53:57.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi047 2024-09-21T00:53:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi047 to 5697M 2024-09-21T00:53:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:53:57.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T00:53:57.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:57.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:57.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:53:57.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:53:57.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:53:57.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: from='osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807]' entity='osd.6' 2024-09-21T00:53:57.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:58.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:57 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:53:58.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:57 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:53:58.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:57 smithi114 ceph-mon[34309]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:58.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:57 smithi114 ceph-mon[34309]: osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] boot 2024-09-21T00:53:58.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:57 smithi114 ceph-mon[34309]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T00:53:58.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:57 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:53:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:57 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:53:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:57 smithi047 ceph-mon[30960]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:57 smithi047 ceph-mon[30960]: osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] boot 2024-09-21T00:53:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:57 smithi047 ceph-mon[30960]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T00:53:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:57 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:53:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:57 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:53:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:57 smithi134 ceph-mon[34785]: from='client.24422 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:53:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:57 smithi134 ceph-mon[34785]: osd.6 [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] boot 2024-09-21T00:53:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:57 smithi134 ceph-mon[34785]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T00:53:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T00:53:59.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:58 smithi114 ceph-mon[34309]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:59.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:58 smithi114 ceph-mon[34309]: from='client.? 172.21.15.114:0/4102558707' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"} : dispatch 2024-09-21T00:53:59.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:58 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"} : dispatch 2024-09-21T00:53:59.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:58 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"}]': finished 2024-09-21T00:53:59.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:58 smithi114 ceph-mon[34309]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:53:59.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:53:59.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:58 smithi047 ceph-mon[30960]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:58 smithi047 ceph-mon[30960]: from='client.? 172.21.15.114:0/4102558707' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"} : dispatch 2024-09-21T00:53:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:58 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"} : dispatch 2024-09-21T00:53:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:58 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"}]': finished 2024-09-21T00:53:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:58 smithi047 ceph-mon[30960]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:53:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:53:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:58 smithi134 ceph-mon[34785]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-21T00:53:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:58 smithi134 ceph-mon[34785]: from='client.? 172.21.15.114:0/4102558707' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"} : dispatch 2024-09-21T00:53:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:58 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"} : dispatch 2024-09-21T00:53:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:58 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57c50ddf-b4db-435a-bfda-5cf763920d78"}]': finished 2024-09-21T00:53:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:58 smithi134 ceph-mon[34785]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T00:53:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:00.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:53:59 smithi114 ceph-mon[34309]: from='client.? 172.21.15.114:0/1000583184' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:00.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:53:59 smithi047 ceph-mon[30960]: from='client.? 172.21.15.114:0/1000583184' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:53:59 smithi134 ceph-mon[34785]: from='client.? 172.21.15.114:0/1000583184' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:01.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:00 smithi114 ceph-mon[34309]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:01.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:00 smithi047 ceph-mon[30960]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:00 smithi134 ceph-mon[34785]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:03.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:02 smithi114 ceph-mon[34309]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:03.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:02 smithi047 ceph-mon[30960]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:03.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:02 smithi134 ceph-mon[34785]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:05.078 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:04 smithi114 ceph-mon[34309]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:05.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:04 smithi047 ceph-mon[30960]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:05.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:04 smithi134 ceph-mon[34785]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:07.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:06 smithi047 ceph-mon[30960]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:07.293 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:06 smithi114 ceph-mon[34309]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:06 smithi134 ceph-mon[34785]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:08.004 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:07 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:54:08.004 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:07 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:08.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:07 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:54:08.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:07 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:08.245 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:07 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T00:54:08.245 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:07 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:09.020 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:08 smithi114 ceph-mon[34309]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:09.020 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:08 smithi114 ceph-mon[34309]: Deploying daemon osd.7 on smithi114 2024-09-21T00:54:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:08 smithi047 ceph-mon[30960]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:08 smithi047 ceph-mon[30960]: Deploying daemon osd.7 on smithi114 2024-09-21T00:54:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:08 smithi134 ceph-mon[34785]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:08 smithi134 ceph-mon[34785]: Deploying daemon osd.7 on smithi114 2024-09-21T00:54:11.046 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:10 smithi114 ceph-mon[34309]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:11.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:10 smithi047 ceph-mon[30960]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:11.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:10 smithi134 ceph-mon[34785]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:13.176 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:12 smithi114 ceph-mon[34309]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:13.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:12 smithi047 ceph-mon[30960]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:13.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:12 smithi134 ceph-mon[34785]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:13.945 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:13.946 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:13.946 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:14.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:14.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:14.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:14.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:14.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:14.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:15.193 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:14 smithi114 ceph-mon[34309]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:15.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:14 smithi047 ceph-mon[30960]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:14 smithi134 ceph-mon[34785]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:17.051 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:16 smithi114 ceph-mon[34309]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:17.051 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:16 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.051 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:16 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.051 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:16 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:17.051 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:16 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:17.051 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:16 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.091+0000 7fb59e7fc640 1 -- 172.21.15.114:0/735754841 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb5a8063800 con 0x7fb5940b6510 2024-09-21T00:54:17.094 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 7 on host 'smithi114' 2024-09-21T00:54:17.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb5940b6510 msgr2=0x7fb5940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:17.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb5940b6510 0x7fb5940b8a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb59800abe0 tx=0x7fb59800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:54:17.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 msgr2=0x7fb5a8199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:17.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 0x7fb5a8199f90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006010 tx=0x7fb5a4004340 comp rx=0 tx=0).stop 2024-09-21T00:54:17.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 shutdown_connections 2024-09-21T00:54:17.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb5940b6510 0x7fb5940b8a20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:17.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a8109500 0x7fb5a819b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:17.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5a8106ba0 0x7fb5a819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:17.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 --2- 172.21.15.114:0/735754841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a8101b00 0x7fb5a8199f90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:17.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.093+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 >> 172.21.15.114:0/735754841 conn(0x7fb5a80fd770 msgr2=0x7fb5a81079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:17.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.094+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 shutdown_connections 2024-09-21T00:54:17.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:54:17.094+0000 7fb5af49b640 1 -- 172.21.15.114:0/735754841 wait complete. 2024-09-21T00:54:17.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:16 smithi047 ceph-mon[30960]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:17.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:17.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:17.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:16 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:16 smithi134 ceph-mon[34785]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:16 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:17.759 DEBUG:teuthology.orchestra.run.smithi114:osd.7> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T00:54:17.761 INFO:tasks.cephadm:Deploying osd.8 on smithi134 with /dev/vg_nvme/lv_2... 2024-09-21T00:54:17.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T00:54:18.018 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:54:18.048 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:18.048 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:18.048 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:17 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:18.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:17 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:18.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:17 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:18.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:17 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:18.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:17 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:18.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:17 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:18.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:17 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:19.140 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:18 smithi114 ceph-mon[34309]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:19.196 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:18 smithi134 ceph-mon[34785]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:19.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:18 smithi047 ceph-mon[30960]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:19.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 00:54:19 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T00:54:19.390+0000 7f4e50c83640 -1 osd.7 0 log_to_monitors true 2024-09-21T00:54:20.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:19 smithi134 ceph-mon[34785]: from='osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:54:20.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:19 smithi134 ceph-mon[34785]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:54:20.151 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:19 smithi114 ceph-mon[34309]: from='osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:54:20.151 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:19 smithi114 ceph-mon[34309]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:54:20.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:19 smithi047 ceph-mon[30960]: from='osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:54:20.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:19 smithi047 ceph-mon[30960]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T00:54:20.439 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:54:20.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-09-21T00:54:20.721 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:54:21.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:21.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:54:21.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:21.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:21.096 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 -- 172.21.15.134:0/2522429433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1128102640 msgr2=0x7f1128102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:21.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 --2- 172.21.15.134:0/2522429433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1128102640 0x7f1128102ab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1120009900 tx=0x7f112002a480 comp rx=0 tx=0).stop 2024-09-21T00:54:21.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 -- 172.21.15.134:0/2522429433 shutdown_connections 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 --2- 172.21.15.134:0/2522429433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1128104070 0x7f112810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 --2- 172.21.15.134:0/2522429433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11281036d0 0x7f1128103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 --2- 172.21.15.134:0/2522429433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1128102640 0x7f1128102ab0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 -- 172.21.15.134:0/2522429433 >> 172.21.15.134:0/2522429433 conn(0x7f11280fdfb0 msgr2=0x7f1128100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 -- 172.21.15.134:0/2522429433 shutdown_connections 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.192+0000 7f112f1e5640 1 -- 172.21.15.134:0/2522429433 wait complete. 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112f1e5640 1 Processor -- start 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112f1e5640 1 -- start start 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112f1e5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1128102640 0x7f112806b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112f1e5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11281036d0 0x7f112819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112f1e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1128104070 0x7f11281a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:21.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112f1e5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f112810e280 con 0x7f1128104070 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112f1e5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f112810e100 con 0x7f1128102640 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112f1e5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f112810e400 con 0x7f11281036d0 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f1127fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11281036d0 0x7f112819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.193+0000 7f112cf81640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1128102640 0x7f112806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1127fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11281036d0 0x7f112819ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53078/0 (socket says 172.21.15.134:53078) 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1127fff640 1 -- 172.21.15.134:0/4085733769 learned_addr learned my addr 172.21.15.134:0/4085733769 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f112d782640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1128104070 0x7f11281a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1127fff640 1 -- 172.21.15.134:0/4085733769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1128102640 msgr2=0x7f112806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1127fff640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1128102640 0x7f112806b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1127fff640 1 -- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1128104070 msgr2=0x7f11281a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1127fff640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1128104070 0x7f11281a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1127fff640 1 -- 172.21.15.134:0/4085733769 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11281a1ab0 con 0x7f11281036d0 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1127fff640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11281036d0 0x7f112819ed00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f111800cce0 tx=0x7f111800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:21.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1125ffb640 1 -- 172.21.15.134:0/4085733769 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111800f450 con 0x7f11281036d0 2024-09-21T00:54:21.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11281a1da0 con 0x7f11281036d0 2024-09-21T00:54:21.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1125ffb640 1 -- 172.21.15.134:0/4085733769 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f111800faa0 con 0x7f11281036d0 2024-09-21T00:54:21.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.194+0000 7f1125ffb640 1 -- 172.21.15.134:0/4085733769 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118018bf0 con 0x7f11281036d0 2024-09-21T00:54:21.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.195+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11281a2200 con 0x7f11281036d0 2024-09-21T00:54:21.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.196+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1128109820 con 0x7f11281036d0 2024-09-21T00:54:21.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.198+0000 7f1125ffb640 1 -- 172.21.15.134:0/4085733769 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f111800f5f0 con 0x7f11281036d0 2024-09-21T00:54:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.199+0000 7f1125ffb640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11140b6510 0x7f11140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.199+0000 7f1125ffb640 1 -- 172.21.15.134:0/4085733769 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f11180e6f40 con 0x7f11281036d0 2024-09-21T00:54:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.199+0000 7f112cf81640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11140b6510 0x7f11140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:21.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.200+0000 7f112cf81640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11140b6510 0x7f11140b8a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1120000c00 tx=0x7f1120031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:21.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.201+0000 7f1125ffb640 1 -- 172.21.15.134:0/4085733769 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1118014030 con 0x7f11281036d0 2024-09-21T00:54:21.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:21.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:21.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:21.392+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1128063800 con 0x7f11140b6510 2024-09-21T00:54:21.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T00:54:20.946+0000 7f4e4cc05640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T00:54:21.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T00:54:20.961+0000 7f4e48a03640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:21.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:21.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:22.033 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi114 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi114 to 5696M 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] boot 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:54:22.034 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi114 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi114 to 5696M 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] boot 2024-09-21T00:54:22.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:54:22.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:22.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi114 2024-09-21T00:54:22.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi114 to 5696M 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: osd.7 [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] boot 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T00:54:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T00:54:23.010 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:22 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:54:23.010 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:22 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:54:23.010 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:22 smithi134 ceph-mon[34785]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:23.010 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:22 smithi134 ceph-mon[34785]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:23.010 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:22 smithi134 ceph-mon[34785]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T00:54:23.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:22 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:54:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:22 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:54:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:22 smithi047 ceph-mon[30960]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:22 smithi047 ceph-mon[30960]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:22 smithi047 ceph-mon[30960]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T00:54:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:22 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:54:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:22 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:54:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:22 smithi114 ceph-mon[34309]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T00:54:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:22 smithi114 ceph-mon[34309]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:23.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:22 smithi114 ceph-mon[34309]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T00:54:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:24 smithi134 ceph-mon[34785]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:24 smithi134 ceph-mon[34785]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T00:54:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:24 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/3992299418' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"} : dispatch 2024-09-21T00:54:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:24 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"} : dispatch 2024-09-21T00:54:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:24 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"}]': finished 2024-09-21T00:54:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:24 smithi134 ceph-mon[34785]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:54:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:24 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/2330190901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:24.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:24 smithi114 ceph-mon[34309]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:24.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:24 smithi114 ceph-mon[34309]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T00:54:24.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:24 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/3992299418' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"} : dispatch 2024-09-21T00:54:24.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:24 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"} : dispatch 2024-09-21T00:54:24.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:24 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"}]': finished 2024-09-21T00:54:24.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:24 smithi114 ceph-mon[34309]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:54:24.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:24.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:24 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/2330190901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:24 smithi047 ceph-mon[30960]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:24 smithi047 ceph-mon[30960]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T00:54:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:24 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/3992299418' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"} : dispatch 2024-09-21T00:54:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:24 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"} : dispatch 2024-09-21T00:54:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:24 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5c831d8-e430-457b-a42f-2fd18ee686be"}]': finished 2024-09-21T00:54:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:24 smithi047 ceph-mon[30960]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T00:54:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:24 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/2330190901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:26.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:26 smithi134 ceph-mon[34785]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:26.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:26 smithi114 ceph-mon[34309]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:26.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:26 smithi047 ceph-mon[30960]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:28.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:28 smithi134 ceph-mon[34785]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-21T00:54:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:28 smithi114 ceph-mon[34309]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-21T00:54:28.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:28 smithi047 ceph-mon[30960]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-21T00:54:30.705 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:30 smithi134 ceph-mon[34785]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T00:54:30.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:30 smithi114 ceph-mon[34309]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T00:54:30.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:30 smithi047 ceph-mon[30960]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T00:54:32.565 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:32 smithi134 ceph-mon[34785]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:54:32.565 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:32 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:54:32.565 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:32 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:32.565 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:32 smithi134 ceph-mon[34785]: Deploying daemon osd.8 on smithi134 2024-09-21T00:54:32.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:32 smithi114 ceph-mon[34309]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:54:32.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:32 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:54:32.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:32 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:32.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:32 smithi114 ceph-mon[34309]: Deploying daemon osd.8 on smithi134 2024-09-21T00:54:32.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:32 smithi047 ceph-mon[30960]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:54:32.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:32 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T00:54:32.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:32 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:32.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:32 smithi047 ceph-mon[30960]: Deploying daemon osd.8 on smithi134 2024-09-21T00:54:34.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:34 smithi134 ceph-mon[34785]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T00:54:34.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:34 smithi114 ceph-mon[34309]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T00:54:34.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:34 smithi047 ceph-mon[30960]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T00:54:36.567 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:36 smithi134 ceph-mon[34785]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:54:36.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:36 smithi114 ceph-mon[34309]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:54:36.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:36 smithi047 ceph-mon[30960]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T00:54:38.737 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:38 smithi114 ceph-mon[34309]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:54:38.737 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:38 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:38.737 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:38 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:38.737 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:38 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:38.756 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:38 smithi134 ceph-mon[34785]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:54:38.756 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:38 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:38.756 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:38 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:38.756 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:38 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:38.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:38 smithi047 ceph-mon[30960]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:54:38.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:38 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:38.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:38 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:38.758 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:38 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.782 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:40 smithi134 ceph-mon[34785]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:40.782 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.782 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.783 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:40.783 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:40.783 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:40 smithi114 ceph-mon[34309]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:40.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:40.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:40 smithi047 ceph-mon[30960]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:41.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.375+0000 7f1125ffb640 1 -- 172.21.15.134:0/4085733769 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1128063800 con 0x7f11140b6510 2024-09-21T00:54:41.377 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 8 on host 'smithi134' 2024-09-21T00:54:41.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11140b6510 msgr2=0x7f11140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:41.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11140b6510 0x7f11140b8a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1120000c00 tx=0x7f1120031400 comp rx=0 tx=0).stop 2024-09-21T00:54:41.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11281036d0 msgr2=0x7f112819ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:41.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11281036d0 0x7f112819ed00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f111800cce0 tx=0x7f111800a620 comp rx=0 tx=0).stop 2024-09-21T00:54:41.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 shutdown_connections 2024-09-21T00:54:41.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11140b6510 0x7f11140b8a20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1128104070 0x7f11281a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11281036d0 0x7f112819ed00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 --2- 172.21.15.134:0/4085733769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1128102640 0x7f112806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:41.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 >> 172.21.15.134:0/4085733769 conn(0x7f11280fdfb0 msgr2=0x7f11281069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:41.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 shutdown_connections 2024-09-21T00:54:41.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:54:41.379+0000 7f112f1e5640 1 -- 172.21.15.134:0/4085733769 wait complete. 2024-09-21T00:54:41.639 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:41.639 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:41.639 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:41.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:41.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:41.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:41.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:54:41.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:41.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:42.007 DEBUG:teuthology.orchestra.run.smithi134:osd.8> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T00:54:42.009 INFO:tasks.cephadm:Deploying osd.9 on smithi047 with /dev/vg_nvme/lv_1... 2024-09-21T00:54:42.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:54:42.277 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:42.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:42 smithi134 ceph-mon[34785]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:42.685 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:42 smithi047 ceph-mon[30960]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:42 smithi114 ceph-mon[34309]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:43.844 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 00:54:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T00:54:43.548+0000 7f7731a00640 -1 osd.8 0 log_to_monitors true 2024-09-21T00:54:44.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:44 smithi134 ceph-mon[34785]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:44.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:44 smithi134 ceph-mon[34785]: from='osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:54:44.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:44 smithi134 ceph-mon[34785]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:54:44.847 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:44 smithi047 ceph-mon[30960]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:44.847 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:44 smithi047 ceph-mon[30960]: from='osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:54:44.847 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:44 smithi047 ceph-mon[30960]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:54:44.850 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:54:44.875 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi047:vg_nvme/lv_1 2024-09-21T00:54:44.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:44 smithi114 ceph-mon[34309]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:44.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:44 smithi114 ceph-mon[34309]: from='osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:54:44.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:44 smithi114 ceph-mon[34309]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T00:54:45.131 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:54:45.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.597+0000 7f0232147640 1 -- 172.21.15.47:0/997885589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 msgr2=0x7f022c10aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:45.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.597+0000 7f0232147640 1 --2- 172.21.15.47:0/997885589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 0x7f022c10aa50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0224009ca0 tx=0x7f022402a950 comp rx=0 tx=0).stop 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.598+0000 7f0232147640 1 -- 172.21.15.47:0/997885589 shutdown_connections 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.598+0000 7f0232147640 1 --2- 172.21.15.47:0/997885589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 0x7f022c10aa50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.598+0000 7f0232147640 1 --2- 172.21.15.47:0/997885589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022c103710 0x7f022c103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.598+0000 7f0232147640 1 --2- 172.21.15.47:0/997885589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f022c102680 0x7f022c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.598+0000 7f0232147640 1 -- 172.21.15.47:0/997885589 >> 172.21.15.47:0/997885589 conn(0x7f022c0fe010 msgr2=0x7f022c1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.598+0000 7f0232147640 1 -- 172.21.15.47:0/997885589 shutdown_connections 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.598+0000 7f0232147640 1 -- 172.21.15.47:0/997885589 wait complete. 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.598+0000 7f0232147640 1 Processor -- start 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f0232147640 1 -- start start 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f0232147640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022c102680 0x7f022c199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f0232147640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f022c103710 0x7f022c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:45.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f0232147640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 0x7f022c19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f0232147640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10f3f0 con 0x7f022c1040b0 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f0232147640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10f270 con 0x7f022c102680 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f0232147640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10f570 con 0x7f022c103710 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 0x7f022c19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 0x7f022c19b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60080/0 (socket says 172.21.15.47:60080) 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022bfff640 1 -- 172.21.15.47:0/2506663854 learned_addr learned my addr 172.21.15.47:0/2506663854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022affd640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f022c103710 0x7f022c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022b7fe640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022c102680 0x7f022c199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022bfff640 1 -- 172.21.15.47:0/2506663854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f022c103710 msgr2=0x7f022c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022bfff640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f022c103710 0x7f022c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022bfff640 1 -- 172.21.15.47:0/2506663854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022c102680 msgr2=0x7f022c199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022bfff640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022c102680 0x7f022c199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:54:45.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022bfff640 1 -- 172.21.15.47:0/2506663854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c19b9a0 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.599+0000 7f022b7fe640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022c102680 0x7f022c199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.600+0000 7f022bfff640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 0x7f022c19b180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0224006010 tx=0x7f022402fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.600+0000 7f0228ff9640 1 -- 172.21.15.47:0/2506663854 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224034040 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.600+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c19bc30 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.600+0000 7f0228ff9640 1 -- 172.21.15.47:0/2506663854 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02240308f0 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.600+0000 7f0228ff9640 1 -- 172.21.15.47:0/2506663854 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224039450 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.600+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c1a21c0 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.601+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022c109840 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.602+0000 7f0228ff9640 1 -- 172.21.15.47:0/2506663854 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0224037020 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.603+0000 7f0228ff9640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02140b6510 0x7f02140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.603+0000 7f022b7fe640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02140b6510 0x7f02140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.603+0000 7f0228ff9640 1 -- 172.21.15.47:0/2506663854 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5549+0+0 (secure 0 0 0) 0x7f0224107900 con 0x7f022c1040b0 2024-09-21T00:54:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.604+0000 7f022b7fe640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02140b6510 0x7f02140b8a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f021c0058c0 tx=0x7f021c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:54:45.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.608+0000 7f0228ff9640 1 -- 172.21.15.47:0/2506663854 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02240cebc0 con 0x7f022c1040b0 2024-09-21T00:54:45.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:54:45.808+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f022c063800 con 0x7f02140b6510 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi134 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-21T00:54:45.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:45.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:45.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:54:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T00:54:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:54:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:54:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi134 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:45.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi134 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:45.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:54:45.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:54:46.832 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:46.832 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:54:46.832 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='osd.8 ' entity='osd.8' 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T00:54:46.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:46.844 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T00:54:46.416+0000 7f772d982640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T00:54:46.844 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T00:54:46.540+0000 7f7725778640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:54:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:46.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='osd.8 ' entity='osd.8' 2024-09-21T00:54:46.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T00:54:46.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:46 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:54:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T00:54:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:54:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:54:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:54:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='osd.8 ' entity='osd.8' 2024-09-21T00:54:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T00:54:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:46 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:47.778 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:47 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:54:47.778 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:47 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:54:47.778 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:47.778 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:47 smithi047 ceph-mon[30960]: osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] boot 2024-09-21T00:54:47.778 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:47 smithi047 ceph-mon[30960]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T00:54:47.778 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:47 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:54:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:47 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:54:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:47 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:47 smithi134 ceph-mon[34785]: osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] boot 2024-09-21T00:54:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:47 smithi134 ceph-mon[34785]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T00:54:47.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:47 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:47.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:47 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:54:47.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:47 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:54:47.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:47 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:47.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:47 smithi114 ceph-mon[34309]: osd.8 [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] boot 2024-09-21T00:54:47.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:47 smithi114 ceph-mon[34309]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T00:54:47.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:47 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T00:54:48.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:48 smithi134 ceph-mon[34785]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:48.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:48 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1084449276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3820216c-43ae-4cab-8f20-487787f5fa2c"} : dispatch 2024-09-21T00:54:48.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:48 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1084449276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3820216c-43ae-4cab-8f20-487787f5fa2c"}]': finished 2024-09-21T00:54:48.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:48 smithi134 ceph-mon[34785]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:54:48.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:48 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:54:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:48 smithi114 ceph-mon[34309]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:48 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1084449276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3820216c-43ae-4cab-8f20-487787f5fa2c"} : dispatch 2024-09-21T00:54:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:48 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1084449276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3820216c-43ae-4cab-8f20-487787f5fa2c"}]': finished 2024-09-21T00:54:48.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:48 smithi114 ceph-mon[34309]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:54:48.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:48 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:54:48.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:48 smithi047 ceph-mon[30960]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-21T00:54:48.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:48 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1084449276' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3820216c-43ae-4cab-8f20-487787f5fa2c"} : dispatch 2024-09-21T00:54:48.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:48 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1084449276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3820216c-43ae-4cab-8f20-487787f5fa2c"}]': finished 2024-09-21T00:54:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:48 smithi047 ceph-mon[30960]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T00:54:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:48 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:54:49.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:49 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/550153687' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:49.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:49 smithi134 ceph-mon[34785]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:54:49.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:49 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:54:49.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:49 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/550153687' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:49.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:49 smithi114 ceph-mon[34309]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:54:49.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:49 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:54:49.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:49 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/550153687' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:54:49.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:49 smithi047 ceph-mon[30960]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T00:54:49.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:49 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:54:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:50 smithi134 ceph-mon[34785]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:54:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:50 smithi114 ceph-mon[34309]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:54:50.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:50 smithi047 ceph-mon[30960]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:54:52.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:52 smithi134 ceph-mon[34785]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:54:52.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:52 smithi114 ceph-mon[34309]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:54:52.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:52 smithi047 ceph-mon[30960]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:54:54.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:54 smithi134 ceph-mon[34785]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:54:54.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:54 smithi047 ceph-mon[30960]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:54:54.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:54 smithi114 ceph-mon[34309]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T00:54:56.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:56 smithi047 ceph-mon[30960]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:54:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:56 smithi134 ceph-mon[34785]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:54:56.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:56 smithi114 ceph-mon[34309]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T00:54:57.634 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:54:57.634 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:57.634 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:57 smithi047 ceph-mon[30960]: Deploying daemon osd.9 on smithi047 2024-09-21T00:54:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:54:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:57 smithi134 ceph-mon[34785]: Deploying daemon osd.9 on smithi047 2024-09-21T00:54:57.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T00:54:57.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:54:57.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:57 smithi114 ceph-mon[34309]: Deploying daemon osd.9 on smithi047 2024-09-21T00:54:58.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:54:58 smithi134 ceph-mon[34785]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T00:54:58.849 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:54:58 smithi047 ceph-mon[30960]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T00:54:58.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:54:58 smithi114 ceph-mon[34309]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T00:55:00.566 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:00 smithi047 ceph-mon[30960]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:55:00.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:00 smithi134 ceph-mon[34785]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:55:00.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:00 smithi114 ceph-mon[34309]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T00:55:02.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:02 smithi047 ceph-mon[30960]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:02.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:02 smithi134 ceph-mon[34785]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:02.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:02 smithi114 ceph-mon[34309]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:03.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:03 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:03.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:03 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:03.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:03 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:03.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:03 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:03.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:03 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:03.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:03 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:03.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:03 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:03.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:03 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:03.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:03 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:04.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:04 smithi047 ceph-mon[30960]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:05.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:04 smithi134 ceph-mon[34785]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:05.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:04 smithi114 ceph-mon[34309]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.424+0000 7f0228ff9640 1 -- 172.21.15.47:0/2506663854 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f022c063800 con 0x7f02140b6510 2024-09-21T00:55:06.425 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 9 on host 'smithi047' 2024-09-21T00:55:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02140b6510 msgr2=0x7f02140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02140b6510 0x7f02140b8a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f021c0058c0 tx=0x7f021c005850 comp rx=0 tx=0).stop 2024-09-21T00:55:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 msgr2=0x7f022c19b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 0x7f022c19b180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0224006010 tx=0x7f022402fc00 comp rx=0 tx=0).stop 2024-09-21T00:55:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 shutdown_connections 2024-09-21T00:55:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02140b6510 0x7f02140b8a20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f022c1040b0 0x7f022c19b180 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f022c103710 0x7f022c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 --2- 172.21.15.47:0/2506663854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022c102680 0x7f022c199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 >> 172.21.15.47:0/2506663854 conn(0x7f022c0fe010 msgr2=0x7f022c106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 shutdown_connections 2024-09-21T00:55:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:06.426+0000 7f0232147640 1 -- 172.21.15.47:0/2506663854 wait complete. 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:07.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.099 DEBUG:teuthology.orchestra.run.smithi047:osd.9> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T00:55:07.102 INFO:tasks.cephadm:Deploying osd.10 on smithi114 with /dev/vg_nvme/lv_1... 2024-09-21T00:55:07.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:55:07.129 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:07.130 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.130 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.130 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:07.130 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:07.130 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.130 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:07.130 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.130 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:07.358 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:55:08.859 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:08 smithi114 ceph-mon[34309]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:08.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:08 smithi047 ceph-mon[30960]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:08.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 00:55:08 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T00:55:08.690+0000 7f987faf9640 -1 osd.9 0 log_to_monitors true 2024-09-21T00:55:09.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:08 smithi134 ceph-mon[34785]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:09.891 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:09 smithi047 ceph-mon[30960]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:55:09.891 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:09 smithi047 ceph-mon[30960]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:55:09.891 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:09 smithi047 ceph-mon[30960]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T00:55:09.891 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:09 smithi047 ceph-mon[30960]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:55:09.891 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:09 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:09.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:09 smithi114 ceph-mon[34309]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:55:09.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:09 smithi114 ceph-mon[34309]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:55:09.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:09 smithi114 ceph-mon[34309]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T00:55:09.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:09 smithi114 ceph-mon[34309]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:55:09.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:09 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:09.917 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-21T00:55:09.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi114:vg_nvme/lv_1 2024-09-21T00:55:10.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:09 smithi134 ceph-mon[34785]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T00:55:10.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:09 smithi134 ceph-mon[34785]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T00:55:10.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:09 smithi134 ceph-mon[34785]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T00:55:10.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:09 smithi134 ceph-mon[34785]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]} : dispatch 2024-09-21T00:55:10.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:09 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T00:55:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 -- 172.21.15.114:0/2864346438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 msgr2=0x7f1688076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2864346438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 0x7f1688076100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f167c009930 tx=0x7f167c02a420 comp rx=0 tx=0).stop 2024-09-21T00:55:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 -- 172.21.15.114:0/2864346438 shutdown_connections 2024-09-21T00:55:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2864346438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f168810fee0 0x7f1688112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2864346438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 0x7f1688076100 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2864346438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16880770e0 0x7f16880757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 -- 172.21.15.114:0/2864346438 >> 172.21.15.114:0/2864346438 conn(0x7f16880ff0c0 msgr2=0x7f1688101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 -- 172.21.15.114:0/2864346438 shutdown_connections 2024-09-21T00:55:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.726+0000 7f168fcf1640 1 -- 172.21.15.114:0/2864346438 wait complete. 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168fcf1640 1 Processor -- start 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168fcf1640 1 -- start start 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168fcf1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 0x7f16881a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168fcf1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16880770e0 0x7f16881a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168fcf1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f168810fee0 0x7f16881a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168fcf1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1688115980 con 0x7f16880770e0 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168fcf1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1688115800 con 0x7f1688075cf0 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168fcf1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1688115b00 con 0x7f168810fee0 2024-09-21T00:55:10.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168da8d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 0x7f16881a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168da8d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 0x7f16881a05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60604/0 (socket says 172.21.15.114:60604) 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168da8d640 1 -- 172.21.15.114:0/2305325017 learned_addr learned my addr 172.21.15.114:0/2305325017 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168d28c640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16880770e0 0x7f16881a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.727+0000 7f168e28e640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f168810fee0 0x7f16881a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f168da8d640 1 -- 172.21.15.114:0/2305325017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f168810fee0 msgr2=0x7f16881a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f168da8d640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f168810fee0 0x7f16881a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f168da8d640 1 -- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16880770e0 msgr2=0x7f16881a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f168da8d640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16880770e0 0x7f16881a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f168da8d640 1 -- 172.21.15.114:0/2305325017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16881a1fd0 con 0x7f1688075cf0 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f168da8d640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 0x7f16881a05a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f167800ebc0 tx=0x7f167800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f1686ffd640 1 -- 172.21.15.114:0/2305325017 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678010630 con 0x7f1688075cf0 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f1686ffd640 1 -- 172.21.15.114:0/2305325017 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1678010c80 con 0x7f1688075cf0 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16881a22c0 con 0x7f1688075cf0 2024-09-21T00:55:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f1686ffd640 1 -- 172.21.15.114:0/2305325017 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678018b60 con 0x7f1688075cf0 2024-09-21T00:55:10.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.728+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16881a89c0 con 0x7f1688075cf0 2024-09-21T00:55:10.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.729+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1688105f70 con 0x7f1688075cf0 2024-09-21T00:55:10.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.731+0000 7f1686ffd640 1 -- 172.21.15.114:0/2305325017 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f1678018d00 con 0x7f1688075cf0 2024-09-21T00:55:10.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.731+0000 7f1686ffd640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f16700b6510 0x7f16700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:10.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.732+0000 7f168d28c640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f16700b6510 0x7f16700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:10.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.732+0000 7f1686ffd640 1 -- 172.21.15.114:0/2305325017 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5981+0+0 (secure 0 0 0) 0x7f16780e7480 con 0x7f1688075cf0 2024-09-21T00:55:10.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.732+0000 7f168d28c640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f16700b6510 0x7f16700b8a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f167c009900 tx=0x7f167c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.735+0000 7f1686ffd640 1 -- 172.21.15.114:0/2305325017 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16780b2a10 con 0x7f1688075cf0 2024-09-21T00:55:10.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi047 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi047 to 4273M 2024-09-21T00:55:10.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:10.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:10 smithi114 ceph-mon[34309]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' 2024-09-21T00:55:10.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:10.926+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1688063800 con 0x7f16700b6510 2024-09-21T00:55:10.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:10.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:55:10.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T00:55:10.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:10.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:10.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi047 2024-09-21T00:55:10.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:10.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi047 to 4273M 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:10.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-mon[30960]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' 2024-09-21T00:55:10.957 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T00:55:10.573+0000 7f987c290640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T00:55:10.957 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 00:55:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T00:55:10.588+0000 7f9873871640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:55:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-21T00:55:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T00:55:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi047 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi047 to 4273M 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:11.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:10 smithi134 ceph-mon[34785]: from='osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370]' entity='osd.9' 2024-09-21T00:55:11.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:55:11.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:55:11.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:11.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:11.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:55:11.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:55:11.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:11.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] boot 2024-09-21T00:55:11.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T00:55:11.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:11 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:12.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:55:12.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:55:12.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:12.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:12.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:55:12.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:55:12.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:12.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] boot 2024-09-21T00:55:12.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T00:55:12.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:11 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: osd.9 [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] boot 2024-09-21T00:55:12.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T00:55:12.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:11 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T00:55:12.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:12 smithi114 ceph-mon[34309]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:12.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:12 smithi114 ceph-mon[34309]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T00:55:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:12 smithi134 ceph-mon[34785]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:12 smithi134 ceph-mon[34785]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T00:55:13.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:12 smithi047 ceph-mon[30960]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T00:55:13.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:12 smithi047 ceph-mon[30960]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T00:55:13.880 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:13 smithi114 ceph-mon[34309]: from='client.? 172.21.15.114:0/528847375' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"} : dispatch 2024-09-21T00:55:13.880 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:13 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"} : dispatch 2024-09-21T00:55:13.880 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:13 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"}]': finished 2024-09-21T00:55:13.880 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:13 smithi114 ceph-mon[34309]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:55:13.881 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:13 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:13 smithi134 ceph-mon[34785]: from='client.? 172.21.15.114:0/528847375' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"} : dispatch 2024-09-21T00:55:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:13 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"} : dispatch 2024-09-21T00:55:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:13 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"}]': finished 2024-09-21T00:55:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:13 smithi134 ceph-mon[34785]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:55:14.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:13 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:14.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:13 smithi047 ceph-mon[30960]: from='client.? 172.21.15.114:0/528847375' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"} : dispatch 2024-09-21T00:55:14.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:13 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"} : dispatch 2024-09-21T00:55:14.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:13 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b2e5646-7db2-41ad-9b2d-ca7c7377466d"}]': finished 2024-09-21T00:55:14.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:13 smithi047 ceph-mon[30960]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T00:55:14.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:13 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:15.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:14 smithi134 ceph-mon[34785]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:15.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:14 smithi134 ceph-mon[34785]: from='client.? 172.21.15.114:0/4278044595' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:55:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:14 smithi114 ceph-mon[34309]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:14 smithi114 ceph-mon[34309]: from='client.? 172.21.15.114:0/4278044595' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:55:15.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:14 smithi047 ceph-mon[30960]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:15.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:14 smithi047 ceph-mon[30960]: from='client.? 172.21.15.114:0/4278044595' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:55:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:16 smithi134 ceph-mon[34785]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:16 smithi114 ceph-mon[34309]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:17.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:16 smithi047 ceph-mon[30960]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:18.865 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:18 smithi114 ceph-mon[34309]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:19.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:18 smithi134 ceph-mon[34785]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:19.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:18 smithi047 ceph-mon[30960]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:20.858 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:20 smithi114 ceph-mon[34309]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:21.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:20 smithi134 ceph-mon[34785]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:21.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:20 smithi047 ceph-mon[30960]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:21.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:55:21.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:22.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:55:22.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:22.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T00:55:22.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:23.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:22 smithi134 ceph-mon[34785]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:23.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:22 smithi134 ceph-mon[34785]: Deploying daemon osd.10 on smithi114 2024-09-21T00:55:23.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:22 smithi114 ceph-mon[34309]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:23.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:22 smithi114 ceph-mon[34309]: Deploying daemon osd.10 on smithi114 2024-09-21T00:55:23.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:22 smithi047 ceph-mon[30960]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:23.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:22 smithi047 ceph-mon[30960]: Deploying daemon osd.10 on smithi114 2024-09-21T00:55:25.041 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:24 smithi114 ceph-mon[34309]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:24 smithi134 ceph-mon[34785]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:25.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:24 smithi047 ceph-mon[30960]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:27.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:26 smithi134 ceph-mon[34785]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:27.132 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:26 smithi114 ceph-mon[34309]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:27.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:26 smithi047 ceph-mon[30960]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:28.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:28.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:28.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:28.108 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:28.108 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:28.108 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:28.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:28.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:28.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:29.039 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:28 smithi114 ceph-mon[34309]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:29.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:28 smithi134 ceph-mon[34785]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:29.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:28 smithi047 ceph-mon[30960]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:30.898 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:30 smithi114 ceph-mon[34309]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:30.898 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:30.899 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:30.899 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:30.899 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:30.899 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:30 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:30.944 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 10 on host 'smithi114' 2024-09-21T00:55:30.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.943+0000 7f1686ffd640 1 -- 172.21.15.114:0/2305325017 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1688063800 con 0x7f16700b6510 2024-09-21T00:55:30.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.945+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f16700b6510 msgr2=0x7f16700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:30.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.945+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f16700b6510 0x7f16700b8a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f167c009900 tx=0x7f167c000bc0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.945+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 msgr2=0x7f16881a05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 0x7f16881a05a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f167800ebc0 tx=0x7f167800c6a0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 shutdown_connections 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f16700b6510 0x7f16700b8a20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f168810fee0 0x7f16881a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16880770e0 0x7f16881a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 --2- 172.21.15.114:0/2305325017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1688075cf0 0x7f16881a05a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 >> 172.21.15.114:0/2305325017 conn(0x7f16880ff0c0 msgr2=0x7f1688103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 shutdown_connections 2024-09-21T00:55:30.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-21T00:55:30.946+0000 7f168fcf1640 1 -- 172.21.15.114:0/2305325017 wait complete. 2024-09-21T00:55:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:30 smithi134 ceph-mon[34785]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:31.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:30 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:30 smithi047 ceph-mon[30960]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:31.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:31.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:31.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:30 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.595 DEBUG:teuthology.orchestra.run.smithi114:osd.10> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T00:55:31.597 INFO:tasks.cephadm:Deploying osd.11 on smithi134 with /dev/vg_nvme/lv_1... 2024-09-21T00:55:31.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T00:55:31.856 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:55:31.893 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:31.893 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.893 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.976 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:31.976 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:31.976 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:32.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:32.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:32.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:33.012 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:32 smithi114 ceph-mon[34309]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:33.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:32 smithi047 ceph-mon[30960]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:33.269 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:32 smithi134 ceph-mon[34785]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:33.711 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 00:55:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T00:55:33.434+0000 7fa75e111640 -1 osd.10 0 log_to_monitors true 2024-09-21T00:55:34.040 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:33 smithi114 ceph-mon[34309]: from='osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:55:34.040 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:33 smithi114 ceph-mon[34309]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:55:34.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:33 smithi047 ceph-mon[30960]: from='osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:55:34.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:33 smithi047 ceph-mon[30960]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:55:34.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:33 smithi134 ceph-mon[34785]: from='osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:55:34.303 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:33 smithi134 ceph-mon[34785]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T00:55:34.306 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T00:55:34.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi134:vg_nvme/lv_1 2024-09-21T00:55:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:55:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 -- 172.21.15.134:0/847301166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a4106900 msgr2=0x7f95a4108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 --2- 172.21.15.134:0/847301166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a4106900 0x7f95a4108d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f958c009900 tx=0x7f958c02a410 comp rx=0 tx=0).stop 2024-09-21T00:55:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 -- 172.21.15.134:0/847301166 shutdown_connections 2024-09-21T00:55:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 --2- 172.21.15.134:0/847301166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a41094a0 0x7f95a410b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 --2- 172.21.15.134:0/847301166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a4106900 0x7f95a4108d60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 --2- 172.21.15.134:0/847301166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a406c640 0x7f95a41063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 -- 172.21.15.134:0/847301166 >> 172.21.15.134:0/847301166 conn(0x7f95a40fe000 msgr2=0x7f95a4100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:35.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 -- 172.21.15.134:0/847301166 shutdown_connections 2024-09-21T00:55:35.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.066+0000 7f95a90ee640 1 -- 172.21.15.134:0/847301166 wait complete. 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a90ee640 1 Processor -- start 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a90ee640 1 -- start start 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a90ee640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a406c640 0x7f95a419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a90ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a4106900 0x7f95a419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a90ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a41094a0 0x7f95a419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a90ee640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410f430 con 0x7f95a41094a0 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a90ee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410f2b0 con 0x7f95a4106900 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a90ee640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410f5b0 con 0x7f95a406c640 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a406c640 0x7f95a419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a406c640 0x7f95a419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52222/0 (socket says 172.21.15.134:52222) 2024-09-21T00:55:35.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.067+0000 7f95a2d9d640 1 -- 172.21.15.134:0/4194428186 learned_addr learned my addr 172.21.15.134:0/4194428186 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a259c640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a4106900 0x7f95a419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a359e640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a41094a0 0x7f95a419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a2d9d640 1 -- 172.21.15.134:0/4194428186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a4106900 msgr2=0x7f95a419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a2d9d640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a4106900 0x7f95a419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a2d9d640 1 -- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a41094a0 msgr2=0x7f95a419b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a2d9d640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a41094a0 0x7f95a419b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a2d9d640 1 -- 172.21.15.134:0/4194428186 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a419bab0 con 0x7f95a406c640 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a359e640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a41094a0 0x7f95a419b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a2d9d640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a406c640 0x7f95a419a080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f959c00e9f0 tx=0x7f959c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f959bfff640 1 -- 172.21.15.134:0/4194428186 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c00cd80 con 0x7f95a406c640 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a419bda0 con 0x7f95a406c640 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f959bfff640 1 -- 172.21.15.134:0/4194428186 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f959c0108e0 con 0x7f95a406c640 2024-09-21T00:55:35.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f959bfff640 1 -- 172.21.15.134:0/4194428186 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c018980 con 0x7f95a406c640 2024-09-21T00:55:35.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.068+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a41a24a0 con 0x7f95a406c640 2024-09-21T00:55:35.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.070+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a40ffb20 con 0x7f95a406c640 2024-09-21T00:55:35.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.071+0000 7f959bfff640 1 -- 172.21.15.134:0/4194428186 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f959c010430 con 0x7f95a406c640 2024-09-21T00:55:35.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.072+0000 7f959bfff640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f95900b6510 0x7f95900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:35.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.072+0000 7f959bfff640 1 -- 172.21.15.134:0/4194428186 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6414+0+0 (secure 0 0 0) 0x7f959c0e7430 con 0x7f95a406c640 2024-09-21T00:55:35.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.072+0000 7f95a259c640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f95900b6510 0x7f95900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:35.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.073+0000 7f95a259c640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f95900b6510 0x7f95900b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f958c000c00 tx=0x7f958c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:35.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.075+0000 7f959bfff640 1 -- 172.21.15.134:0/4194428186 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f959c0ae430 con 0x7f95a406c640 2024-09-21T00:55:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:55:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T00:55:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:55:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:55:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:35.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:35.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:35.269+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f95a4063800 con 0x7f95900b6510 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.271 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:35.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:35.272 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T00:55:34.956+0000 7fa75a093640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T00:55:35.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T00:55:34.970+0000 7fa755e91640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:35.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:35.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:35.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:35.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi114 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi114 to 4272M 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:55:36.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:36.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi114 2024-09-21T00:55:36.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi114 to 4272M 2024-09-21T00:55:36.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:55:36.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T00:55:36.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:36.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:36.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:55:36.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:55:36.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi114 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi114 to 4272M 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T00:55:36.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:37.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:36 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:55:37.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:36 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:55:37.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:36 smithi134 ceph-mon[34785]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:37.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:36 smithi134 ceph-mon[34785]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:37.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:36 smithi134 ceph-mon[34785]: osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] boot 2024-09-21T00:55:37.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:36 smithi134 ceph-mon[34785]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:55:37.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:36 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:37.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:36 smithi134 ceph-mon[34785]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T00:55:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:36 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:55:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:36 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:55:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:36 smithi114 ceph-mon[34309]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:36 smithi114 ceph-mon[34309]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:36 smithi114 ceph-mon[34309]: osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] boot 2024-09-21T00:55:37.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:36 smithi114 ceph-mon[34309]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:55:37.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:36 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:37.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:36 smithi114 ceph-mon[34309]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T00:55:37.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:36 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:55:37.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:36 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:55:37.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:36 smithi047 ceph-mon[30960]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T00:55:37.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:36 smithi047 ceph-mon[30960]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:55:37.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:36 smithi047 ceph-mon[30960]: osd.10 [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] boot 2024-09-21T00:55:37.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:36 smithi047 ceph-mon[30960]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T00:55:37.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:36 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T00:55:37.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:36 smithi047 ceph-mon[30960]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T00:55:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:38 smithi134 ceph-mon[34785]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:38 smithi134 ceph-mon[34785]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T00:55:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:38 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/3318651641' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"} : dispatch 2024-09-21T00:55:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:38 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"} : dispatch 2024-09-21T00:55:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:38 smithi134 ceph-mon[34785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"}]': finished 2024-09-21T00:55:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:38 smithi134 ceph-mon[34785]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:55:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:38 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:55:38.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:38 smithi134 ceph-mon[34785]: from='client.? 172.21.15.134:0/2114969559' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:55:38.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:38 smithi114 ceph-mon[34309]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:38.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:38 smithi114 ceph-mon[34309]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T00:55:38.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:38 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/3318651641' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"} : dispatch 2024-09-21T00:55:38.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:38 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"} : dispatch 2024-09-21T00:55:38.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:38 smithi114 ceph-mon[34309]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"}]': finished 2024-09-21T00:55:38.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:38 smithi114 ceph-mon[34309]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:55:38.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:38 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:55:38.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:38 smithi114 ceph-mon[34309]: from='client.? 172.21.15.134:0/2114969559' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:55:38.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:38 smithi047 ceph-mon[30960]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:38.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:38 smithi047 ceph-mon[30960]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T00:55:38.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:38 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/3318651641' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"} : dispatch 2024-09-21T00:55:38.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:38 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"} : dispatch 2024-09-21T00:55:38.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:38 smithi047 ceph-mon[30960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78c28fc6-4934-498a-8600-d78cf377eb4a"}]': finished 2024-09-21T00:55:38.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:38 smithi047 ceph-mon[30960]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T00:55:38.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:38 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:55:38.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:38 smithi047 ceph-mon[30960]: from='client.? 172.21.15.134:0/2114969559' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T00:55:40.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:40 smithi047 ceph-mon[30960]: pgmap v243: 1 pgs: 1 peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:40 smithi134 ceph-mon[34785]: pgmap v243: 1 pgs: 1 peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:40 smithi114 ceph-mon[34309]: pgmap v243: 1 pgs: 1 peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:42 smithi134 ceph-mon[34785]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:42 smithi114 ceph-mon[34309]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:42.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:42 smithi047 ceph-mon[30960]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:44.579 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:44 smithi134 ceph-mon[34785]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T00:55:44.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:44 smithi114 ceph-mon[34309]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T00:55:44.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:44 smithi047 ceph-mon[30960]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T00:55:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:46 smithi134 ceph-mon[34785]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:55:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:46 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:55:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:46 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:46 smithi134 ceph-mon[34785]: Deploying daemon osd.11 on smithi134 2024-09-21T00:55:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:46 smithi114 ceph-mon[34309]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:55:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:46 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:55:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:46 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:46 smithi114 ceph-mon[34309]: Deploying daemon osd.11 on smithi134 2024-09-21T00:55:46.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:46 smithi047 ceph-mon[30960]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T00:55:46.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T00:55:46.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:46 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:46.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:46 smithi047 ceph-mon[30960]: Deploying daemon osd.11 on smithi134 2024-09-21T00:55:48.838 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:48 smithi134 ceph-mon[34785]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T00:55:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:48 smithi114 ceph-mon[34309]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T00:55:48.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:48 smithi047 ceph-mon[30960]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T00:55:50.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:50 smithi134 ceph-mon[34785]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:55:50.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:50 smithi047 ceph-mon[30960]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:55:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:50 smithi114 ceph-mon[34309]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T00:55:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:51 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:51.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:51.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:51.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:51 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:51.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:51.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:51.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:51 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:52.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:52 smithi134 ceph-mon[34785]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:52.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:52 smithi114 ceph-mon[34309]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:52.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:52 smithi047 ceph-mon[30960]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:54.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.645+0000 7f959bfff640 1 -- 172.21.15.134:0/4194428186 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f95a4063800 con 0x7f95900b6510 2024-09-21T00:55:54.646 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 11 on host 'smithi134' 2024-09-21T00:55:54.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f95900b6510 msgr2=0x7f95900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:54.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f95900b6510 0x7f95900b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f958c000c00 tx=0x7f958c031400 comp rx=0 tx=0).stop 2024-09-21T00:55:54.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a406c640 msgr2=0x7f95a419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:54.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a406c640 0x7f95a419a080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f959c00e9f0 tx=0x7f959c00eeb0 comp rx=0 tx=0).stop 2024-09-21T00:55:54.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 shutdown_connections 2024-09-21T00:55:54.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f95900b6510 0x7f95900b8a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:54.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95a41094a0 0x7f95a419b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:54.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a4106900 0x7f95a419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:54.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 --2- 172.21.15.134:0/4194428186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a406c640 0x7f95a419a080 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:54.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 >> 172.21.15.134:0/4194428186 conn(0x7f95a40fe000 msgr2=0x7f95a4104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:54.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 shutdown_connections 2024-09-21T00:55:54.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:55:54.647+0000 7f95a90ee640 1 -- 172.21.15.134:0/4194428186 wait complete. 2024-09-21T00:55:55.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:55.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.304 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:55.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:55.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:55.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.305 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.331 DEBUG:teuthology.orchestra.run.smithi134:osd.11> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T00:55:55.333 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T00:55:55.333 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:55:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T00:55:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:55.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:55.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:55:55.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:55.604 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:56.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 -- 172.21.15.47:0/1334332313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280103700 msgr2=0x7f0280103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:56.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 --2- 172.21.15.47:0/1334332313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280103700 0x7f0280103b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0268009900 tx=0x7f026802a480 comp rx=0 tx=0).stop 2024-09-21T00:55:56.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 -- 172.21.15.47:0/1334332313 shutdown_connections 2024-09-21T00:55:56.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 --2- 172.21.15.47:0/1334332313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02801040a0 0x7f028010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 --2- 172.21.15.47:0/1334332313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280103700 0x7f0280103b10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 --2- 172.21.15.47:0/1334332313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0280102670 0x7f0280102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 -- 172.21.15.47:0/1334332313 >> 172.21.15.47:0/1334332313 conn(0x7f02800fdfe0 msgr2=0x7f0280100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:56.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 -- 172.21.15.47:0/1334332313 shutdown_connections 2024-09-21T00:55:56.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.080+0000 7f02854a1640 1 -- 172.21.15.47:0/1334332313 wait complete. 2024-09-21T00:55:56.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02854a1640 1 Processor -- start 2024-09-21T00:55:56.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02854a1640 1 -- start start 2024-09-21T00:55:56.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02854a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280102670 0x7f0280106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:56.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02854a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0280103700 0x7f0280104b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:56.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02854a1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02801040a0 0x7f0280105050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:56.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02854a1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f028010e2a0 con 0x7f0280102670 2024-09-21T00:55:56.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02854a1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f028010e120 con 0x7f02801040a0 2024-09-21T00:55:56.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02854a1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f028010e420 con 0x7f0280103700 2024-09-21T00:55:56.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f027effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280102670 0x7f0280106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:56.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f027effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280102670 0x7f0280106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48532/0 (socket says 172.21.15.47:48532) 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f027effd640 1 -- 172.21.15.47:0/4226141272 learned_addr learned my addr 172.21.15.47:0/4226141272 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.081+0000 7f02767fc640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0280103700 0x7f0280104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027f7fe640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02801040a0 0x7f0280105050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027effd640 1 -- 172.21.15.47:0/4226141272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0280103700 msgr2=0x7f0280104b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027effd640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0280103700 0x7f0280104b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027effd640 1 -- 172.21.15.47:0/4226141272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02801040a0 msgr2=0x7f0280105050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027effd640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02801040a0 0x7f0280105050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027effd640 1 -- 172.21.15.47:0/4226141272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0280105750 con 0x7f0280102670 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027f7fe640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02801040a0 0x7f0280105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027effd640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280102670 0x7f0280106240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f027000d950 tx=0x7f027000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027cff9640 1 -- 172.21.15.47:0/4226141272 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270017070 con 0x7f0280102670 2024-09-21T00:55:56.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02801a4040 con 0x7f0280102670 2024-09-21T00:55:56.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027cff9640 1 -- 172.21.15.47:0/4226141272 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0270009c30 con 0x7f0280102670 2024-09-21T00:55:56.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f027cff9640 1 -- 172.21.15.47:0/4226141272 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027000f620 con 0x7f0280102670 2024-09-21T00:55:56.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.082+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02801a44a0 con 0x7f0280102670 2024-09-21T00:55:56.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.083+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02801a4700 con 0x7f0280102670 2024-09-21T00:55:56.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.085+0000 7f027cff9640 1 -- 172.21.15.47:0/4226141272 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0270010460 con 0x7f0280102670 2024-09-21T00:55:56.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.086+0000 7f027cff9640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f026c0b6510 0x7f026c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:56.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.086+0000 7f02767fc640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f026c0b6510 0x7f026c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:56.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.086+0000 7f027cff9640 1 -- 172.21.15.47:0/4226141272 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6809+0+0 (secure 0 0 0) 0x7f02700e69e0 con 0x7f0280102670 2024-09-21T00:55:56.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.087+0000 7f02767fc640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f026c0b6510 0x7f026c0b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0268000c00 tx=0x7f0268031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:56.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.089+0000 7f027cff9640 1 -- 172.21.15.47:0/4226141272 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02700ad7b0 con 0x7f0280102670 2024-09-21T00:55:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.276+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f02801a48d0 con 0x7f0280102670 2024-09-21T00:55:56.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.276+0000 7f027cff9640 1 -- 172.21.15.47:0/4226141272 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f0270009de0 con 0x7f0280102670 2024-09-21T00:55:56.277 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:55:56.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f026c0b6510 msgr2=0x7f026c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:56.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f026c0b6510 0x7f026c0b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0268000c00 tx=0x7f0268031400 comp rx=0 tx=0).stop 2024-09-21T00:55:56.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280102670 msgr2=0x7f0280106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:56.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280102670 0x7f0280106240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f027000d950 tx=0x7f027000de10 comp rx=0 tx=0).stop 2024-09-21T00:55:56.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 shutdown_connections 2024-09-21T00:55:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f026c0b6510 0x7f026c0b8a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02801040a0 0x7f0280105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0280103700 0x7f0280104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 --2- 172.21.15.47:0/4226141272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0280102670 0x7f0280106240 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 >> 172.21.15.47:0/4226141272 conn(0x7f02800fdfe0 msgr2=0x7f02800ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.279+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 shutdown_connections 2024-09-21T00:55:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:56.280+0000 7f02854a1640 1 -- 172.21.15.47:0/4226141272 wait complete. 2024-09-21T00:55:56.975 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726880135,"num_in_osds":12,"osd_in_since":1726880137,"num_remapped_pgs":0} 2024-09-21T00:55:57.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:56 smithi134 ceph-mon[34785]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:57.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:56 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4226141272' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:55:57.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:56 smithi047 ceph-mon[30960]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:57.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:56 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4226141272' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:55:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:56 smithi114 ceph-mon[34309]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:57.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:56 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4226141272' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:55:57.595 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 00:55:57 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T00:55:57.337+0000 7f47ed3ee640 -1 osd.11 0 log_to_monitors true 2024-09-21T00:55:57.976 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:55:58.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:57 smithi047 ceph-mon[30960]: from='osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:55:58.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:57 smithi047 ceph-mon[30960]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:55:58.239 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:55:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:57 smithi134 ceph-mon[34785]: from='osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:55:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:57 smithi134 ceph-mon[34785]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:55:58.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:57 smithi114 ceph-mon[34309]: from='osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:55:58.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:57 smithi114 ceph-mon[34309]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 -- 172.21.15.47:0/3920250052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 msgr2=0x7fdcbc104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3920250052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 0x7fdcbc104bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009900 tx=0x7fdcac02a480 comp rx=0 tx=0).stop 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 -- 172.21.15.47:0/3920250052 shutdown_connections 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3920250052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcbc105180 0x7fdcbc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3920250052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 0x7fdcbc104bf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3920250052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcbc103750 0x7fdcbc103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 -- 172.21.15.47:0/3920250052 >> 172.21.15.47:0/3920250052 conn(0x7fdcbc0ff0c0 msgr2=0x7fdcbc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 -- 172.21.15.47:0/3920250052 shutdown_connections 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 -- 172.21.15.47:0/3920250052 wait complete. 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.712+0000 7fdcc4162640 1 Processor -- start 2024-09-21T00:55:58.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc4162640 1 -- start start 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc4162640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcbc103750 0x7fdcbc19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc4162640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 0x7fdcbc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc4162640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcbc105180 0x7fdcbc19b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc4162640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc10f400 con 0x7fdcbc1047e0 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc4162640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc10f280 con 0x7fdcbc105180 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc4162640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc10f580 con 0x7fdcbc103750 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc16fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 0x7fdcbc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc16fd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 0x7fdcbc19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48546/0 (socket says 172.21.15.47:48546) 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc16fd640 1 -- 172.21.15.47:0/3348553852 learned_addr learned my addr 172.21.15.47:0/3348553852 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc1efe640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcbc103750 0x7fdcbc19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc26ff640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcbc105180 0x7fdcbc19b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc16fd640 1 -- 172.21.15.47:0/3348553852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcbc103750 msgr2=0x7fdcbc19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc16fd640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcbc103750 0x7fdcbc19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc16fd640 1 -- 172.21.15.47:0/3348553852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcbc105180 msgr2=0x7fdcbc19b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc16fd640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcbc105180 0x7fdcbc19b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.713+0000 7fdcc16fd640 1 -- 172.21.15.47:0/3348553852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc19ba60 con 0x7fdcbc1047e0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.714+0000 7fdcc16fd640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 0x7fdcbc19a6a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdcac006010 tx=0x7fdcac0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.714+0000 7fdcb2ffd640 1 -- 172.21.15.47:0/3348553852 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac03f030 con 0x7fdcbc1047e0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.714+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc19bcf0 con 0x7fdcbc1047e0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.714+0000 7fdcb2ffd640 1 -- 172.21.15.47:0/3348553852 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcac003cb0 con 0x7fdcbc1047e0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.714+0000 7fdcb2ffd640 1 -- 172.21.15.47:0/3348553852 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac035070 con 0x7fdcbc1047e0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.714+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc1a2300 con 0x7fdcbc1047e0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.715+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcbc10a930 con 0x7fdcbc1047e0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.716+0000 7fdcb2ffd640 1 -- 172.21.15.47:0/3348553852 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fdcac042030 con 0x7fdcbc1047e0 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.717+0000 7fdcb2ffd640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdca80b6510 0x7fdca80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:55:58.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.717+0000 7fdcc1efe640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdca80b6510 0x7fdca80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:55:58.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.717+0000 7fdcb2ffd640 1 -- 172.21.15.47:0/3348553852 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6831+0+0 (secure 0 0 0) 0x7fdcac107b80 con 0x7fdcbc1047e0 2024-09-21T00:55:58.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.718+0000 7fdcc1efe640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdca80b6510 0x7fdca80b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80058c0 tx=0x7fdcb800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:55:58.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.721+0000 7fdcb2ffd640 1 -- 172.21.15.47:0/3348553852 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdcac0ce9e0 con 0x7fdcbc1047e0 2024-09-21T00:55:58.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.911+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdcbc063fc0 con 0x7fdcbc1047e0 2024-09-21T00:55:58.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.911+0000 7fdcb2ffd640 1 -- 172.21.15.47:0/3348553852 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7fdcac0d2dc0 con 0x7fdcbc1047e0 2024-09-21T00:55:58.912 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:55:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdca80b6510 msgr2=0x7fdca80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdca80b6510 0x7fdca80b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80058c0 tx=0x7fdcb800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 msgr2=0x7fdcbc19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:55:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 0x7fdcbc19a6a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdcac006010 tx=0x7fdcac0043b0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 shutdown_connections 2024-09-21T00:55:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdca80b6510 0x7fdca80b8a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcbc105180 0x7fdcbc19b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcbc1047e0 0x7fdcbc19a6a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 --2- 172.21.15.47:0/3348553852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcbc103750 0x7fdcbc19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:55:58.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 >> 172.21.15.47:0/3348553852 conn(0x7fdcbc0ff0c0 msgr2=0x7fdcbc107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:55:58.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 shutdown_connections 2024-09-21T00:55:58.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:55:58.914+0000 7fdcc4162640 1 -- 172.21.15.47:0/3348553852 wait complete. 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: Detected new or changed devices on smithi134 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-21T00:55:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:58 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3348553852' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:55:59.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T00:55:58.936+0000 7f47e9370640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T00:55:59.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T00:55:58.957+0000 7f47e516e640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T00:55:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:55:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T00:55:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:55:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: Detected new or changed devices on smithi134 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:58 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3348553852' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:55:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:55:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T00:55:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T00:55:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:55:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]} : dispatch 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: Detected new or changed devices on smithi134 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:55:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:58 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3348553852' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:55:59.645 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726880135,"num_in_osds":12,"osd_in_since":1726880137,"num_remapped_pgs":0} 2024-09-21T00:56:00.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:59 smithi047 ceph-mon[30960]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:56:00.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:59 smithi047 ceph-mon[30960]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T00:56:00.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:00.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:55:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:59 smithi134 ceph-mon[34785]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:56:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:59 smithi134 ceph-mon[34785]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T00:56:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:55:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:59 smithi114 ceph-mon[34309]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-21T00:56:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:59 smithi114 ceph-mon[34309]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T00:56:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:00.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:55:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:00.646 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T00:56:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:01.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:00 smithi047 ceph-mon[30960]: purged_snaps scrub starts 2024-09-21T00:56:01.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:00 smithi047 ceph-mon[30960]: purged_snaps scrub ok 2024-09-21T00:56:01.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:00 smithi047 ceph-mon[30960]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:56:01.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:00 smithi047 ceph-mon[30960]: osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] boot 2024-09-21T00:56:01.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:00 smithi047 ceph-mon[30960]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:56:01.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:00 smithi134 ceph-mon[34785]: purged_snaps scrub starts 2024-09-21T00:56:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:00 smithi134 ceph-mon[34785]: purged_snaps scrub ok 2024-09-21T00:56:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:00 smithi134 ceph-mon[34785]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:56:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:00 smithi134 ceph-mon[34785]: osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] boot 2024-09-21T00:56:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:00 smithi134 ceph-mon[34785]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:56:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:01.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 -- 172.21.15.47:0/2541527970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 msgr2=0x7f5cd810aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:01.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/2541527970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 0x7f5cd810aa40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009ca0 tx=0x7f5cd002a950 comp rx=0 tx=0).stop 2024-09-21T00:56:01.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 -- 172.21.15.47:0/2541527970 shutdown_connections 2024-09-21T00:56:01.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/2541527970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 0x7f5cd810aa40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/2541527970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cd8103700 0x7f5cd8103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/2541527970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd8102670 0x7f5cd8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 -- 172.21.15.47:0/2541527970 >> 172.21.15.47:0/2541527970 conn(0x7f5cd80fdfe0 msgr2=0x7f5cd8100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:01.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 -- 172.21.15.47:0/2541527970 shutdown_connections 2024-09-21T00:56:01.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.394+0000 7f5cde5aa640 1 -- 172.21.15.47:0/2541527970 wait complete. 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.395+0000 7f5cde5aa640 1 Processor -- start 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.395+0000 7f5cde5aa640 1 -- start start 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.395+0000 7f5cde5aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd8102670 0x7f5cd806c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.395+0000 7f5cde5aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cd8103700 0x7f5cd819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.395+0000 7f5cde5aa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 0x7f5cd81a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.395+0000 7f5cde5aa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd810e2a0 con 0x7f5cd81040a0 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.395+0000 7f5cde5aa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd810e120 con 0x7f5cd8103700 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.395+0000 7f5cde5aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd810e420 con 0x7f5cd8102670 2024-09-21T00:56:01.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 0x7f5cd81a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 0x7f5cd81a1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48560/0 (socket says 172.21.15.47:48560) 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 -- 172.21.15.47:0/800416067 learned_addr learned my addr 172.21.15.47:0/800416067 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cd7fff640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd8102670 0x7f5cd806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5ccffff640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cd8103700 0x7f5cd819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 -- 172.21.15.47:0/800416067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd8102670 msgr2=0x7f5cd806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd8102670 0x7f5cd806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 -- 172.21.15.47:0/800416067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cd8103700 msgr2=0x7f5cd819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cd8103700 0x7f5cd819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 -- 172.21.15.47:0/800416067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd81a1a10 con 0x7f5cd81040a0 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cdcb47640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 0x7f5cd81a1210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0006010 tx=0x7f5cd002fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cd5ffb640 1 -- 172.21.15.47:0/800416067 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0034040 con 0x7f5cd81040a0 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cd5ffb640 1 -- 172.21.15.47:0/800416067 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cd00308f0 con 0x7f5cd81040a0 2024-09-21T00:56:01.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cd5ffb640 1 -- 172.21.15.47:0/800416067 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0039450 con 0x7f5cd81040a0 2024-09-21T00:56:01.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.396+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd81a1ca0 con 0x7f5cd81040a0 2024-09-21T00:56:01.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.397+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd81a2130 con 0x7f5cd81040a0 2024-09-21T00:56:01.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.398+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd8109850 con 0x7f5cd81040a0 2024-09-21T00:56:01.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.399+0000 7f5cd5ffb640 1 -- 172.21.15.47:0/800416067 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5cd0037020 con 0x7f5cd81040a0 2024-09-21T00:56:01.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.400+0000 7f5cd5ffb640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5cc40b6590 0x7f5cc40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:01.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.400+0000 7f5cd7fff640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5cc40b6590 0x7f5cc40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:01.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.400+0000 7f5cd5ffb640 1 -- 172.21.15.47:0/800416067 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f5cd0107fc0 con 0x7f5cd81040a0 2024-09-21T00:56:01.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.401+0000 7f5cd7fff640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5cc40b6590 0x7f5cc40b8aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80058c0 tx=0x7f5cc800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:01.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.403+0000 7f5cd5ffb640 1 -- 172.21.15.47:0/800416067 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5cd00cecf0 con 0x7f5cd81040a0 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:00 smithi114 ceph-mon[34309]: purged_snaps scrub starts 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:00 smithi114 ceph-mon[34309]: purged_snaps scrub ok 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:00 smithi114 ceph-mon[34309]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T00:56:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:00 smithi114 ceph-mon[34309]: osd.11 [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] boot 2024-09-21T00:56:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:00 smithi114 ceph-mon[34309]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T00:56:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T00:56:01.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.590+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5cd802e890 con 0x7f5cd81040a0 2024-09-21T00:56:01.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.591+0000 7f5cd5ffb640 1 -- 172.21.15.47:0/800416067 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f5cd00d30d0 con 0x7f5cd81040a0 2024-09-21T00:56:01.592 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:01.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5cc40b6590 msgr2=0x7f5cc40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:01.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5cc40b6590 0x7f5cc40b8aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80058c0 tx=0x7f5cc800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 msgr2=0x7f5cd81a1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 0x7f5cd81a1210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0006010 tx=0x7f5cd002fc00 comp rx=0 tx=0).stop 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 shutdown_connections 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5cc40b6590 0x7f5cc40b8aa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5cd81040a0 0x7f5cd81a1210 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cd8103700 0x7f5cd819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 --2- 172.21.15.47:0/800416067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cd8102670 0x7f5cd806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 >> 172.21.15.47:0/800416067 conn(0x7f5cd80fdfe0 msgr2=0x7f5cd8106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.593+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 shutdown_connections 2024-09-21T00:56:01.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:01.594+0000 7f5cde5aa640 1 -- 172.21.15.47:0/800416067 wait complete. 2024-09-21T00:56:02.203 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726880159,"num_in_osds":12,"osd_in_since":1726880137,"num_remapped_pgs":0} 2024-09-21T00:56:02.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:56:02.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:01 smithi047 ceph-mon[30960]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:56:02.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:01 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/800416067' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:56:02.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:01 smithi134 ceph-mon[34785]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:56:02.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:01 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/800416067' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:56:02.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:01 smithi114 ceph-mon[34309]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T00:56:02.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:01 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/800416067' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T00:56:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:02.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.949+0000 7f86b82fc640 1 -- 172.21.15.47:0/1524063144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0103b60 msgr2=0x7f86b0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:02.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.949+0000 7f86b82fc640 1 --2- 172.21.15.47:0/1524063144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0103b60 0x7f86b0103f70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009900 tx=0x7f86ac02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:02.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 -- 172.21.15.47:0/1524063144 shutdown_connections 2024-09-21T00:56:02.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 --2- 172.21.15.47:0/1524063144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86b0109df0 0x7f86b0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:02.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 --2- 172.21.15.47:0/1524063144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b01094a0 0x7f86b01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:02.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 --2- 172.21.15.47:0/1524063144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0103b60 0x7f86b0103f70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:02.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 -- 172.21.15.47:0/1524063144 >> 172.21.15.47:0/1524063144 conn(0x7f86b007b850 msgr2=0x7f86b007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:02.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 -- 172.21.15.47:0/1524063144 shutdown_connections 2024-09-21T00:56:02.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 -- 172.21.15.47:0/1524063144 wait complete. 2024-09-21T00:56:02.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 Processor -- start 2024-09-21T00:56:02.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.950+0000 7f86b82fc640 1 -- start start 2024-09-21T00:56:02.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b82fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86b0103b60 0x7f86b019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b82fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b01094a0 0x7f86b019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b82fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0109df0 0x7f86b019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b82fc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86b0113ab0 con 0x7f86b0109df0 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b82fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86b0113930 con 0x7f86b01094a0 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b82fc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86b0113c30 con 0x7f86b0103b60 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6899640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0109df0 0x7f86b019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6899640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0109df0 0x7f86b019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53858/0 (socket says 172.21.15.47:53858) 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6899640 1 -- 172.21.15.47:0/3079627690 learned_addr learned my addr 172.21.15.47:0/3079627690 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b5897640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b01094a0 0x7f86b019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6098640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86b0103b60 0x7f86b019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6899640 1 -- 172.21.15.47:0/3079627690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86b0103b60 msgr2=0x7f86b019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6899640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86b0103b60 0x7f86b019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6899640 1 -- 172.21.15.47:0/3079627690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b01094a0 msgr2=0x7f86b019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6899640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b01094a0 0x7f86b019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:02.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.951+0000 7f86b6899640 1 -- 172.21.15.47:0/3079627690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b01a0310 con 0x7f86b0109df0 2024-09-21T00:56:02.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.952+0000 7f86b6899640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0109df0 0x7f86b019fca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f86a800cad0 tx=0x7f86a800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:02.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.955+0000 7f86a37fe640 1 -- 172.21.15.47:0/3079627690 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a800ad60 con 0x7f86b0109df0 2024-09-21T00:56:02.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.955+0000 7f86a37fe640 1 -- 172.21.15.47:0/3079627690 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86a8005020 con 0x7f86b0109df0 2024-09-21T00:56:02.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.955+0000 7f86a37fe640 1 -- 172.21.15.47:0/3079627690 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a800f6b0 con 0x7f86b0109df0 2024-09-21T00:56:02.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.955+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b01a0600 con 0x7f86b0109df0 2024-09-21T00:56:02.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.955+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b01a6e20 con 0x7f86b0109df0 2024-09-21T00:56:02.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.957+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b0103f70 con 0x7f86b0109df0 2024-09-21T00:56:02.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.958+0000 7f86a37fe640 1 -- 172.21.15.47:0/3079627690 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f86a80051d0 con 0x7f86b0109df0 2024-09-21T00:56:02.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.959+0000 7f86a37fe640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f869c0b6640 0x7f869c0b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:02.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.959+0000 7f86b6098640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f869c0b6640 0x7f869c0b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:02.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.959+0000 7f86a37fe640 1 -- 172.21.15.47:0/3079627690 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f86a80e71e0 con 0x7f86b0109df0 2024-09-21T00:56:02.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.959+0000 7f86b6098640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f869c0b6640 0x7f869c0b8b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f86ac031440 tx=0x7f86ac005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:02.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:02.962+0000 7f86a37fe640 1 -- 172.21.15.47:0/3079627690 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86a8014030 con 0x7f86b0109df0 2024-09-21T00:56:03.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.150+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86b019b590 con 0x7f86b0109df0 2024-09-21T00:56:03.152 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:02 smithi047 ceph-mon[30960]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:03.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.151+0000 7f86a37fe640 1 -- 172.21.15.47:0/3079627690 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18482 (secure 0 0 0) 0x7f86b019b590 con 0x7f86b0109df0 2024-09-21T00:56:03.153 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:03.153 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":70,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:56:00.938343+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:56:03.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f869c0b6640 msgr2=0x7f869c0b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:03.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f869c0b6640 0x7f869c0b8b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f86ac031440 tx=0x7f86ac005e80 comp rx=0 tx=0).stop 2024-09-21T00:56:03.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0109df0 msgr2=0x7f86b019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:03.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0109df0 0x7f86b019fca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f86a800cad0 tx=0x7f86a800ced0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 shutdown_connections 2024-09-21T00:56:03.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f869c0b6640 0x7f869c0b8b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b0109df0 0x7f86b019fca0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b01094a0 0x7f86b019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 --2- 172.21.15.47:0/3079627690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86b0103b60 0x7f86b019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:03.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 >> 172.21.15.47:0/3079627690 conn(0x7f86b007b850 msgr2=0x7f86b0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:03.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 shutdown_connections 2024-09-21T00:56:03.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:03.153+0000 7f86b82fc640 1 -- 172.21.15.47:0/3079627690 wait complete. 2024-09-21T00:56:03.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:02 smithi134 ceph-mon[34785]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:03.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:02 smithi114 ceph-mon[34309]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:03.735 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:52:17.628162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T00:56:03.736 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T00:56:03.991 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:04.274 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:03 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3079627690' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:04.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:03 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3079627690' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:04.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:03 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3079627690' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:04.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 -- 172.21.15.47:0/325668365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100102a60 msgr2=0x7fc100102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:04.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 --2- 172.21.15.47:0/325668365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100102a60 0x7fc100102e70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009900 tx=0x7fc0f002a410 comp rx=0 tx=0).stop 2024-09-21T00:56:04.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 -- 172.21.15.47:0/325668365 shutdown_connections 2024-09-21T00:56:04.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 --2- 172.21.15.47:0/325668365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc100108cf0 0x7fc10010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 --2- 172.21.15.47:0/325668365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1001083a0 0x7fc1001087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 --2- 172.21.15.47:0/325668365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100102a60 0x7fc100102e70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 -- 172.21.15.47:0/325668365 >> 172.21.15.47:0/325668365 conn(0x7fc100079730 msgr2=0x7fc100079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:04.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 -- 172.21.15.47:0/325668365 shutdown_connections 2024-09-21T00:56:04.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.610+0000 7fc106426640 1 -- 172.21.15.47:0/325668365 wait complete. 2024-09-21T00:56:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.611+0000 7fc106426640 1 Processor -- start 2024-09-21T00:56:04.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.611+0000 7fc106426640 1 -- start start 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.611+0000 7fc106426640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc100102a60 0x7fc100104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.611+0000 7fc106426640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001083a0 0x7fc100104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.611+0000 7fc106426640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100108cf0 0x7fc100104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.611+0000 7fc106426640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1001129b0 con 0x7fc100108cf0 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.611+0000 7fc106426640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc100112830 con 0x7fc1001083a0 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.611+0000 7fc106426640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc100112b30 con 0x7fc100102a60 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100108cf0 0x7fc100104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100108cf0 0x7fc100104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53876/0 (socket says 172.21.15.47:53876) 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 -- 172.21.15.47:0/2285151917 learned_addr learned my addr 172.21.15.47:0/2285151917 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc0fffff640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc100102a60 0x7fc100104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc0f7fff640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001083a0 0x7fc100104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:04.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 -- 172.21.15.47:0/2285151917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc100102a60 msgr2=0x7fc100104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc100102a60 0x7fc100104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 -- 172.21.15.47:0/2285151917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001083a0 msgr2=0x7fc100104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001083a0 0x7fc100104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 -- 172.21.15.47:0/2285151917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1001a86d0 con 0x7fc100108cf0 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc1049c3640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100108cf0 0x7fc100104cd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800eaa0 tx=0x7fc0f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc0fdffb640 1 -- 172.21.15.47:0/2285151917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800cdb0 con 0x7fc100108cf0 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1001a89c0 con 0x7fc100108cf0 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc0fdffb640 1 -- 172.21.15.47:0/2285151917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0f8005020 con 0x7fc100108cf0 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc0fdffb640 1 -- 172.21.15.47:0/2285151917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80116d0 con 0x7fc100108cf0 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.612+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1001a8ed0 con 0x7fc100108cf0 2024-09-21T00:56:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.613+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc100102e70 con 0x7fc100108cf0 2024-09-21T00:56:04.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.616+0000 7fc0fdffb640 1 -- 172.21.15.47:0/2285151917 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc0f80051d0 con 0x7fc100108cf0 2024-09-21T00:56:04.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.617+0000 7fc0fdffb640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc0ec0b6510 0x7fc0ec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:04.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.617+0000 7fc0fffff640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc0ec0b6510 0x7fc0ec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:04.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.617+0000 7fc0fdffb640 1 -- 172.21.15.47:0/2285151917 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fc0f80e73d0 con 0x7fc100108cf0 2024-09-21T00:56:04.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.618+0000 7fc0fffff640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc0ec0b6510 0x7fc0ec0b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0005ab0 tx=0x7fc0f0005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:04.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.620+0000 7fc0fdffb640 1 -- 172.21.15.47:0/2285151917 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0f8016030 con 0x7fc100108cf0 2024-09-21T00:56:04.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.809+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1001a92c0 con 0x7fc100108cf0 2024-09-21T00:56:04.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.809+0000 7fc0fdffb640 1 -- 172.21.15.47:0/2285151917 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fc0f80b2440 con 0x7fc100108cf0 2024-09-21T00:56:04.811 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-09-21T00:56:04.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc0ec0b6510 msgr2=0x7fc0ec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc0ec0b6510 0x7fc0ec0b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0005ab0 tx=0x7fc0f0005a20 comp rx=0 tx=0).stop 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100108cf0 msgr2=0x7fc100104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100108cf0 0x7fc100104cd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800eaa0 tx=0x7fc0f800ef60 comp rx=0 tx=0).stop 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 shutdown_connections 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc0ec0b6510 0x7fc0ec0b8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc100108cf0 0x7fc100104cd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001083a0 0x7fc100104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 --2- 172.21.15.47:0/2285151917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc100102a60 0x7fc100104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 >> 172.21.15.47:0/2285151917 conn(0x7fc100079730 msgr2=0x7fc1001066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 shutdown_connections 2024-09-21T00:56:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:04.812+0000 7fc106426640 1 -- 172.21.15.47:0/2285151917 wait complete. 2024-09-21T00:56:05.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:04 smithi134 ceph-mon[34785]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:05.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:04 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2285151917' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:56:05.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:04 smithi114 ceph-mon[34309]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:05.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:04 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2285151917' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:56:05.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:04 smithi047 ceph-mon[30960]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:05.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:04 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2285151917' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:56:05.558 INFO:tasks.cephadm:Adding mds.a on smithi047 2024-09-21T00:56:05.558 INFO:tasks.cephadm:Adding mds.d on smithi047 2024-09-21T00:56:05.558 INFO:tasks.cephadm:Adding mds.g on smithi047 2024-09-21T00:56:05.558 INFO:tasks.cephadm:Adding mds.j on smithi047 2024-09-21T00:56:05.559 INFO:tasks.cephadm:Adding mds.b on smithi114 2024-09-21T00:56:05.559 INFO:tasks.cephadm:Adding mds.e on smithi114 2024-09-21T00:56:05.559 INFO:tasks.cephadm:Adding mds.h on smithi114 2024-09-21T00:56:05.559 INFO:tasks.cephadm:Adding mds.k on smithi114 2024-09-21T00:56:05.559 INFO:tasks.cephadm:Adding mds.c on smithi134 2024-09-21T00:56:05.559 INFO:tasks.cephadm:Adding mds.f on smithi134 2024-09-21T00:56:05.559 INFO:tasks.cephadm:Adding mds.i on smithi134 2024-09-21T00:56:05.559 INFO:tasks.cephadm:Adding mds.l on smithi134 2024-09-21T00:56:05.559 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l' 2024-09-21T00:56:05.818 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T00:56:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 -- 172.21.15.134:0/1888760381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc101b60 msgr2=0x7f59dc101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 --2- 172.21.15.134:0/1888760381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc101b60 0x7f59dc101f70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009900 tx=0x7f59cc02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:06.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 -- 172.21.15.134:0/1888760381 shutdown_connections 2024-09-21T00:56:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 --2- 172.21.15.134:0/1888760381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc1094b0 0x7f59dc10b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 --2- 172.21.15.134:0/1888760381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59dc102590 0x7f59dc108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 --2- 172.21.15.134:0/1888760381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc101b60 0x7f59dc101f70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 -- 172.21.15.134:0/1888760381 >> 172.21.15.134:0/1888760381 conn(0x7f59dc0fd770 msgr2=0x7f59dc0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 -- 172.21.15.134:0/1888760381 shutdown_connections 2024-09-21T00:56:06.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.262+0000 7f59e125c640 1 -- 172.21.15.134:0/1888760381 wait complete. 2024-09-21T00:56:06.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59e125c640 1 Processor -- start 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59e125c640 1 -- start start 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59e125c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59dc101b60 0x7f59dc19a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59e125c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc102590 0x7f59dc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59e125c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc1094b0 0x7f59dc19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59e125c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc10f410 con 0x7f59dc1094b0 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59e125c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc10f290 con 0x7f59dc101b60 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59e125c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc10f590 con 0x7f59dc102590 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59da59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc102590 0x7f59dc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59da59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc102590 0x7f59dc19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38528/0 (socket says 172.21.15.134:38528) 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.263+0000 7f59da59c640 1 -- 172.21.15.134:0/1934107284 learned_addr learned my addr 172.21.15.134:0/1934107284 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59dad9d640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59dc101b60 0x7f59dc19a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:06.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59db59e640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc1094b0 0x7f59dc19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59da59c640 1 -- 172.21.15.134:0/1934107284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59dc101b60 msgr2=0x7f59dc19a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59da59c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59dc101b60 0x7f59dc19a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59da59c640 1 -- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc1094b0 msgr2=0x7f59dc19b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59da59c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc1094b0 0x7f59dc19b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59da59c640 1 -- 172.21.15.134:0/1934107284 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc19ba30 con 0x7f59dc102590 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59da59c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc102590 0x7f59dc19a670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59d000b4a0 tx=0x7f59d000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59c3fff640 1 -- 172.21.15.134:0/1934107284 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0014070 con 0x7f59dc102590 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc19bd20 con 0x7f59dc102590 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59c3fff640 1 -- 172.21.15.134:0/1934107284 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59d0010ac0 con 0x7f59dc102590 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59c3fff640 1 -- 172.21.15.134:0/1934107284 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0017c30 con 0x7f59dc102590 2024-09-21T00:56:06.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.264+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc1a2420 con 0x7f59dc102590 2024-09-21T00:56:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.266+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc0ff290 con 0x7f59dc102590 2024-09-21T00:56:06.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.267+0000 7f59c3fff640 1 -- 172.21.15.134:0/1934107284 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f59d0017070 con 0x7f59dc102590 2024-09-21T00:56:06.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.268+0000 7f59c3fff640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f59c40b6510 0x7f59c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:06.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.268+0000 7f59c3fff640 1 -- 172.21.15.134:0/1934107284 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f59d00e6510 con 0x7f59dc102590 2024-09-21T00:56:06.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.268+0000 7f59dad9d640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f59c40b6510 0x7f59c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:06.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.269+0000 7f59dad9d640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f59c40b6510 0x7f59c40b8a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000c00 tx=0x7f59cc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:06.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.271+0000 7f59c3fff640 1 -- 172.21.15.134:0/1934107284 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59d00b1620 con 0x7f59dc102590 2024-09-21T00:56:06.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.462+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}) -- 0x7f59dc063900 con 0x7f59c40b6510 2024-09-21T00:56:06.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.471+0000 7f59c3fff640 1 -- 172.21.15.134:0/1934107284 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f59dc063900 con 0x7f59c40b6510 2024-09-21T00:56:06.472 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mds.all update... 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.473+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f59c40b6510 msgr2=0x7f59c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.473+0000 7f59e125c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f59c40b6510 0x7f59c40b8a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000c00 tx=0x7f59cc031400 comp rx=0 tx=0).stop 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.473+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc102590 msgr2=0x7f59dc19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.473+0000 7f59e125c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc102590 0x7f59dc19a670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59d000b4a0 tx=0x7f59d000b960 comp rx=0 tx=0).stop 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.473+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 shutdown_connections 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.474+0000 7f59e125c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f59c40b6510 0x7f59c40b8a20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.474+0000 7f59e125c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc1094b0 0x7f59dc19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.474+0000 7f59e125c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59dc102590 0x7f59dc19a670 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.474+0000 7f59e125c640 1 --2- 172.21.15.134:0/1934107284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59dc101b60 0x7f59dc19a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.474+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 >> 172.21.15.134:0/1934107284 conn(0x7f59dc0fd770 msgr2=0x7f59dc1077e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:06.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.474+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 shutdown_connections 2024-09-21T00:56:06.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T00:56:06.474+0000 7f59e125c640 1 -- 172.21.15.134:0/1934107284 wait complete. 2024-09-21T00:56:07.187 DEBUG:teuthology.orchestra.run.smithi047:mds.a> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T00:56:07.190 DEBUG:teuthology.orchestra.run.smithi047:mds.d> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:07.215 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:06 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.217 DEBUG:teuthology.orchestra.run.smithi047:mds.g> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T00:56:07.260 DEBUG:teuthology.orchestra.run.smithi047:mds.j> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T00:56:07.303 DEBUG:teuthology.orchestra.run.smithi114:mds.b> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T00:56:07.306 DEBUG:teuthology.orchestra.run.smithi114:mds.e> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:07.328 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:06 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.329 DEBUG:teuthology.orchestra.run.smithi114:mds.h> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:06 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:07.371 DEBUG:teuthology.orchestra.run.smithi114:mds.k> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T00:56:07.414 DEBUG:teuthology.orchestra.run.smithi134:mds.c> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T00:56:07.417 DEBUG:teuthology.orchestra.run.smithi134:mds.f> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T00:56:07.459 DEBUG:teuthology.orchestra.run.smithi134:mds.i> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T00:56:07.502 DEBUG:teuthology.orchestra.run.smithi134:mds.l> sudo journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T00:56:07.545 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T00:56:07.546 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:07.805 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:08.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:07 smithi047 ceph-mon[30960]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:08.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:07 smithi047 ceph-mon[30960]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-09-21T00:56:08.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:07 smithi047 ceph-mon[30960]: Deploying daemon mds.l on smithi134 2024-09-21T00:56:08.331 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:07 smithi134 ceph-mon[34785]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:08.332 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:07 smithi134 ceph-mon[34785]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-09-21T00:56:08.332 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:07 smithi134 ceph-mon[34785]: Deploying daemon mds.l on smithi134 2024-09-21T00:56:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 -- 172.21.15.47:0/666877007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 msgr2=0x7f25f0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/666877007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 0x7f25f0102e70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009900 tx=0x7f25ec02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 -- 172.21.15.47:0/666877007 shutdown_connections 2024-09-21T00:56:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/666877007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f0108cf0 0x7f25f010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/666877007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f01083a0 0x7f25f01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/666877007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 0x7f25f0102e70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 -- 172.21.15.47:0/666877007 >> 172.21.15.47:0/666877007 conn(0x7f25f0079730 msgr2=0x7f25f0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 -- 172.21.15.47:0/666877007 shutdown_connections 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.334+0000 7f25f7ab6640 1 -- 172.21.15.47:0/666877007 wait complete. 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f7ab6640 1 Processor -- start 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f7ab6640 1 -- start start 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f7ab6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 0x7f25f0104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f7ab6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f01083a0 0x7f25f0104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f7ab6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f0108cf0 0x7f25f0104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f7ab6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0112960 con 0x7f25f0102a60 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f7ab6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f25f01127e0 con 0x7f25f01083a0 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f7ab6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0112ae0 con 0x7f25f0108cf0 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f5852640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 0x7f25f0104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f5852640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 0x7f25f0104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53894/0 (socket says 172.21.15.47:53894) 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f5852640 1 -- 172.21.15.47:0/3837793259 learned_addr learned my addr 172.21.15.47:0/3837793259 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f6053640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f0108cf0 0x7f25f0104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.335+0000 7f25f5051640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f01083a0 0x7f25f0104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25f5852640 1 -- 172.21.15.47:0/3837793259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f0108cf0 msgr2=0x7f25f0104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25f5852640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f0108cf0 0x7f25f0104cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25f5852640 1 -- 172.21.15.47:0/3837793259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f01083a0 msgr2=0x7f25f0104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25f5852640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f01083a0 0x7f25f0104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25f5852640 1 -- 172.21.15.47:0/3837793259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f01a8710 con 0x7f25f0102a60 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25f5852640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 0x7f25f0104250 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25ec005940 tx=0x7f25ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25e6ffd640 1 -- 172.21.15.47:0/3837793259 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec03f030 con 0x7f25f0102a60 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25e6ffd640 1 -- 172.21.15.47:0/3837793259 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25ec003aa0 con 0x7f25f0102a60 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f01a89a0 con 0x7f25f0102a60 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25e6ffd640 1 -- 172.21.15.47:0/3837793259 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec035070 con 0x7f25f0102a60 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.336+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f01a8e80 con 0x7f25f0102a60 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.337+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f0102e70 con 0x7f25f0102a60 2024-09-21T00:56:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.339+0000 7f25e6ffd640 1 -- 172.21.15.47:0/3837793259 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f25ec042030 con 0x7f25f0102a60 2024-09-21T00:56:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.340+0000 7f25e6ffd640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f25dc0b6510 0x7f25dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.340+0000 7f25e6ffd640 1 -- 172.21.15.47:0/3837793259 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f25ec107020 con 0x7f25f0102a60 2024-09-21T00:56:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.340+0000 7f25f5051640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f25dc0b6510 0x7f25dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.341+0000 7f25f5051640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f25dc0b6510 0x7f25dc0b8a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f25e0005e10 tx=0x7f25e0005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:08.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.345+0000 7f25e6ffd640 1 -- 172.21.15.47:0/3837793259 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25ec0cdd30 con 0x7f25f0102a60 2024-09-21T00:56:08.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:07 smithi114 ceph-mon[34309]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:56:08.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:07 smithi114 ceph-mon[34309]: Saving service mds.all spec with placement smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-09-21T00:56:08.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:07 smithi114 ceph-mon[34309]: Deploying daemon mds.l on smithi134 2024-09-21T00:56:08.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.571+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25f01a91a0 con 0x7f25f0102a60 2024-09-21T00:56:08.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.571+0000 7f25e6ffd640 1 -- 172.21.15.47:0/3837793259 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f25ec0d2110 con 0x7f25f0102a60 2024-09-21T00:56:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:08.573 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"btime":"2024-09-21T00:48:36:406905+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T00:56:08.573 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 1 2024-09-21T00:56:08.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.573+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f25dc0b6510 msgr2=0x7f25dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.573+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f25dc0b6510 0x7f25dc0b8a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f25e0005e10 tx=0x7f25e0005da0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.573+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 msgr2=0x7f25f0104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.573+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 0x7f25f0104250 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25ec005940 tx=0x7f25ec004270 comp rx=0 tx=0).stop 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.574+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 shutdown_connections 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.574+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f25dc0b6510 0x7f25dc0b8a20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.574+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25f0108cf0 0x7f25f0104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.574+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f01083a0 0x7f25f0104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.574+0000 7f25f7ab6640 1 --2- 172.21.15.47:0/3837793259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25f0102a60 0x7f25f0104250 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.574+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 >> 172.21.15.47:0/3837793259 conn(0x7f25f0079730 msgr2=0x7f25f0101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.574+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 shutdown_connections 2024-09-21T00:56:08.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:08.574+0000 7f25f7ab6640 1 -- 172.21.15.47:0/3837793259 wait complete. 2024-09-21T00:56:08.971 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:08 smithi134 systemd[1]: Starting Ceph mds.l for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:09.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:08 smithi047 ceph-mon[30960]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:08 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3837793259' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:09.222 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:08 smithi134 ceph-mon[34785]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:09.223 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:08 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3837793259' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:09.223 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:09 smithi134 podman[61969]: 2024-09-21 00:56:08.908298996 +0000 UTC m=+0.016039005 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:09.223 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:09 smithi134 podman[61969]: 2024-09-21 00:56:09.017408679 +0000 UTC m=+0.125148678 container create f760e2e48020c3efe0a10f541cf290ae5f7251dfe45f2dc77a6b4c46dab98f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-21T00:56:09.223 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:09 smithi134 podman[61969]: 2024-09-21 00:56:09.186327062 +0000 UTC m=+0.294067062 container init f760e2e48020c3efe0a10f541cf290ae5f7251dfe45f2dc77a6b4c46dab98f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T00:56:09.223 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:09 smithi134 podman[61969]: 2024-09-21 00:56:09.189351135 +0000 UTC m=+0.297091136 container start f760e2e48020c3efe0a10f541cf290ae5f7251dfe45f2dc77a6b4c46dab98f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T00:56:09.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:08 smithi114 ceph-mon[34309]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:09.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:08 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3837793259' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:09.594 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:09 smithi134 ceph-mds[61989]: -- 172.21.15.134:0/1600338464 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55883200d860 con 0x5588361b5a80 2024-09-21T00:56:09.594 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l[61985]: starting mds.l at 2024-09-21T00:56:09.594 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:09 smithi134 bash[61969]: f760e2e48020c3efe0a10f541cf290ae5f7251dfe45f2dc77a6b4c46dab98f22 2024-09-21T00:56:09.595 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 00:56:09 smithi134 systemd[1]: Started Ceph mds.l for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:10.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.134:6832/2433850762,v1:172.21.15.134:6833/2433850762] up:boot 2024-09-21T00:56:10.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: fsmap 1 up:standby 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:10.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:10 smithi114 ceph-mon[34309]: Deploying daemon mds.k on smithi114 2024-09-21T00:56:10.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.134:6832/2433850762,v1:172.21.15.134:6833/2433850762] up:boot 2024-09-21T00:56:10.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: fsmap 1 up:standby 2024-09-21T00:56:10.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:56:10.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:10.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:10.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:10.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:10.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:10 smithi134 ceph-mon[34785]: Deploying daemon mds.k on smithi114 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.134:6832/2433850762,v1:172.21.15.134:6833/2433850762] up:boot 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: fsmap 1 up:standby 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:10.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:10.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:10.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:10 smithi047 ceph-mon[30960]: Deploying daemon mds.k on smithi114 2024-09-21T00:56:11.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:11.409 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 00:56:11 smithi114 systemd[1]: Starting Ceph mds.k for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:11.681 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 00:56:11 smithi114 podman[61586]: 2024-09-21 00:56:11.326661661 +0000 UTC m=+0.016464329 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:11.681 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 00:56:11 smithi114 podman[61586]: 2024-09-21 00:56:11.432525872 +0000 UTC m=+0.122328522 container create 446099b5f6b6d060cf3ee54329b1866ae4fe10a7167fa7eb256865d26fff4b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T00:56:11.681 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 00:56:11 smithi114 podman[61586]: 2024-09-21 00:56:11.643182774 +0000 UTC m=+0.332985424 container init 446099b5f6b6d060cf3ee54329b1866ae4fe10a7167fa7eb256865d26fff4b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T00:56:11.681 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 00:56:11 smithi114 podman[61586]: 2024-09-21 00:56:11.646147309 +0000 UTC m=+0.335949960 container start 446099b5f6b6d060cf3ee54329b1866ae4fe10a7167fa7eb256865d26fff4b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T00:56:11.681 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 00:56:11 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k[61602]: starting mds.k at 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 -- 172.21.15.47:0/115818994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee40757b0 msgr2=0x7f1ee4075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/115818994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee40757b0 0x7f1ee4075bc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009900 tx=0x7f1ed402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 -- 172.21.15.47:0/115818994 shutdown_connections 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/115818994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ee41100c0 0x7f1ee4112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/115818994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee4076100 0x7f1ee410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/115818994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee40757b0 0x7f1ee4075bc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 -- 172.21.15.47:0/115818994 >> 172.21.15.47:0/115818994 conn(0x7f1ee407b850 msgr2=0x7f1ee407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 -- 172.21.15.47:0/115818994 shutdown_connections 2024-09-21T00:56:12.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.111+0000 7f1ee8d48640 1 -- 172.21.15.47:0/115818994 wait complete. 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee8d48640 1 Processor -- start 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee8d48640 1 -- start start 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee8d48640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ee40757b0 0x7f1ee419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee8d48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee4076100 0x7f1ee419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee8d48640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee41100c0 0x7f1ee41a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee8d48640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4115cc0 con 0x7f1ee4076100 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee8d48640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4115b40 con 0x7f1ee40757b0 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee8d48640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4115e40 con 0x7f1ee41100c0 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee4076100 0x7f1ee419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee4076100 0x7f1ee419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54546/0 (socket says 172.21.15.47:54546) 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1edbfff640 1 -- 172.21.15.47:0/3220469583 learned_addr learned my addr 172.21.15.47:0/3220469583 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee259c640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ee40757b0 0x7f1ee419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.112+0000 7f1ee2d9d640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee41100c0 0x7f1ee41a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edbfff640 1 -- 172.21.15.47:0/3220469583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee41100c0 msgr2=0x7f1ee41a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edbfff640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee41100c0 0x7f1ee41a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edbfff640 1 -- 172.21.15.47:0/3220469583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ee40757b0 msgr2=0x7f1ee419c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edbfff640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ee40757b0 0x7f1ee419c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edbfff640 1 -- 172.21.15.47:0/3220469583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee41a25c0 con 0x7f1ee4076100 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edbfff640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee4076100 0x7f1ee419cbf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00c970 tx=0x7f1ecc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edb7fe640 1 -- 172.21.15.47:0/3220469583 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc004220 con 0x7f1ee4076100 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edb7fe640 1 -- 172.21.15.47:0/3220469583 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ecc0043c0 con 0x7f1ee4076100 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee41a28b0 con 0x7f1ee4076100 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1edb7fe640 1 -- 172.21.15.47:0/3220469583 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc004a00 con 0x7f1ee4076100 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.113+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee41a9010 con 0x7f1ee4076100 2024-09-21T00:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.114+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee4075bc0 con 0x7f1ee4076100 2024-09-21T00:56:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.116+0000 7f1edb7fe640 1 -- 172.21.15.47:0/3220469583 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f1ecc0079b0 con 0x7f1ee4076100 2024-09-21T00:56:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.117+0000 7f1edb7fe640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1ed00b6510 0x7f1ed00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.117+0000 7f1ee259c640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1ed00b6510 0x7f1ed00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.117+0000 7f1edb7fe640 1 -- 172.21.15.47:0/3220469583 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f1ecc0e6f20 con 0x7f1ee4076100 2024-09-21T00:56:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.117+0000 7f1ee259c640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1ed00b6510 0x7f1ed00b8a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4005ab0 tx=0x7f1ed4005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:12.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.121+0000 7f1edb7fe640 1 -- 172.21.15.47:0/3220469583 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ecc014030 con 0x7f1ee4076100 2024-09-21T00:56:12.159 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 00:56:11 smithi114 bash[61586]: 446099b5f6b6d060cf3ee54329b1866ae4fe10a7167fa7eb256865d26fff4b2d 2024-09-21T00:56:12.159 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 00:56:11 smithi114 systemd[1]: Started Ceph mds.k for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:12.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.356+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ee419d780 con 0x7f1ee4076100 2024-09-21T00:56:12.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.356+0000 7f1edb7fe640 1 -- 172.21.15.47:0/3220469583 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f1ecc0b2030 con 0x7f1ee4076100 2024-09-21T00:56:12.357 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:12.358 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"btime":"2024-09-21T00:56:12:296395+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T00:56:12.358 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.358+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1ed00b6510 msgr2=0x7f1ed00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.358+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1ed00b6510 0x7f1ed00b8a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4005ab0 tx=0x7f1ed4005a20 comp rx=0 tx=0).stop 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee4076100 msgr2=0x7f1ee419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee4076100 0x7f1ee419cbf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00c970 tx=0x7f1ecc00ce30 comp rx=0 tx=0).stop 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 shutdown_connections 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1ed00b6510 0x7f1ed00b8a20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ee41100c0 0x7f1ee41a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ee4076100 0x7f1ee419cbf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 --2- 172.21.15.47:0/3220469583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ee40757b0 0x7f1ee419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 >> 172.21.15.47:0/3220469583 conn(0x7f1ee407b850 msgr2=0x7f1ee4109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 shutdown_connections 2024-09-21T00:56:12.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:12.359+0000 7f1ee8d48640 1 -- 172.21.15.47:0/3220469583 wait complete. 2024-09-21T00:56:12.957 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: Deploying daemon mds.j on smithi047 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.114:6832/1826356330,v1:172.21.15.114:6833/1826356330] up:boot 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: fsmap 2 up:standby 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:56:12.958 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:12 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3220469583' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:13.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: Deploying daemon mds.j on smithi047 2024-09-21T00:56:13.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.114:6832/1826356330,v1:172.21.15.114:6833/1826356330] up:boot 2024-09-21T00:56:13.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: fsmap 2 up:standby 2024-09-21T00:56:13.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:56:13.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:12 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3220469583' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:13.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:13.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:13.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:13.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: Deploying daemon mds.j on smithi047 2024-09-21T00:56:13.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.114:6832/1826356330,v1:172.21.15.114:6833/1826356330] up:boot 2024-09-21T00:56:13.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: fsmap 2 up:standby 2024-09-21T00:56:13.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T00:56:13.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:12 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3220469583' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:14.456 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 systemd[1]: Starting Ceph mds.j for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:14.774 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 podman[68779]: 2024-09-21 00:56:14.424550953 +0000 UTC m=+0.016837324 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:14.774 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 podman[68779]: 2024-09-21 00:56:14.529647362 +0000 UTC m=+0.121933718 container create 89d58e110204a2b6b7145d7279efafa72c2b3dee725f7b6a2e238b0a20803980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T00:56:14.774 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 podman[68779]: 2024-09-21 00:56:14.774206707 +0000 UTC m=+0.366493072 container init 89d58e110204a2b6b7145d7279efafa72c2b3dee725f7b6a2e238b0a20803980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T00:56:15.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:14 smithi134 ceph-mon[34785]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:14 smithi114 ceph-mon[34309]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:15.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:14 smithi047 ceph-mon[30960]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:15.206 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 podman[68779]: 2024-09-21 00:56:14.777410224 +0000 UTC m=+0.369696581 container start 89d58e110204a2b6b7145d7279efafa72c2b3dee725f7b6a2e238b0a20803980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:56:15.206 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 ceph-mds[68798]: -- 172.21.15.47:0/2078116290 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5576ff8b3860 con 0x557703a5ba80 2024-09-21T00:56:15.206 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j[68794]: starting mds.j at 2024-09-21T00:56:15.206 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 bash[68779]: 89d58e110204a2b6b7145d7279efafa72c2b3dee725f7b6a2e238b0a20803980 2024-09-21T00:56:15.206 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 00:56:14 smithi047 systemd[1]: Started Ceph mds.j for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:15.487 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: Deploying daemon mds.d on smithi047 2024-09-21T00:56:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.47:6834/661733967,v1:172.21.15.47:6835/661733967] up:boot 2024-09-21T00:56:16.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: fsmap 3 up:standby 2024-09-21T00:56:16.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:15 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:56:16.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:16.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:16.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:16.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: Deploying daemon mds.d on smithi047 2024-09-21T00:56:16.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.47:6834/661733967,v1:172.21.15.47:6835/661733967] up:boot 2024-09-21T00:56:16.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: fsmap 3 up:standby 2024-09-21T00:56:16.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:15 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:56:16.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:16.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:16.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:16.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:16.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: Deploying daemon mds.d on smithi047 2024-09-21T00:56:16.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.47:6834/661733967,v1:172.21.15.47:6835/661733967] up:boot 2024-09-21T00:56:16.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: fsmap 3 up:standby 2024-09-21T00:56:16.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:15 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T00:56:16.660 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:17.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:16 smithi047 ceph-mon[30960]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:16 smithi134 ceph-mon[34785]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:17.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:16 smithi114 ceph-mon[34309]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 -- 172.21.15.47:0/1182086907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4760114800 msgr2=0x7f476011b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 --2- 172.21.15.47:0/1182086907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4760114800 0x7f476011b030 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4758009900 tx=0x7f475802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 -- 172.21.15.47:0/1182086907 shutdown_connections 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 --2- 172.21.15.47:0/1182086907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4760114800 0x7f476011b030 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 --2- 172.21.15.47:0/1182086907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4760113eb0 0x7f47601142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 --2- 172.21.15.47:0/1182086907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f476010e5c0 0x7f476010e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 -- 172.21.15.47:0/1182086907 >> 172.21.15.47:0/1182086907 conn(0x7f476010a3c0 msgr2=0x7f476010c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 -- 172.21.15.47:0/1182086907 shutdown_connections 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.305+0000 7f4766c62640 1 -- 172.21.15.47:0/1182086907 wait complete. 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f4766c62640 1 Processor -- start 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f4766c62640 1 -- start start 2024-09-21T00:56:17.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f4766c62640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f476010e5c0 0x7f47601a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f4766c62640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4760113eb0 0x7f47601a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f4766c62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4760114800 0x7f47601aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f4766c62640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f476011e4d0 con 0x7f476010e5c0 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f4766c62640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f476011e350 con 0x7f4760113eb0 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f4766c62640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f476011e650 con 0x7f4760114800 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f47649fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f476010e5c0 0x7f47601a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f47649fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f476010e5c0 0x7f47601a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54584/0 (socket says 172.21.15.47:54584) 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f47649fe640 1 -- 172.21.15.47:0/3586753085 learned_addr learned my addr 172.21.15.47:0/3586753085 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.306+0000 7f475ffff640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4760113eb0 0x7f47601a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f47651ff640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4760114800 0x7f47601aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f47649fe640 1 -- 172.21.15.47:0/3586753085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4760114800 msgr2=0x7f47601aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f47649fe640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4760114800 0x7f47601aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f47649fe640 1 -- 172.21.15.47:0/3586753085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4760113eb0 msgr2=0x7f47601a5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f47649fe640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4760113eb0 0x7f47601a5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f47649fe640 1 -- 172.21.15.47:0/3586753085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47601aadd0 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f47649fe640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f476010e5c0 0x7f47601a4e60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f475000eab0 tx=0x7f475000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f475dffb640 1 -- 172.21.15.47:0/3586753085 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475000ce40 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f475dffb640 1 -- 172.21.15.47:0/3586753085 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4750011920 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47601ab0c0 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f475dffb640 1 -- 172.21.15.47:0/3586753085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750010a30 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.307+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47601b1820 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.309+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476010e9d0 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.310+0000 7f475dffb640 1 -- 172.21.15.47:0/3586753085 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f4750010bd0 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.310+0000 7f475dffb640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f47480b6510 0x7f47480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.311+0000 7f475ffff640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f47480b6510 0x7f47480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.311+0000 7f475dffb640 1 -- 172.21.15.47:0/3586753085 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f47500e73e0 con 0x7f476010e5c0 2024-09-21T00:56:17.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.311+0000 7f475ffff640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f47480b6510 0x7f47480b8a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f47601144e0 tx=0x7f4754005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:17.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.315+0000 7f475dffb640 1 -- 172.21.15.47:0/3586753085 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4750016030 con 0x7f476010e5c0 2024-09-21T00:56:17.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.551+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47601165f0 con 0x7f476010e5c0 2024-09-21T00:56:17.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.552+0000 7f475dffb640 1 -- 172.21.15.47:0/3586753085 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f47500ae110 con 0x7f476010e5c0 2024-09-21T00:56:17.553 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:17.553 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":4,"btime":"2024-09-21T00:56:15:795640+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T00:56:17.553 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 4 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f47480b6510 msgr2=0x7f47480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f47480b6510 0x7f47480b8a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f47601144e0 tx=0x7f4754005f90 comp rx=0 tx=0).stop 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f476010e5c0 msgr2=0x7f47601a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f476010e5c0 0x7f47601a4e60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f475000eab0 tx=0x7f475000ef70 comp rx=0 tx=0).stop 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 shutdown_connections 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f47480b6510 0x7f47480b8a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4760114800 0x7f47601aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4760113eb0 0x7f47601a5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 --2- 172.21.15.47:0/3586753085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f476010e5c0 0x7f47601a4e60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:17.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 >> 172.21.15.47:0/3586753085 conn(0x7f476010a3c0 msgr2=0x7f4760113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:17.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 shutdown_connections 2024-09-21T00:56:17.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:17.554+0000 7f4766c62640 1 -- 172.21.15.47:0/3586753085 wait complete. 2024-09-21T00:56:18.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:17 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3586753085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:18.206 INFO:journalctl@ceph.mds.d.smithi047.stdout:Sep 21 00:56:18 smithi047 systemd[1]: Started Ceph mds.d for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:18.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:17 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3586753085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:18.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:17 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3586753085' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:19.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:18 smithi047 ceph-mon[30960]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:19.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:19.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:19.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:18 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:18 smithi134 ceph-mon[34785]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:18 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:18 smithi114 ceph-mon[34309]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:19.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:19.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:18 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:20.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:19 smithi134 ceph-mon[34785]: Deploying daemon mds.e on smithi114 2024-09-21T00:56:20.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:19 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.47:6836/1306058041,v1:172.21.15.47:6837/1306058041] up:boot 2024-09-21T00:56:20.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:19 smithi134 ceph-mon[34785]: fsmap 4 up:standby 2024-09-21T00:56:20.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:19 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:56:20.409 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 systemd[1]: Starting Ceph mds.e for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:20.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:19 smithi114 ceph-mon[34309]: Deploying daemon mds.e on smithi114 2024-09-21T00:56:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:19 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.47:6836/1306058041,v1:172.21.15.47:6837/1306058041] up:boot 2024-09-21T00:56:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:19 smithi114 ceph-mon[34309]: fsmap 4 up:standby 2024-09-21T00:56:20.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:19 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:56:20.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:19 smithi047 ceph-mon[30960]: Deploying daemon mds.e on smithi114 2024-09-21T00:56:20.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:19 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.47:6836/1306058041,v1:172.21.15.47:6837/1306058041] up:boot 2024-09-21T00:56:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:19 smithi047 ceph-mon[30960]: fsmap 4 up:standby 2024-09-21T00:56:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:19 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T00:56:20.672 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 podman[61869]: 2024-09-21 00:56:20.410681181 +0000 UTC m=+0.111486809 container create a65e57a02ed447b0a533ef18b23874dcbf9e6db8dfde28439b98af409a8d2799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T00:56:20.672 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 podman[61869]: 2024-09-21 00:56:20.315337067 +0000 UTC m=+0.016142695 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:20.672 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 podman[61869]: 2024-09-21 00:56:20.671780724 +0000 UTC m=+0.372586352 container init a65e57a02ed447b0a533ef18b23874dcbf9e6db8dfde28439b98af409a8d2799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T00:56:20.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:20.962 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 podman[61869]: 2024-09-21 00:56:20.674674818 +0000 UTC m=+0.375480447 container start a65e57a02ed447b0a533ef18b23874dcbf9e6db8dfde28439b98af409a8d2799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:56:20.962 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-mds[61888]: -- 172.21.15.114:0/2895869227 <== mon.2 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0b6ae7860 con 0x55a0bac8f600 2024-09-21T00:56:20.962 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e[61884]: starting mds.e at 2024-09-21T00:56:20.962 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 bash[61869]: a65e57a02ed447b0a533ef18b23874dcbf9e6db8dfde28439b98af409a8d2799 2024-09-21T00:56:20.962 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 00:56:20 smithi114 systemd[1]: Started Ceph mds.e for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:21.100 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:20 smithi047 ceph-mon[30960]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:21.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:21.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:21.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:20 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:21.216 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:20 smithi134 ceph-mon[34785]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:21.216 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.216 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.216 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.216 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:21.216 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:21.216 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:20 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-mon[34309]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:21.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:20 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:21.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 -- 172.21.15.47:0/3259507279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 msgr2=0x7fe62c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 --2- 172.21.15.47:0/3259507279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 0x7fe62c10d950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe614009900 tx=0x7fe61402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:21.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 -- 172.21.15.47:0/3259507279 shutdown_connections 2024-09-21T00:56:21.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 --2- 172.21.15.47:0/3259507279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c10de90 0x7fe62c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 --2- 172.21.15.47:0/3259507279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 0x7fe62c10d950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 --2- 172.21.15.47:0/3259507279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe62c1048e0 0x7fe62c104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 -- 172.21.15.47:0/3259507279 >> 172.21.15.47:0/3259507279 conn(0x7fe62c0797b0 msgr2=0x7fe62c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:21.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 -- 172.21.15.47:0/3259507279 shutdown_connections 2024-09-21T00:56:21.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.440+0000 7fe6314be640 1 -- 172.21.15.47:0/3259507279 wait complete. 2024-09-21T00:56:21.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe6314be640 1 Processor -- start 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe6314be640 1 -- start start 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe6314be640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe62c1048e0 0x7fe62c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe6314be640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 0x7fe62c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe6314be640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c10de90 0x7fe62c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe6314be640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c113b30 con 0x7fe62c105310 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe6314be640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1139b0 con 0x7fe62c10de90 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe6314be640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c113cb0 con 0x7fe62c1048e0 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe62a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 0x7fe62c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe62a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 0x7fe62c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54630/0 (socket says 172.21.15.47:54630) 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.441+0000 7fe62a7fc640 1 -- 172.21.15.47:0/3652887918 learned_addr learned my addr 172.21.15.47:0/3652887918 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62b7fe640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c10de90 0x7fe62c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62affd640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe62c1048e0 0x7fe62c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62a7fc640 1 -- 172.21.15.47:0/3652887918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe62c1048e0 msgr2=0x7fe62c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62a7fc640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe62c1048e0 0x7fe62c19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62a7fc640 1 -- 172.21.15.47:0/3652887918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c10de90 msgr2=0x7fe62c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62a7fc640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c10de90 0x7fe62c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62a7fc640 1 -- 172.21.15.47:0/3652887918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c1a0480 con 0x7fe62c105310 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62affd640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe62c1048e0 0x7fe62c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe62a7fc640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 0x7fe62c19aab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe614005ab0 tx=0x7fe614003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe623fff640 1 -- 172.21.15.47:0/3652887918 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61403f070 con 0x7fe62c105310 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c1a0710 con 0x7fe62c105310 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe623fff640 1 -- 172.21.15.47:0/3652887918 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe614031d60 con 0x7fe62c105310 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe623fff640 1 -- 172.21.15.47:0/3652887918 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614035030 con 0x7fe62c105310 2024-09-21T00:56:21.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.442+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c1a6ed0 con 0x7fe62c105310 2024-09-21T00:56:21.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.443+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62c104cf0 con 0x7fe62c105310 2024-09-21T00:56:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.446+0000 7fe623fff640 1 -- 172.21.15.47:0/3652887918 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fe614042070 con 0x7fe62c105310 2024-09-21T00:56:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.447+0000 7fe623fff640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe6180b6510 0x7fe6180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:21.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.447+0000 7fe62affd640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe6180b6510 0x7fe6180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.447+0000 7fe623fff640 1 -- 172.21.15.47:0/3652887918 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fe614107dd0 con 0x7fe62c105310 2024-09-21T00:56:21.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.447+0000 7fe62affd640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe6180b6510 0x7fe6180b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009fa0 tx=0x7fe61c009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.450+0000 7fe623fff640 1 -- 172.21.15.47:0/3652887918 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6140cea60 con 0x7fe62c105310 2024-09-21T00:56:21.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.674+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe62c19b640 con 0x7fe62c105310 2024-09-21T00:56:21.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.675+0000 7fe623fff640 1 -- 172.21.15.47:0/3652887918 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7fe62c19b640 con 0x7fe62c105310 2024-09-21T00:56:21.676 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:21.676 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":6,"btime":"2024-09-21T00:56:20:961000+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T00:56:21.676 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 6 2024-09-21T00:56:21.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe6180b6510 msgr2=0x7fe6180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe6180b6510 0x7fe6180b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009fa0 tx=0x7fe61c009570 comp rx=0 tx=0).stop 2024-09-21T00:56:21.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 msgr2=0x7fe62c19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:21.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 0x7fe62c19aab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe614005ab0 tx=0x7fe614003cd0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 shutdown_connections 2024-09-21T00:56:21.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe6180b6510 0x7fe6180b8a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c10de90 0x7fe62c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe62c105310 0x7fe62c19aab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 --2- 172.21.15.47:0/3652887918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe62c1048e0 0x7fe62c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:21.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 >> 172.21.15.47:0/3652887918 conn(0x7fe62c0797b0 msgr2=0x7fe62c1079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:21.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 shutdown_connections 2024-09-21T00:56:21.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:21.677+0000 7fe6314be640 1 -- 172.21.15.47:0/3652887918 wait complete. 2024-09-21T00:56:22.239 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:21 smithi134 ceph-mon[34785]: Deploying daemon mds.f on smithi134 2024-09-21T00:56:22.240 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:21 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.114:6834/27443904,v1:172.21.15.114:6835/27443904] up:boot 2024-09-21T00:56:22.240 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:21 smithi134 ceph-mon[34785]: fsmap 5 up:standby 2024-09-21T00:56:22.240 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:21 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:56:22.240 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:21 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3652887918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:21 smithi114 ceph-mon[34309]: Deploying daemon mds.f on smithi134 2024-09-21T00:56:22.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:21 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.114:6834/27443904,v1:172.21.15.114:6835/27443904] up:boot 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:21 smithi114 ceph-mon[34309]: fsmap 5 up:standby 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:21 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:21 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3652887918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:21 smithi047 ceph-mon[30960]: Deploying daemon mds.f on smithi134 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:21 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.114:6834/27443904,v1:172.21.15.114:6835/27443904] up:boot 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:21 smithi047 ceph-mon[30960]: fsmap 5 up:standby 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:21 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T00:56:22.410 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:21 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3652887918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:22.844 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:22 smithi134 systemd[1]: Starting Ceph mds.f for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:23.153 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:22 smithi134 ceph-mon[34785]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:23.153 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:22 smithi134 podman[62239]: 2024-09-21 00:56:22.792319597 +0000 UTC m=+0.015620392 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:23.154 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:22 smithi134 podman[62239]: 2024-09-21 00:56:22.911071947 +0000 UTC m=+0.134372731 container create ac84252df8880e7c1f05ce05d189f2aab479fdf3302c5eeee8d4fc4ebf8be87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:56:23.154 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:23 smithi134 podman[62239]: 2024-09-21 00:56:23.153704409 +0000 UTC m=+0.377005197 container init ac84252df8880e7c1f05ce05d189f2aab479fdf3302c5eeee8d4fc4ebf8be87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T00:56:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:22 smithi114 ceph-mon[34309]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:23.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:22 smithi047 ceph-mon[30960]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:23.594 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:23 smithi134 podman[62239]: 2024-09-21 00:56:23.156876324 +0000 UTC m=+0.380177108 container start ac84252df8880e7c1f05ce05d189f2aab479fdf3302c5eeee8d4fc4ebf8be87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:56:23.594 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:23 smithi134 ceph-mds[62258]: -- 172.21.15.134:0/1765025581 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ead0119860 con 0x55ead42c1180 2024-09-21T00:56:23.594 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f[62254]: starting mds.f at 2024-09-21T00:56:23.594 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:23 smithi134 bash[62239]: ac84252df8880e7c1f05ce05d189f2aab479fdf3302c5eeee8d4fc4ebf8be87f 2024-09-21T00:56:23.595 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 00:56:23 smithi134 systemd[1]: Started Ceph mds.f for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:24.442 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: Deploying daemon mds.c on smithi134 2024-09-21T00:56:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.134:6834/1078728658,v1:172.21.15.134:6835/1078728658] up:boot 2024-09-21T00:56:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: fsmap 6 up:standby 2024-09-21T00:56:24.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:24 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:56:24.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:24.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: Deploying daemon mds.c on smithi134 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.134:6834/1078728658,v1:172.21.15.134:6835/1078728658] up:boot 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: fsmap 6 up:standby 2024-09-21T00:56:24.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:24 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:56:24.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:24.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: Deploying daemon mds.c on smithi134 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.134:6834/1078728658,v1:172.21.15.134:6835/1078728658] up:boot 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: fsmap 6 up:standby 2024-09-21T00:56:24.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:24 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T00:56:24.715 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:25.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 -- 172.21.15.47:0/2035056899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 msgr2=0x7fa75410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:25.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/2035056899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 0x7fa75410d850 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa748009900 tx=0x7fa74802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:25.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 -- 172.21.15.47:0/2035056899 shutdown_connections 2024-09-21T00:56:25.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/2035056899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa75410de10 0x7fa754110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/2035056899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 0x7fa75410d850 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/2035056899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7541049b0 0x7fa754104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 -- 172.21.15.47:0/2035056899 >> 172.21.15.47:0/2035056899 conn(0x7fa754079730 msgr2=0x7fa754079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:25.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 -- 172.21.15.47:0/2035056899 shutdown_connections 2024-09-21T00:56:25.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.164+0000 7fa75a9a3640 1 -- 172.21.15.47:0/2035056899 wait complete. 2024-09-21T00:56:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa75a9a3640 1 Processor -- start 2024-09-21T00:56:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa75a9a3640 1 -- start start 2024-09-21T00:56:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa75a9a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7541049b0 0x7fa7541026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa75a9a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 0x7fa754102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa75a9a3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75410de10 0x7fa754103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa75a9a3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa754113a70 con 0x7fa754105300 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa75a9a3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541138f0 con 0x7fa7541049b0 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa75a9a3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa754113bf0 con 0x7fa75410de10 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 0x7fa754102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 0x7fa754102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55326/0 (socket says 172.21.15.47:55326) 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa7537fe640 1 -- 172.21.15.47:0/3312411181 learned_addr learned my addr 172.21.15.47:0/3312411181 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.165+0000 7fa758f40640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75410de10 0x7fa754103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa753fff640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7541049b0 0x7fa7541026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7537fe640 1 -- 172.21.15.47:0/3312411181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75410de10 msgr2=0x7fa754103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7537fe640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75410de10 0x7fa754103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7537fe640 1 -- 172.21.15.47:0/3312411181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7541049b0 msgr2=0x7fa7541026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7537fe640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7541049b0 0x7fa7541026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7537fe640 1 -- 172.21.15.47:0/3312411181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7541a8800 con 0x7fa754105300 2024-09-21T00:56:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7537fe640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 0x7fa754102c30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa748006010 tx=0x7fa748004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7517fa640 1 -- 172.21.15.47:0/3312411181 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74803f030 con 0x7fa754105300 2024-09-21T00:56:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7517fa640 1 -- 172.21.15.47:0/3312411181 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa748003aa0 con 0x7fa754105300 2024-09-21T00:56:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7541a8a90 con 0x7fa754105300 2024-09-21T00:56:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa7517fa640 1 -- 172.21.15.47:0/3312411181 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748035070 con 0x7fa754105300 2024-09-21T00:56:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.166+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7541a8f70 con 0x7fa754105300 2024-09-21T00:56:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.167+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa754104dc0 con 0x7fa754105300 2024-09-21T00:56:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.169+0000 7fa7517fa640 1 -- 172.21.15.47:0/3312411181 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fa748042030 con 0x7fa754105300 2024-09-21T00:56:25.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.170+0000 7fa7517fa640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa73c0b6510 0x7fa73c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:25.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.170+0000 7fa753fff640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa73c0b6510 0x7fa73c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:25.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.170+0000 7fa7517fa640 1 -- 172.21.15.47:0/3312411181 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fa748107780 con 0x7fa754105300 2024-09-21T00:56:25.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.171+0000 7fa753fff640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa73c0b6510 0x7fa73c0b8a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa744005fd0 tx=0x7fa744005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:25.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.174+0000 7fa7517fa640 1 -- 172.21.15.47:0/3312411181 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7480ce4b0 con 0x7fa754105300 2024-09-21T00:56:25.344 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 systemd[1]: Starting Ceph mds.c for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:25.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.406+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa75402e640 con 0x7fa754105300 2024-09-21T00:56:25.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.406+0000 7fa7517fa640 1 -- 172.21.15.47:0/3312411181 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7fa7480d2890 con 0x7fa754105300 2024-09-21T00:56:25.407 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:25.407 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":7,"btime":"2024-09-21T00:56:23:974798+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T00:56:25.408 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 7 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.408+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa73c0b6510 msgr2=0x7fa73c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.408+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa73c0b6510 0x7fa73c0b8a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa744005fd0 tx=0x7fa744005850 comp rx=0 tx=0).stop 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.408+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 msgr2=0x7fa754102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.408+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 0x7fa754102c30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa748006010 tx=0x7fa748004060 comp rx=0 tx=0).stop 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.409+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 shutdown_connections 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.409+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa73c0b6510 0x7fa73c0b8a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.409+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75410de10 0x7fa754103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.409+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa754105300 0x7fa754102c30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.409+0000 7fa75a9a3640 1 --2- 172.21.15.47:0/3312411181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7541049b0 0x7fa7541026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.409+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 >> 172.21.15.47:0/3312411181 conn(0x7fa754079730 msgr2=0x7fa754100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.409+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 shutdown_connections 2024-09-21T00:56:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:25.409+0000 7fa75a9a3640 1 -- 172.21.15.47:0/3312411181 wait complete. 2024-09-21T00:56:25.632 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 podman[62510]: 2024-09-21 00:56:25.280811984 +0000 UTC m=+0.015895446 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:25.632 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 podman[62510]: 2024-09-21 00:56:25.40478336 +0000 UTC m=+0.139866812 container create 04bbdf9ee27f3b689539aa1992701b7dabe28a0393b13e8930a9b19b76edac17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T00:56:25.633 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 podman[62510]: 2024-09-21 00:56:25.632207497 +0000 UTC m=+0.367290955 container init 04bbdf9ee27f3b689539aa1992701b7dabe28a0393b13e8930a9b19b76edac17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T00:56:26.094 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 podman[62510]: 2024-09-21 00:56:25.635268849 +0000 UTC m=+0.370352304 container start 04bbdf9ee27f3b689539aa1992701b7dabe28a0393b13e8930a9b19b76edac17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T00:56:26.094 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 ceph-mds[62530]: -- 172.21.15.134:0/1593254672 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a9fb5d860 con 0x555aa3d05a80 2024-09-21T00:56:26.094 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c[62526]: starting mds.c at 2024-09-21T00:56:26.094 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 bash[62510]: 04bbdf9ee27f3b689539aa1992701b7dabe28a0393b13e8930a9b19b76edac17 2024-09-21T00:56:26.094 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 00:56:25 smithi134 systemd[1]: Started Ceph mds.c for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:26.500 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:26.500 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3312411181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:26.500 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.500 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.501 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.501 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:26.501 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:26.501 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:26.501 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:26 smithi114 ceph-mon[34309]: Deploying daemon mds.h on smithi114 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3312411181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:26.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:26 smithi134 ceph-mon[34785]: Deploying daemon mds.h on smithi114 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3312411181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:26.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:26 smithi047 ceph-mon[30960]: Deploying daemon mds.h on smithi114 2024-09-21T00:56:27.520 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:27 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.134:6836/4289116211,v1:172.21.15.134:6837/4289116211] up:boot 2024-09-21T00:56:27.521 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:27 smithi114 ceph-mon[34309]: fsmap 7 up:standby 2024-09-21T00:56:27.521 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:27 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:56:27.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:27 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.134:6836/4289116211,v1:172.21.15.134:6837/4289116211] up:boot 2024-09-21T00:56:27.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:27 smithi134 ceph-mon[34785]: fsmap 7 up:standby 2024-09-21T00:56:27.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:27 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:56:27.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:27 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.134:6836/4289116211,v1:172.21.15.134:6837/4289116211] up:boot 2024-09-21T00:56:27.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:27 smithi047 ceph-mon[30960]: fsmap 7 up:standby 2024-09-21T00:56:27.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:27 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T00:56:27.909 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:27 smithi114 systemd[1]: Starting Ceph mds.h for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:28.063 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:28.169 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:27 smithi114 podman[62140]: 2024-09-21 00:56:27.820218307 +0000 UTC m=+0.016354408 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:28.169 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:27 smithi114 podman[62140]: 2024-09-21 00:56:27.922934931 +0000 UTC m=+0.119071031 container create f95e835f9f1afe8f5cd17b342ecc079ade5231583f89f570cf6acd32762e92af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T00:56:28.170 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:28 smithi114 podman[62140]: 2024-09-21 00:56:28.133465709 +0000 UTC m=+0.329601818 container init f95e835f9f1afe8f5cd17b342ecc079ade5231583f89f570cf6acd32762e92af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T00:56:28.170 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:28 smithi114 podman[62140]: 2024-09-21 00:56:28.136251404 +0000 UTC m=+0.332387507 container start f95e835f9f1afe8f5cd17b342ecc079ade5231583f89f570cf6acd32762e92af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:56:28.170 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-mds[62159]: -- 172.21.15.114:0/4073382118 <== mon.2 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564600b45860 con 0x564604ced600 2024-09-21T00:56:28.341 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:28.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:28 smithi047 ceph-mon[30960]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:28.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:28.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:28.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:28 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:28.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:28 smithi134 ceph-mon[34785]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:28.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:28.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:28.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:28 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:28.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-mon[34309]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:28.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:28.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:28.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:28.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:28.661 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h[62155]: starting mds.h at 2024-09-21T00:56:28.661 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:28 smithi114 bash[62140]: f95e835f9f1afe8f5cd17b342ecc079ade5231583f89f570cf6acd32762e92af 2024-09-21T00:56:28.661 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 00:56:28 smithi114 systemd[1]: Started Ceph mds.h for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:28.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2893219356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 msgr2=0x7fc228110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:28.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2893219356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 0x7fc228110670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc220009900 tx=0x7fc22002a410 comp rx=0 tx=0).stop 2024-09-21T00:56:28.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2893219356 shutdown_connections 2024-09-21T00:56:28.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2893219356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 0x7fc228110670 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2893219356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2281094f0 0x7fc228109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2893219356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc228103bb0 0x7fc228103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2893219356 >> 172.21.15.47:0/2893219356 conn(0x7fc2280ff600 msgr2=0x7fc228101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2893219356 shutdown_connections 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.837+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2893219356 wait complete. 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22cc7d640 1 Processor -- start 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22cc7d640 1 -- start start 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22cc7d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc228103bb0 0x7fc228075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22cc7d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2281094f0 0x7fc228075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22cc7d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 0x7fc228076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22cc7d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc228113b00 con 0x7fc228109e40 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22cc7d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc228113980 con 0x7fc2281094f0 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22cc7d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc228113c80 con 0x7fc228103bb0 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc226d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 0x7fc228076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:28.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc226d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 0x7fc228076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55352/0 (socket says 172.21.15.47:55352) 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc226d9d640 1 -- 172.21.15.47:0/2443094666 learned_addr learned my addr 172.21.15.47:0/2443094666 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc22659c640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc228103bb0 0x7fc228075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.838+0000 7fc225d9b640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2281094f0 0x7fc228075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc226d9d640 1 -- 172.21.15.47:0/2443094666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc228103bb0 msgr2=0x7fc228075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc226d9d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc228103bb0 0x7fc228075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc226d9d640 1 -- 172.21.15.47:0/2443094666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2281094f0 msgr2=0x7fc228075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc226d9d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2281094f0 0x7fc228075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc226d9d640 1 -- 172.21.15.47:0/2443094666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2281a8730 con 0x7fc228109e40 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc226d9d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 0x7fc228076190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc220004770 tx=0x7fc220004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc21f7fe640 1 -- 172.21.15.47:0/2443094666 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22003f030 con 0x7fc228109e40 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2281a89c0 con 0x7fc228109e40 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc21f7fe640 1 -- 172.21.15.47:0/2443094666 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc220004440 con 0x7fc228109e40 2024-09-21T00:56:28.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc21f7fe640 1 -- 172.21.15.47:0/2443094666 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220035070 con 0x7fc228109e40 2024-09-21T00:56:28.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.839+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2281a8ef0 con 0x7fc228109e40 2024-09-21T00:56:28.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.840+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc228103fc0 con 0x7fc228109e40 2024-09-21T00:56:28.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.842+0000 7fc21f7fe640 1 -- 172.21.15.47:0/2443094666 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc220042030 con 0x7fc228109e40 2024-09-21T00:56:28.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.843+0000 7fc21f7fe640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc2140b6510 0x7fc2140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:28.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.843+0000 7fc22659c640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc2140b6510 0x7fc2140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:28.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.843+0000 7fc21f7fe640 1 -- 172.21.15.47:0/2443094666 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fc2201073e0 con 0x7fc228109e40 2024-09-21T00:56:28.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.843+0000 7fc22659c640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc2140b6510 0x7fc2140b8a20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc228077160 tx=0x7fc218009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:28.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:28.846+0000 7fc21f7fe640 1 -- 172.21.15.47:0/2443094666 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2200d24f0 con 0x7fc228109e40 2024-09-21T00:56:29.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.070+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc22802e640 con 0x7fc228109e40 2024-09-21T00:56:29.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.070+0000 7fc21f7fe640 1 -- 172.21.15.47:0/2443094666 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7fc2200d7430 con 0x7fc228109e40 2024-09-21T00:56:29.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:29.071 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"btime":"2024-09-21T00:56:28:308718+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T00:56:29.071 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-09-21T00:56:29.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.072+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc2140b6510 msgr2=0x7fc2140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:29.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.072+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc2140b6510 0x7fc2140b8a20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc228077160 tx=0x7fc218009500 comp rx=0 tx=0).stop 2024-09-21T00:56:29.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.072+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 msgr2=0x7fc228076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.072+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 0x7fc228076190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc220004770 tx=0x7fc220004040 comp rx=0 tx=0).stop 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.073+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 shutdown_connections 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.073+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc2140b6510 0x7fc2140b8a20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.073+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc228109e40 0x7fc228076190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.073+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2281094f0 0x7fc228075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.073+0000 7fc22cc7d640 1 --2- 172.21.15.47:0/2443094666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc228103bb0 0x7fc228075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.073+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 >> 172.21.15.47:0/2443094666 conn(0x7fc2280ff600 msgr2=0x7fc228101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.073+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 shutdown_connections 2024-09-21T00:56:29.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:29.073+0000 7fc22cc7d640 1 -- 172.21.15.47:0/2443094666 wait complete. 2024-09-21T00:56:29.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:29 smithi134 ceph-mon[34785]: Deploying daemon mds.i on smithi134 2024-09-21T00:56:29.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:29 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.114:6836/2922289361,v1:172.21.15.114:6837/2922289361] up:boot 2024-09-21T00:56:29.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:29 smithi134 ceph-mon[34785]: fsmap 8 up:standby 2024-09-21T00:56:29.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:29 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:56:29.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:29 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2443094666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:29.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:29 smithi114 ceph-mon[34309]: Deploying daemon mds.i on smithi134 2024-09-21T00:56:29.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:29 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.114:6836/2922289361,v1:172.21.15.114:6837/2922289361] up:boot 2024-09-21T00:56:29.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:29 smithi114 ceph-mon[34309]: fsmap 8 up:standby 2024-09-21T00:56:29.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:29 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:56:29.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:29 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2443094666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:29.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:29 smithi047 ceph-mon[30960]: Deploying daemon mds.i on smithi134 2024-09-21T00:56:29.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:29 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.114:6836/2922289361,v1:172.21.15.114:6837/2922289361] up:boot 2024-09-21T00:56:29.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:29 smithi047 ceph-mon[30960]: fsmap 8 up:standby 2024-09-21T00:56:29.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:29 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T00:56:29.691 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:29 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2443094666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:30.300 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 systemd[1]: Starting Ceph mds.i for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:30.573 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:30 smithi134 ceph-mon[34785]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:30.573 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 podman[62781]: 2024-09-21 00:56:30.202715958 +0000 UTC m=+0.016177194 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:30.573 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 podman[62781]: 2024-09-21 00:56:30.309313763 +0000 UTC m=+0.122774989 container create 1f2f9abe957450da5a2faa898d401afb6b6824e3e82385ce271896da14320901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T00:56:30.573 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 podman[62781]: 2024-09-21 00:56:30.536945393 +0000 UTC m=+0.350406628 container init 1f2f9abe957450da5a2faa898d401afb6b6824e3e82385ce271896da14320901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:56:30.573 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 podman[62781]: 2024-09-21 00:56:30.539677253 +0000 UTC m=+0.353138479 container start 1f2f9abe957450da5a2faa898d401afb6b6824e3e82385ce271896da14320901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T00:56:30.573 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 ceph-mds[62801]: -- 172.21.15.134:0/917192449 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c46301860 con 0x560c4a4a9600 2024-09-21T00:56:30.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:30 smithi114 ceph-mon[34309]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:30.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:30 smithi047 ceph-mon[30960]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:30.844 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i[62797]: starting mds.i at 2024-09-21T00:56:30.844 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 bash[62781]: 1f2f9abe957450da5a2faa898d401afb6b6824e3e82385ce271896da14320901 2024-09-21T00:56:30.844 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 00:56:30 smithi134 systemd[1]: Started Ceph mds.i for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:31.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: Deploying daemon mds.g on smithi047 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.134:6838/924032014,v1:172.21.15.134:6839/924032014] up:boot 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: fsmap 9 up:standby 2024-09-21T00:56:31.747 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:31 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:56:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:32.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: Deploying daemon mds.g on smithi047 2024-09-21T00:56:32.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.134:6838/924032014,v1:172.21.15.134:6839/924032014] up:boot 2024-09-21T00:56:32.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: fsmap 9 up:standby 2024-09-21T00:56:32.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:31 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:56:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:32.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:32.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:32.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: Deploying daemon mds.g on smithi047 2024-09-21T00:56:32.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.134:6838/924032014,v1:172.21.15.134:6839/924032014] up:boot 2024-09-21T00:56:32.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: fsmap 9 up:standby 2024-09-21T00:56:32.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:31 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T00:56:32.324 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:32.701 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:32 smithi047 systemd[1]: Starting Ceph mds.g for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:32.701 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:32 smithi047 ceph-mon[30960]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.920+0000 7f0d5acf0640 1 -- 172.21.15.47:0/2409630345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d54108d10 msgr2=0x7f0d5410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.920+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/2409630345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d54108d10 0x7f0d5410f540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009ca0 tx=0x7f0d4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 -- 172.21.15.47:0/2409630345 shutdown_connections 2024-09-21T00:56:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/2409630345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d54108d10 0x7f0d5410f540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/2409630345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d541083c0 0x7f0d541087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:32.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/2409630345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d54102a80 0x7f0d54102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 -- 172.21.15.47:0/2409630345 >> 172.21.15.47:0/2409630345 conn(0x7f0d54079740 msgr2=0x7f0d54079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 -- 172.21.15.47:0/2409630345 shutdown_connections 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 -- 172.21.15.47:0/2409630345 wait complete. 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 Processor -- start 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.921+0000 7f0d5acf0640 1 -- start start 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d5acf0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d54102a80 0x7f0d5419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d5acf0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d541083c0 0x7f0d5419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d5acf0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d54108d10 0x7f0d5419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d5acf0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541129e0 con 0x7f0d541083c0 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d5acf0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54112860 con 0x7f0d54102a80 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d5acf0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54112b60 con 0x7f0d54108d10 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d541083c0 0x7f0d5419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:32.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d58a8c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d54102a80 0x7f0d5419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d541083c0 0x7f0d5419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53742/0 (socket says 172.21.15.47:53742) 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 -- 172.21.15.47:0/1344710380 learned_addr learned my addr 172.21.15.47:0/1344710380 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d5928d640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d54108d10 0x7f0d5419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 -- 172.21.15.47:0/1344710380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d54108d10 msgr2=0x7f0d5419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d54108d10 0x7f0d5419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 -- 172.21.15.47:0/1344710380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d54102a80 msgr2=0x7f0d5419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d54102a80 0x7f0d5419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 -- 172.21.15.47:0/1344710380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d541a0330 con 0x7f0d541083c0 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d58a8c640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d54102a80 0x7f0d5419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.922+0000 7f0d53fff640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d541083c0 0x7f0d5419aa20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000c970 tx=0x7f0d4000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.923+0000 7f0d51ffb640 1 -- 172.21.15.47:0/1344710380 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40014070 con 0x7f0d541083c0 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.923+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d541a0620 con 0x7f0d541083c0 2024-09-21T00:56:32.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.923+0000 7f0d51ffb640 1 -- 172.21.15.47:0/1344710380 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d40004440 con 0x7f0d541083c0 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.923+0000 7f0d51ffb640 1 -- 172.21.15.47:0/1344710380 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40003d30 con 0x7f0d541083c0 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.923+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d541a6e40 con 0x7f0d541083c0 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.924+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d54103d00 con 0x7f0d541083c0 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.925+0000 7f0d51ffb640 1 -- 172.21.15.47:0/1344710380 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0d40017070 con 0x7f0d541083c0 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.926+0000 7f0d51ffb640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d440b6540 0x7f0d440b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.926+0000 7f0d58a8c640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d440b6540 0x7f0d440b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.926+0000 7f0d51ffb640 1 -- 172.21.15.47:0/1344710380 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f0d400e68e0 con 0x7f0d541083c0 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.927+0000 7f0d58a8c640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d440b6540 0x7f0d440b8a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009d60 tx=0x7f0d48009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:32.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:32.930+0000 7f0d51ffb640 1 -- 172.21.15.47:0/1344710380 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d4001e030 con 0x7f0d541083c0 2024-09-21T00:56:33.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:32 smithi134 ceph-mon[34785]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:33.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:32 smithi114 ceph-mon[34309]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:33.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.170+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d5402e640 con 0x7f0d541083c0 2024-09-21T00:56:33.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.171+0000 7f0d51ffb640 1 -- 172.21.15.47:0/1344710380 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8046 (secure 0 0 0) 0x7f0d400ad610 con 0x7f0d541083c0 2024-09-21T00:56:33.172 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:33.172 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":10,"btime":"2024-09-21T00:56:31:322584+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T00:56:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 10 2024-09-21T00:56:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d440b6540 msgr2=0x7f0d440b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d440b6540 0x7f0d440b8a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009d60 tx=0x7f0d48009110 comp rx=0 tx=0).stop 2024-09-21T00:56:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d541083c0 msgr2=0x7f0d5419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d541083c0 0x7f0d5419aa20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000c970 tx=0x7f0d4000cd70 comp rx=0 tx=0).stop 2024-09-21T00:56:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 shutdown_connections 2024-09-21T00:56:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d440b6540 0x7f0d440b8a50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d54108d10 0x7f0d5419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d541083c0 0x7f0d5419aa20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 --2- 172.21.15.47:0/1344710380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d54102a80 0x7f0d5419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 >> 172.21.15.47:0/1344710380 conn(0x7f0d54079740 msgr2=0x7f0d5406be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.173+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 shutdown_connections 2024-09-21T00:56:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:33.174+0000 7f0d5acf0640 1 -- 172.21.15.47:0/1344710380 wait complete. 2024-09-21T00:56:33.456 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:33 smithi047 podman[69880]: 2024-09-21 00:56:33.062594395 +0000 UTC m=+0.017103269 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:33.456 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:33 smithi047 podman[69880]: 2024-09-21 00:56:33.206811438 +0000 UTC m=+0.161320305 container create bba7e9b5d4a529d90ede39f27ff991bcfda6a8b7774dca3a0275a6c26da9e968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T00:56:33.892 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:33 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1344710380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:34.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:33 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1344710380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:34.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:33 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1344710380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:34.168 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:34 smithi047 podman[69880]: 2024-09-21 00:56:34.084974137 +0000 UTC m=+1.039482997 container init bba7e9b5d4a529d90ede39f27ff991bcfda6a8b7774dca3a0275a6c26da9e968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T00:56:34.168 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:34 smithi047 podman[69880]: 2024-09-21 00:56:34.088338851 +0000 UTC m=+1.042847702 container start bba7e9b5d4a529d90ede39f27ff991bcfda6a8b7774dca3a0275a6c26da9e968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T00:56:34.168 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-mds[69916]: -- 172.21.15.47:0/2781066659 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558101247860 con 0x5581053ef600 2024-09-21T00:56:34.168 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g[69909]: starting mds.g at 2024-09-21T00:56:34.455 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:34 smithi047 bash[69880]: bba7e9b5d4a529d90ede39f27ff991bcfda6a8b7774dca3a0275a6c26da9e968 2024-09-21T00:56:34.455 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 00:56:34 smithi047 systemd[1]: Started Ceph mds.g for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:34.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-mon[30960]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:34.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:34.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:34.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:34.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:34.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:34.930 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:34 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:34 smithi134 ceph-mon[34785]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:34 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:35.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:34 smithi114 ceph-mon[34309]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:35.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:35.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:35.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:35.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:35.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:35.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:34 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:35.902 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:35 smithi047 ceph-mon[30960]: Deploying daemon mds.a on smithi047 2024-09-21T00:56:35.902 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:35 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.47:6838/1305457594,v1:172.21.15.47:6839/1305457594] up:boot 2024-09-21T00:56:35.902 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:35 smithi047 ceph-mon[30960]: fsmap 10 up:standby 2024-09-21T00:56:35.902 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:35 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:56:35.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:36.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:35 smithi134 ceph-mon[34785]: Deploying daemon mds.a on smithi047 2024-09-21T00:56:36.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:35 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.47:6838/1305457594,v1:172.21.15.47:6839/1305457594] up:boot 2024-09-21T00:56:36.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:35 smithi134 ceph-mon[34785]: fsmap 10 up:standby 2024-09-21T00:56:36.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:35 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:56:36.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:35 smithi114 ceph-mon[34309]: Deploying daemon mds.a on smithi047 2024-09-21T00:56:36.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:35 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.47:6838/1305457594,v1:172.21.15.47:6839/1305457594] up:boot 2024-09-21T00:56:36.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:35 smithi114 ceph-mon[34309]: fsmap 10 up:standby 2024-09-21T00:56:36.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:35 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T00:56:36.205 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 systemd[1]: Starting Ceph mds.a for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:36.706 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 podman[70181]: 2024-09-21 00:56:36.232328933 +0000 UTC m=+0.016887208 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:36.706 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 podman[70181]: 2024-09-21 00:56:36.35493906 +0000 UTC m=+0.139497333 container create 2ed37a86bd1b08f8e4e4d6260a6dacab7ac6a315d670c2203ce0c01219738361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T00:56:36.859 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:36.982 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:36 smithi047 ceph-mon[30960]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:36.982 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 podman[70181]: 2024-09-21 00:56:36.732893191 +0000 UTC m=+0.517451475 container init 2ed37a86bd1b08f8e4e4d6260a6dacab7ac6a315d670c2203ce0c01219738361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T00:56:36.982 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 podman[70181]: 2024-09-21 00:56:36.736015479 +0000 UTC m=+0.520573745 container start 2ed37a86bd1b08f8e4e4d6260a6dacab7ac6a315d670c2203ce0c01219738361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T00:56:36.982 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 ceph-mds[70224]: -- 172.21.15.47:0/158660479 <== mon.0 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a2fd43860 con 0x563a33eeba80 2024-09-21T00:56:36.982 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a[70210]: starting mds.a at 2024-09-21T00:56:36.982 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 bash[70181]: 2ed37a86bd1b08f8e4e4d6260a6dacab7ac6a315d670c2203ce0c01219738361 2024-09-21T00:56:36.983 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 00:56:36 smithi047 systemd[1]: Started Ceph mds.a for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:37.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:36 smithi134 ceph-mon[34785]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:37.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:36 smithi114 ceph-mon[34309]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:37.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 -- 172.21.15.47:0/4072804230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4108d10 msgr2=0x7f1aa410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:37.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/4072804230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4108d10 0x7f1aa410f540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009900 tx=0x7f1a9402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:37.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 -- 172.21.15.47:0/4072804230 shutdown_connections 2024-09-21T00:56:37.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/4072804230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4108d10 0x7f1aa410f540 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/4072804230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aa41083c0 0x7f1aa41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/4072804230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aa4102a80 0x7f1aa4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 -- 172.21.15.47:0/4072804230 >> 172.21.15.47:0/4072804230 conn(0x7f1aa4079740 msgr2=0x7f1aa4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 -- 172.21.15.47:0/4072804230 shutdown_connections 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.389+0000 7f1aab0d8640 1 -- 172.21.15.47:0/4072804230 wait complete. 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aab0d8640 1 Processor -- start 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aab0d8640 1 -- start start 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aab0d8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4102a80 0x7f1aa410ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aab0d8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aa41083c0 0x7f1aa4110510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aab0d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aa4108d10 0x7f1aa4110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aab0d8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4113aa0 con 0x7f1aa4102a80 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aab0d8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4113920 con 0x7f1aa41083c0 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aab0d8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4113c20 con 0x7f1aa4108d10 2024-09-21T00:56:37.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa8e74640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4102a80 0x7f1aa410ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa8e74640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4102a80 0x7f1aa410ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53768/0 (socket says 172.21.15.47:53768) 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa8e74640 1 -- 172.21.15.47:0/3009916595 learned_addr learned my addr 172.21.15.47:0/3009916595 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa3fff640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aa41083c0 0x7f1aa4110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa9675640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aa4108d10 0x7f1aa4110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa8e74640 1 -- 172.21.15.47:0/3009916595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aa4108d10 msgr2=0x7f1aa4110a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa8e74640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aa4108d10 0x7f1aa4110a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa8e74640 1 -- 172.21.15.47:0/3009916595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aa41083c0 msgr2=0x7f1aa4110510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa8e74640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aa41083c0 0x7f1aa4110510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.390+0000 7f1aa8e74640 1 -- 172.21.15.47:0/3009916595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa41a8770 con 0x7f1aa4102a80 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.391+0000 7f1aa8e74640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4102a80 0x7f1aa410ffd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00ea80 tx=0x7f1a9c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.391+0000 7f1aa1ffb640 1 -- 172.21.15.47:0/3009916595 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00ce40 con 0x7f1aa4102a80 2024-09-21T00:56:37.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.391+0000 7f1aa1ffb640 1 -- 172.21.15.47:0/3009916595 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a9c005020 con 0x7f1aa4102a80 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.391+0000 7f1aa1ffb640 1 -- 172.21.15.47:0/3009916595 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c0116d0 con 0x7f1aa4102a80 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.391+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa41a8a60 con 0x7f1aa4102a80 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.391+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa41a8f50 con 0x7f1aa4102a80 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.392+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa4103d00 con 0x7f1aa4102a80 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.394+0000 7f1aa1ffb640 1 -- 172.21.15.47:0/3009916595 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f1a9c0054d0 con 0x7f1aa4102a80 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.394+0000 7f1aa1ffb640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1a8c0b6510 0x7f1a8c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.395+0000 7f1aa3fff640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1a8c0b6510 0x7f1a8c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.395+0000 7f1aa1ffb640 1 -- 172.21.15.47:0/3009916595 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f1a9c0e74e0 con 0x7f1aa4102a80 2024-09-21T00:56:37.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.395+0000 7f1aa3fff640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1a8c0b6510 0x7f1a8c0b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4105f20 tx=0x7f1a9800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:37.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.398+0000 7f1aa1ffb640 1 -- 172.21.15.47:0/3009916595 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a9c016030 con 0x7f1aa4102a80 2024-09-21T00:56:37.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.622+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1aa41112d0 con 0x7f1aa4102a80 2024-09-21T00:56:37.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.623+0000 7f1aa1ffb640 1 -- 172.21.15.47:0/3009916595 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8872 (secure 0 0 0) 0x7f1a9c0ae210 con 0x7f1aa4102a80 2024-09-21T00:56:37.624 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:37.624 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":11,"btime":"2024-09-21T00:56:34:704422+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T00:56:37.624 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 11 2024-09-21T00:56:37.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.625+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1a8c0b6510 msgr2=0x7f1a8c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:37.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.625+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1a8c0b6510 0x7f1a8c0b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4105f20 tx=0x7f1a9800b390 comp rx=0 tx=0).stop 2024-09-21T00:56:37.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.625+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4102a80 msgr2=0x7f1aa410ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:37.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.625+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4102a80 0x7f1aa410ffd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00ea80 tx=0x7f1a9c00ef40 comp rx=0 tx=0).stop 2024-09-21T00:56:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.626+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 shutdown_connections 2024-09-21T00:56:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.626+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1a8c0b6510 0x7f1a8c0b8a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.626+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1aa4108d10 0x7f1aa4110a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.626+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aa41083c0 0x7f1aa4110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.626+0000 7f1aab0d8640 1 --2- 172.21.15.47:0/3009916595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa4102a80 0x7f1aa410ffd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.626+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 >> 172.21.15.47:0/3009916595 conn(0x7f1aa4079740 msgr2=0x7f1aa4104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.626+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 shutdown_connections 2024-09-21T00:56:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:37.626+0000 7f1aab0d8640 1 -- 172.21.15.47:0/3009916595 wait complete. 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: Deploying daemon mds.b on smithi114 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3009916595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.47:6840/1666315878,v1:172.21.15.47:6841/1666315878] up:boot 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: fsmap 11 up:standby 2024-09-21T00:56:37.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:37 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:56:38.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: Deploying daemon mds.b on smithi114 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3009916595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.47:6840/1666315878,v1:172.21.15.47:6841/1666315878] up:boot 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: fsmap 11 up:standby 2024-09-21T00:56:38.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:37 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:56:38.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:38.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:38.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:38.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T00:56:38.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T00:56:38.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:38.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: Deploying daemon mds.b on smithi114 2024-09-21T00:56:38.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3009916595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:38.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.47:6840/1666315878,v1:172.21.15.47:6841/1666315878] up:boot 2024-09-21T00:56:38.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: fsmap 11 up:standby 2024-09-21T00:56:38.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:37 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T00:56:39.119 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:38 smithi114 ceph-mon[34309]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:39.119 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:38 smithi114 systemd[1]: Starting Ceph mds.b for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T00:56:39.119 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:39 smithi114 podman[62409]: 2024-09-21 00:56:39.021604491 +0000 UTC m=+0.015856039 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T00:56:39.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:38 smithi047 ceph-mon[30960]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:39.245 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:38 smithi134 ceph-mon[34785]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:39.370 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:39 smithi114 podman[62409]: 2024-09-21 00:56:39.139143625 +0000 UTC m=+0.133395155 container create 51291ae2298c4491d6b23019c4882c93e4140336244a495a6ffe4a35efb9b231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T00:56:39.370 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:39 smithi114 podman[62409]: 2024-09-21 00:56:39.370347018 +0000 UTC m=+0.364598555 container init 51291ae2298c4491d6b23019c4882c93e4140336244a495a6ffe4a35efb9b231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T00:56:39.659 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:39 smithi114 podman[62409]: 2024-09-21 00:56:39.373937984 +0000 UTC m=+0.368189513 container start 51291ae2298c4491d6b23019c4882c93e4140336244a495a6ffe4a35efb9b231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T00:56:39.659 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:39 smithi114 ceph-mds[62429]: -- 172.21.15.114:0/2247339780 <== mon.2 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8aff9f860 con 0x55b8b4147180 2024-09-21T00:56:39.659 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:39 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b[62424]: starting mds.b at 2024-09-21T00:56:39.659 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:39 smithi114 bash[62409]: 51291ae2298c4491d6b23019c4882c93e4140336244a495a6ffe4a35efb9b231 2024-09-21T00:56:39.660 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:39 smithi114 systemd[1]: Started Ceph mds.b for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T00:56:40.249 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:56:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:40.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] up:boot 2024-09-21T00:56:40.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: fsmap 12 up:standby 2024-09-21T00:56:40.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:40 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:56:40.850 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:40.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] up:boot 2024-09-21T00:56:40.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: fsmap 12 up:standby 2024-09-21T00:56:40.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:40 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:56:40.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:40.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] up:boot 2024-09-21T00:56:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: fsmap 12 up:standby 2024-09-21T00:56:40.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:40 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T00:56:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.317+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/2373963852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106340 msgr2=0x7fbcbc106750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.317+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/2373963852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106340 0x7fbcbc106750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009900 tx=0x7fbcb002a410 comp rx=0 tx=0).stop 2024-09-21T00:56:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.317+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/2373963852 shutdown_connections 2024-09-21T00:56:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.317+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/2373963852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcbc106c90 0x7fbcbc1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.317+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/2373963852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106340 0x7fbcbc106750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.317+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/2373963852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcbc102060 0x7fbcbc102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.317+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/2373963852 >> 172.21.15.47:0/2373963852 conn(0x7fbcbc079ea0 msgr2=0x7fbcbc07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.317+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/2373963852 shutdown_connections 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.318+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/2373963852 wait complete. 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.318+0000 7fbcc2e0e640 1 Processor -- start 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.318+0000 7fbcc2e0e640 1 -- start start 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc2e0e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcbc102060 0x7fbcbc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc2e0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcbc106340 0x7fbcbc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc2e0e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106c90 0x7fbcbc19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc2e0e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc113af0 con 0x7fbcbc106c90 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc2e0e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc113970 con 0x7fbcbc102060 2024-09-21T00:56:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc2e0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc113c70 con 0x7fbcbc106340 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106c90 0x7fbcbc19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106c90 0x7fbcbc19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53782/0 (socket says 172.21.15.47:53782) 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 -- 172.21.15.47:0/3776589506 learned_addr learned my addr 172.21.15.47:0/3776589506 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcbbfff640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcbc106340 0x7fbcbc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc0baa640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcbc102060 0x7fbcbc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 -- 172.21.15.47:0/3776589506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcbc106340 msgr2=0x7fbcbc19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcbc106340 0x7fbcbc19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 -- 172.21.15.47:0/3776589506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcbc102060 msgr2=0x7fbcbc19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcbc102060 0x7fbcbc19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 -- 172.21.15.47:0/3776589506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc1a04d0 con 0x7fbcbc106c90 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc13ab640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106c90 0x7fbcbc19fda0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009fd0 tx=0x7fbcb400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcb9ffb640 1 -- 172.21.15.47:0/3776589506 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4017070 con 0x7fbcbc106c90 2024-09-21T00:56:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.319+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcbc1a07c0 con 0x7fbcbc106c90 2024-09-21T00:56:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.320+0000 7fbcb9ffb640 1 -- 172.21.15.47:0/3776589506 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcb4003e20 con 0x7fbcbc106c90 2024-09-21T00:56:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.320+0000 7fbcb9ffb640 1 -- 172.21.15.47:0/3776589506 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4010460 con 0x7fbcbc106c90 2024-09-21T00:56:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.320+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcbc1a6f20 con 0x7fbcbc106c90 2024-09-21T00:56:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.321+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcbc06b970 con 0x7fbcbc106c90 2024-09-21T00:56:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.323+0000 7fbcb9ffb640 1 -- 172.21.15.47:0/3776589506 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fbcb4003970 con 0x7fbcbc106c90 2024-09-21T00:56:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.324+0000 7fbcb9ffb640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbca40b6510 0x7fbca40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.324+0000 7fbcc0baa640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbca40b6510 0x7fbca40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.324+0000 7fbcb9ffb640 1 -- 172.21.15.47:0/3776589506 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fbcb40e6b20 con 0x7fbcbc106c90 2024-09-21T00:56:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.325+0000 7fbcc0baa640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbca40b6510 0x7fbca40b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00bbe0 tx=0x7fbcac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.327+0000 7fbcb9ffb640 1 -- 172.21.15.47:0/3776589506 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbcb40b1c30 con 0x7fbcbc106c90 2024-09-21T00:56:41.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.569+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcbc10bc10 con 0x7fbcbc106c90 2024-09-21T00:56:41.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.570+0000 7fbcb9ffb640 1 -- 172.21.15.47:0/3776589506 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7fbcb40b6b70 con 0x7fbcbc106c90 2024-09-21T00:56:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:41.571 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":13,"btime":"2024-09-21T00:56:39:894715+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T00:56:41.572 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 13 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbca40b6510 msgr2=0x7fbca40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbca40b6510 0x7fbca40b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00bbe0 tx=0x7fbcac00b390 comp rx=0 tx=0).stop 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106c90 msgr2=0x7fbcbc19fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106c90 0x7fbcbc19fda0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009fd0 tx=0x7fbcb400b260 comp rx=0 tx=0).stop 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 shutdown_connections 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbca40b6510 0x7fbca40b8a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcbc106c90 0x7fbcbc19fda0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcbc106340 0x7fbcbc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 --2- 172.21.15.47:0/3776589506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcbc102060 0x7fbcbc19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.573+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 >> 172.21.15.47:0/3776589506 conn(0x7fbcbc079ea0 msgr2=0x7fbcbc107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:41.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.574+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 shutdown_connections 2024-09-21T00:56:41.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:41.574+0000 7fbcc2e0e640 1 -- 172.21.15.47:0/3776589506 wait complete. 2024-09-21T00:56:41.896 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.896 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.896 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.896 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.896 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.896 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.896 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:41 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.897 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:41 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3776589506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:41.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:41 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:41.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:41 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3776589506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:41 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:41 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3776589506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:56:42.242 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T00:56:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:42 smithi134 ceph-mon[34785]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:42 smithi114 ceph-mon[34309]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:42.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:42 smithi047 ceph-mon[30960]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:42.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:42.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:42.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:42.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:56:43.146 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:43.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 -- 172.21.15.47:0/1582023816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4102a60 msgr2=0x7ff1c4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/1582023816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4102a60 0x7ff1c4102e70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009900 tx=0x7ff1b402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:43.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 -- 172.21.15.47:0/1582023816 shutdown_connections 2024-09-21T00:56:43.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/1582023816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c4108cf0 0x7ff1c410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/1582023816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c41083a0 0x7ff1c41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/1582023816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4102a60 0x7ff1c4102e70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 -- 172.21.15.47:0/1582023816 >> 172.21.15.47:0/1582023816 conn(0x7ff1c4079730 msgr2=0x7ff1c4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:43.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 -- 172.21.15.47:0/1582023816 shutdown_connections 2024-09-21T00:56:43.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.653+0000 7ff1c9bac640 1 -- 172.21.15.47:0/1582023816 wait complete. 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.654+0000 7ff1c9bac640 1 Processor -- start 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.654+0000 7ff1c9bac640 1 -- start start 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c9bac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c4102a60 0x7ff1c410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c9bac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c41083a0 0x7ff1c41102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c9bac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4108cf0 0x7ff1c4110830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c9bac640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4113a70 con 0x7ff1c4108cf0 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c9bac640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41138f0 con 0x7ff1c4102a60 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c9bac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4113bf0 con 0x7ff1c41083a0 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4108cf0 0x7ff1c4110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c4102a60 0x7ff1c410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c4102a60 0x7ff1c410fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:49380/0 (socket says 172.21.15.47:49380) 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 -- 172.21.15.47:0/3549452771 learned_addr learned my addr 172.21.15.47:0/3549452771 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c2ffd640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c41083a0 0x7ff1c41102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4108cf0 0x7ff1c4110830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47136/0 (socket says 172.21.15.47:47136) 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 -- 172.21.15.47:0/3549452771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c41083a0 msgr2=0x7ff1c41102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c41083a0 0x7ff1c41102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 -- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4108cf0 msgr2=0x7ff1c4110830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4108cf0 0x7ff1c4110830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 -- 172.21.15.47:0/3549452771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c41a86e0 con 0x7ff1c4102a60 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c3fff640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4108cf0 0x7ff1c4110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c37fe640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c4102a60 0x7ff1c410fdb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4005940 tx=0x7ff1b40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.655+0000 7ff1c0ff9640 1 -- 172.21.15.47:0/3549452771 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b403f030 con 0x7ff1c4102a60 2024-09-21T00:56:43.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.656+0000 7ff1c0ff9640 1 -- 172.21.15.47:0/3549452771 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1b4003cb0 con 0x7ff1c4102a60 2024-09-21T00:56:43.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.656+0000 7ff1c0ff9640 1 -- 172.21.15.47:0/3549452771 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4035070 con 0x7ff1c4102a60 2024-09-21T00:56:43.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.656+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c41a8970 con 0x7ff1c4102a60 2024-09-21T00:56:43.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.656+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c41a8e00 con 0x7ff1c4102a60 2024-09-21T00:56:43.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.657+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c4102e70 con 0x7ff1c4102a60 2024-09-21T00:56:43.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.658+0000 7ff1c0ff9640 1 -- 172.21.15.47:0/3549452771 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7ff1b4042030 con 0x7ff1c4102a60 2024-09-21T00:56:43.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.659+0000 7ff1c0ff9640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff1ac0b6590 0x7ff1ac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:43.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.659+0000 7ff1c2ffd640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff1ac0b6590 0x7ff1ac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:43.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.659+0000 7ff1c0ff9640 1 -- 172.21.15.47:0/3549452771 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7ff1b4107900 con 0x7ff1c4102a60 2024-09-21T00:56:43.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.659+0000 7ff1c2ffd640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff1ac0b6590 0x7ff1ac0b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4100c50 tx=0x7ff1b800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:43.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.662+0000 7ff1c0ff9640 1 -- 172.21.15.47:0/3549452771 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff1b40d2970 con 0x7ff1c4102a60 2024-09-21T00:56:43.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.857+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff1c402e640 con 0x7ff1c4102a60 2024-09-21T00:56:43.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.858+0000 7ff1c0ff9640 1 -- 172.21.15.47:0/3549452771 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7ff1b40d78b0 con 0x7ff1c4102a60 2024-09-21T00:56:43.859 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:43.859 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-09-21T00:56:43.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T00:56:43.860 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-09-21T00:56:43.860 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-09-21T00:56:43.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:56:43.860 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-09-21T00:56:43.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff1ac0b6590 msgr2=0x7ff1ac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff1ac0b6590 0x7ff1ac0b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4100c50 tx=0x7ff1b800b410 comp rx=0 tx=0).stop 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c4102a60 msgr2=0x7ff1c410fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c4102a60 0x7ff1c410fdb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4005940 tx=0x7ff1b40042f0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 shutdown_connections 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff1ac0b6590 0x7ff1ac0b8aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1c4108cf0 0x7ff1c4110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c41083a0 0x7ff1c41102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 --2- 172.21.15.47:0/3549452771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c4102a60 0x7ff1c410fdb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 >> 172.21.15.47:0/3549452771 conn(0x7ff1c4079730 msgr2=0x7ff1c4101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 shutdown_connections 2024-09-21T00:56:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:43.862+0000 7ff1c9bac640 1 -- 172.21.15.47:0/3549452771 wait complete. 2024-09-21T00:56:44.492 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T00:56:44.493 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T00:56:44.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:44 smithi114 ceph-mon[34309]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:44.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:44 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3549452771' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:56:44.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:44 smithi047 ceph-mon[30960]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:44.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:44 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3549452771' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:56:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:44 smithi134 ceph-mon[34785]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:44 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3549452771' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T00:56:45.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 -- 172.21.15.47:0/3032560120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc10de30 msgr2=0x7fe1dc110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:45.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 --2- 172.21.15.47:0/3032560120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc10de30 0x7fe1dc110300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009900 tx=0x7fe1d402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:45.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 -- 172.21.15.47:0/3032560120 shutdown_connections 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 --2- 172.21.15.47:0/3032560120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc10de30 0x7fe1dc110300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 --2- 172.21.15.47:0/3032560120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc1052b0 0x7fe1dc10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 --2- 172.21.15.47:0/3032560120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1dc104880 0x7fe1dc104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 -- 172.21.15.47:0/3032560120 >> 172.21.15.47:0/3032560120 conn(0x7fe1dc079730 msgr2=0x7fe1dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 -- 172.21.15.47:0/3032560120 shutdown_connections 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.264+0000 7fe1e196e640 1 -- 172.21.15.47:0/3032560120 wait complete. 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1e196e640 1 Processor -- start 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1e196e640 1 -- start start 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1e196e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc104880 0x7fe1dc19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1e196e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1dc1052b0 0x7fe1dc19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1e196e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc10de30 0x7fe1dc19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1e196e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc113a70 con 0x7fe1dc104880 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1e196e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1138f0 con 0x7fe1dc10de30 2024-09-21T00:56:45.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1e196e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc113bf0 con 0x7fe1dc1052b0 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc104880 0x7fe1dc19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc104880 0x7fe1dc19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47160/0 (socket says 172.21.15.47:47160) 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1daffd640 1 -- 172.21.15.47:0/1033250506 learned_addr learned my addr 172.21.15.47:0/1033250506 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1da7fc640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1dc1052b0 0x7fe1dc19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.265+0000 7fe1db7fe640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc10de30 0x7fe1dc19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1daffd640 1 -- 172.21.15.47:0/1033250506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1dc1052b0 msgr2=0x7fe1dc19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1daffd640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1dc1052b0 0x7fe1dc19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1daffd640 1 -- 172.21.15.47:0/1033250506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc10de30 msgr2=0x7fe1dc19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1daffd640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc10de30 0x7fe1dc19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1daffd640 1 -- 172.21.15.47:0/1033250506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc1a02d0 con 0x7fe1dc104880 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1da7fc640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1dc1052b0 0x7fe1dc19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1daffd640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc104880 0x7fe1dc19a420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00ccb0 tx=0x7fe1cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:45.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1e096c640 1 -- 172.21.15.47:0/1033250506 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc003b70 con 0x7fe1dc104880 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1e096c640 1 -- 172.21.15.47:0/1033250506 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1cc00ae50 con 0x7fe1dc104880 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc1a05c0 con 0x7fe1dc104880 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1e096c640 1 -- 172.21.15.47:0/1033250506 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00f6f0 con 0x7fe1dc104880 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.266+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc1a6de0 con 0x7fe1dc104880 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.267+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1dc104c90 con 0x7fe1dc104880 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.269+0000 7fe1e096c640 1 -- 172.21.15.47:0/1033250506 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fe1cc004000 con 0x7fe1dc104880 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.270+0000 7fe1e096c640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c80b6540 0x7fe1c80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.270+0000 7fe1da7fc640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c80b6540 0x7fe1c80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.270+0000 7fe1e096c640 1 -- 172.21.15.47:0/1033250506 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fe1cc0e7420 con 0x7fe1dc104880 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.270+0000 7fe1da7fc640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c80b6540 0x7fe1c80b8a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc10fb50 tx=0x7fe1c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:45.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.273+0000 7fe1e096c640 1 -- 172.21.15.47:0/1033250506 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1cc014070 con 0x7fe1dc104880 2024-09-21T00:56:45.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.463+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe1dc1a70d0 con 0x7fe1dc104880 2024-09-21T00:56:45.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.613+0000 7fe1e096c640 1 -- 172.21.15.47:0/1033250506 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7fe1cc0ae150 con 0x7fe1dc104880 2024-09-21T00:56:45.614 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-09-21T00:56:45.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c80b6540 msgr2=0x7fe1c80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:45.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c80b6540 0x7fe1c80b8a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc10fb50 tx=0x7fe1c4005f90 comp rx=0 tx=0).stop 2024-09-21T00:56:45.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc104880 msgr2=0x7fe1dc19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:45.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc104880 0x7fe1dc19a420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00ccb0 tx=0x7fe1cc00a620 comp rx=0 tx=0).stop 2024-09-21T00:56:45.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 shutdown_connections 2024-09-21T00:56:45.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c80b6540 0x7fe1c80b8a50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc10de30 0x7fe1dc19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1dc1052b0 0x7fe1dc19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 --2- 172.21.15.47:0/1033250506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1dc104880 0x7fe1dc19a420 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:45.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 >> 172.21.15.47:0/1033250506 conn(0x7fe1dc079730 msgr2=0x7fe1dc107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:45.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 shutdown_connections 2024-09-21T00:56:45.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:45.616+0000 7fe1e196e640 1 -- 172.21.15.47:0/1033250506 wait complete. 2024-09-21T00:56:45.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:45 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:45.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:45 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1033250506' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:56:45.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:45.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:45.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:45.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:45.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:45 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:45.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:45 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1033250506' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:56:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:56:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:56:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:45 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:56:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:45 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1033250506' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T00:56:46.269 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T00:56:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:46 smithi114 ceph-mon[34309]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:46 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1033250506' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:56:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:46 smithi114 ceph-mon[34309]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:56:46.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:46 smithi047 ceph-mon[30960]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:46.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:46 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1033250506' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:56:46.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:46 smithi047 ceph-mon[30960]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:56:47.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 -- 172.21.15.47:0/520089122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8108d10 msgr2=0x7fc4a810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/520089122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8108d10 0x7fc4a810f540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009ca0 tx=0x7fc4a002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 -- 172.21.15.47:0/520089122 shutdown_connections 2024-09-21T00:56:47.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/520089122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8108d10 0x7fc4a810f540 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/520089122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a81083c0 0x7fc4a81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/520089122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4a8102a80 0x7fc4a8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 -- 172.21.15.47:0/520089122 >> 172.21.15.47:0/520089122 conn(0x7fc4a8079740 msgr2=0x7fc4a8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:47.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 -- 172.21.15.47:0/520089122 shutdown_connections 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.024+0000 7fc4ae89b640 1 -- 172.21.15.47:0/520089122 wait complete. 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ae89b640 1 Processor -- start 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ae89b640 1 -- start start 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ae89b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8102a80 0x7fc4a80ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ae89b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4a81083c0 0x7fc4a80ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ae89b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a8108d10 0x7fc4a8100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ae89b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8112980 con 0x7fc4a8102a80 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ae89b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8112800 con 0x7fc4a8108d10 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ae89b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8112b00 con 0x7fc4a81083c0 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8102a80 0x7fc4a80ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8102a80 0x7fc4a80ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47186/0 (socket says 172.21.15.47:47186) 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4a7fff640 1 -- 172.21.15.47:0/1811051607 learned_addr learned my addr 172.21.15.47:0/1811051607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4ace38640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a8108d10 0x7fc4a8100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.025+0000 7fc4a77fe640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4a81083c0 0x7fc4a80ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a7fff640 1 -- 172.21.15.47:0/1811051607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4a81083c0 msgr2=0x7fc4a80ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a7fff640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4a81083c0 0x7fc4a80ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a7fff640 1 -- 172.21.15.47:0/1811051607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a8108d10 msgr2=0x7fc4a8100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a7fff640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a8108d10 0x7fc4a8100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a7fff640 1 -- 172.21.15.47:0/1811051607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a81a86e0 con 0x7fc4a8102a80 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a77fe640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4a81083c0 0x7fc4a80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a7fff640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8102a80 0x7fc4a80ff690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc49800e9f0 tx=0x7fc49800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a57fa640 1 -- 172.21.15.47:0/1811051607 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49800cd80 con 0x7fc4a8102a80 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a81a89d0 con 0x7fc4a8102a80 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a57fa640 1 -- 172.21.15.47:0/1811051607 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4980054d0 con 0x7fc4a8102a80 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4a57fa640 1 -- 172.21.15.47:0/1811051607 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498010690 con 0x7fc4a8102a80 2024-09-21T00:56:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.026+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a81a8f10 con 0x7fc4a8102a80 2024-09-21T00:56:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.027+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a8103d00 con 0x7fc4a8102a80 2024-09-21T00:56:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.029+0000 7fc4a57fa640 1 -- 172.21.15.47:0/1811051607 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc498004e30 con 0x7fc4a8102a80 2024-09-21T00:56:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.030+0000 7fc4a57fa640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc4900b6510 0x7fc4900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.030+0000 7fc4a77fe640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc4900b6510 0x7fc4900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.030+0000 7fc4a57fa640 1 -- 172.21.15.47:0/1811051607 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7497+0+0 (secure 0 0 0) 0x7fc4980e7710 con 0x7fc4a8102a80 2024-09-21T00:56:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.030+0000 7fc4a77fe640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc4900b6510 0x7fc4900b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0058c0 tx=0x7fc49c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.033+0000 7fc4a57fa640 1 -- 172.21.15.47:0/1811051607 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc498056710 con 0x7fc4a8102a80 2024-09-21T00:56:47.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:46 smithi134 ceph-mon[34785]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:47.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:46 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1033250506' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T00:56:47.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:46 smithi134 ceph-mon[34785]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T00:56:47.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.225+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc4a810b560 con 0x7fc4a8102a80 2024-09-21T00:56:47.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.626+0000 7fc4a57fa640 1 -- 172.21.15.47:0/1811051607 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7fc4980ae230 con 0x7fc4a8102a80 2024-09-21T00:56:47.628 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-09-21T00:56:47.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc4900b6510 msgr2=0x7fc4900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc4900b6510 0x7fc4900b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0058c0 tx=0x7fc49c005850 comp rx=0 tx=0).stop 2024-09-21T00:56:47.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8102a80 msgr2=0x7fc4a80ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:47.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8102a80 0x7fc4a80ff690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc49800e9f0 tx=0x7fc49800edf0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 shutdown_connections 2024-09-21T00:56:47.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc4900b6510 0x7fc4900b8a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a8108d10 0x7fc4a8100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4a81083c0 0x7fc4a80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 --2- 172.21.15.47:0/1811051607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4a8102a80 0x7fc4a80ff690 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:47.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 >> 172.21.15.47:0/1811051607 conn(0x7fc4a8079740 msgr2=0x7fc4a806be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:47.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.630+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 shutdown_connections 2024-09-21T00:56:47.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:47.631+0000 7fc4ae89b640 1 -- 172.21.15.47:0/1811051607 wait complete. 2024-09-21T00:56:47.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:47 smithi114 ceph-mon[34309]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:56:47.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:47 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1811051607' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:56:47.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:47 smithi047 ceph-mon[30960]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:56:47.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:47 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1811051607' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:56:48.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:47 smithi134 ceph-mon[34785]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T00:56:48.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:47 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1811051607' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T00:56:48.274 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T00:56:48.538 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:48.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:48 smithi047 ceph-mon[30960]: pgmap v283: 33 pgs: 14 active+clean, 2 creating+activating, 7 creating+peering, 10 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:48.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:48 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1811051607' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:56:48.908 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:48 smithi047 ceph-mon[30960]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:56:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:48 smithi114 ceph-mon[34309]: pgmap v283: 33 pgs: 14 active+clean, 2 creating+activating, 7 creating+peering, 10 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:48 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1811051607' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:56:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:48 smithi114 ceph-mon[34309]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:56:49.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.002+0000 7fbbb9331640 1 -- 172.21.15.47:0/2350386613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 msgr2=0x7fbbb4104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.002+0000 7fbbb9331640 1 --2- 172.21.15.47:0/2350386613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 0x7fbbb4104de0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009900 tx=0x7fbba402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.003+0000 7fbbb9331640 1 -- 172.21.15.47:0/2350386613 shutdown_connections 2024-09-21T00:56:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.003+0000 7fbbb9331640 1 --2- 172.21.15.47:0/2350386613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb410de30 0x7fbbb4110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.003+0000 7fbbb9331640 1 --2- 172.21.15.47:0/2350386613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4105320 0x7fbbb410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.003+0000 7fbbb9331640 1 --2- 172.21.15.47:0/2350386613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 0x7fbbb4104de0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.003+0000 7fbbb9331640 1 -- 172.21.15.47:0/2350386613 >> 172.21.15.47:0/2350386613 conn(0x7fbbb4079740 msgr2=0x7fbbb4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.003+0000 7fbbb9331640 1 -- 172.21.15.47:0/2350386613 shutdown_connections 2024-09-21T00:56:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.003+0000 7fbbb9331640 1 -- 172.21.15.47:0/2350386613 wait complete. 2024-09-21T00:56:49.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.003+0000 7fbbb9331640 1 Processor -- start 2024-09-21T00:56:49.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb9331640 1 -- start start 2024-09-21T00:56:49.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb9331640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 0x7fbbb419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:49.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb9331640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4105320 0x7fbbb419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:49.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb9331640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb410de30 0x7fbbb419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:49.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb9331640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4113ad0 con 0x7fbbb41049d0 2024-09-21T00:56:49.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb9331640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4113950 con 0x7fbbb410de30 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb9331640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4113c50 con 0x7fbbb4105320 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 0x7fbbb419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 0x7fbbb419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47206/0 (socket says 172.21.15.47:47206) 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb2ffd640 1 -- 172.21.15.47:0/1046999710 learned_addr learned my addr 172.21.15.47:0/1046999710 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb27fc640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4105320 0x7fbbb419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb37fe640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb410de30 0x7fbbb419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb2ffd640 1 -- 172.21.15.47:0/1046999710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4105320 msgr2=0x7fbbb419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb2ffd640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4105320 0x7fbbb419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb2ffd640 1 -- 172.21.15.47:0/1046999710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb410de30 msgr2=0x7fbbb419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb2ffd640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb410de30 0x7fbbb419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.004+0000 7fbbb2ffd640 1 -- 172.21.15.47:0/1046999710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb41a0470 con 0x7fbbb41049d0 2024-09-21T00:56:49.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.005+0000 7fbbb2ffd640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 0x7fbbb419a500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbba4006010 tx=0x7fbba4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.005+0000 7fbb9bfff640 1 -- 172.21.15.47:0/1046999710 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba403f030 con 0x7fbbb41049d0 2024-09-21T00:56:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.005+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb41a0700 con 0x7fbbb41049d0 2024-09-21T00:56:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.005+0000 7fbb9bfff640 1 -- 172.21.15.47:0/1046999710 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbba4003aa0 con 0x7fbbb41049d0 2024-09-21T00:56:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.005+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb41a6ec0 con 0x7fbbb41049d0 2024-09-21T00:56:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.005+0000 7fbb9bfff640 1 -- 172.21.15.47:0/1046999710 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4035070 con 0x7fbbb41049d0 2024-09-21T00:56:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.006+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb406c240 con 0x7fbbb41049d0 2024-09-21T00:56:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.008+0000 7fbb9bfff640 1 -- 172.21.15.47:0/1046999710 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fbba4042030 con 0x7fbbb41049d0 2024-09-21T00:56:49.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.009+0000 7fbb9bfff640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb9c0b6510 0x7fbb9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:49.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.009+0000 7fbbb27fc640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb9c0b6510 0x7fbb9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:49.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.009+0000 7fbb9bfff640 1 -- 172.21.15.47:0/1046999710 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7879+0+0 (secure 0 0 0) 0x7fbba4107a40 con 0x7fbbb41049d0 2024-09-21T00:56:49.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.009+0000 7fbbb27fc640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb9c0b6510 0x7fbb9c0b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbb407a080 tx=0x7fbba800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:49.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.012+0000 7fbb9bfff640 1 -- 172.21.15.47:0/1046999710 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbba40d27c0 con 0x7fbbb41049d0 2024-09-21T00:56:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:48 smithi134 ceph-mon[34785]: pgmap v283: 33 pgs: 14 active+clean, 2 creating+activating, 7 creating+peering, 10 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:48 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1811051607' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T00:56:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:48 smithi134 ceph-mon[34785]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T00:56:49.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.240+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbbb4104de0 con 0x7fbbb41049d0 2024-09-21T00:56:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.646+0000 7fbb9bfff640 1 -- 172.21.15.47:0/1046999710 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fbba40d7700 con 0x7fbbb41049d0 2024-09-21T00:56:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T00:56:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb9c0b6510 msgr2=0x7fbb9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb9c0b6510 0x7fbb9c0b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbb407a080 tx=0x7fbba800b390 comp rx=0 tx=0).stop 2024-09-21T00:56:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 msgr2=0x7fbbb419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 0x7fbbb419a500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbba4006010 tx=0x7fbba4004060 comp rx=0 tx=0).stop 2024-09-21T00:56:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 shutdown_connections 2024-09-21T00:56:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb9c0b6510 0x7fbb9c0b8a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb410de30 0x7fbbb419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb4105320 0x7fbbb419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 --2- 172.21.15.47:0/1046999710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbb41049d0 0x7fbbb419a500 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 >> 172.21.15.47:0/1046999710 conn(0x7fbbb4079740 msgr2=0x7fbbb41007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 shutdown_connections 2024-09-21T00:56:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:49.648+0000 7fbbb9331640 1 -- 172.21.15.47:0/1046999710 wait complete. 2024-09-21T00:56:49.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:49 smithi114 ceph-mon[34309]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:56:49.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:49 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1046999710' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:56:49.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:49 smithi114 ceph-mon[34309]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:56:49.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:49 smithi047 ceph-mon[30960]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:56:49.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:49 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1046999710' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:56:49.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:49 smithi047 ceph-mon[30960]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:56:50.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:49 smithi134 ceph-mon[34785]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T00:56:50.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:49 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1046999710' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T00:56:50.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:49 smithi134 ceph-mon[34785]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T00:56:50.313 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:56:50.574 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:50 smithi134 ceph-mon[34785]: pgmap v286: 97 pgs: 31 active+clean, 2 creating+activating, 13 creating+peering, 51 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:50 smithi134 ceph-mon[34785]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:56:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:50 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1046999710' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:56:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:50 smithi134 ceph-mon[34785]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:56:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:50 smithi134 ceph-mon[34785]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:56:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:50 smithi114 ceph-mon[34309]: pgmap v286: 97 pgs: 31 active+clean, 2 creating+activating, 13 creating+peering, 51 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:50 smithi114 ceph-mon[34309]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:56:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:50 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1046999710' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:56:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:50 smithi114 ceph-mon[34309]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:56:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:50 smithi114 ceph-mon[34309]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:56:50.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:50 smithi047 ceph-mon[30960]: pgmap v286: 97 pgs: 31 active+clean, 2 creating+activating, 13 creating+peering, 51 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T00:56:50.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:50 smithi047 ceph-mon[30960]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T00:56:50.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:50 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1046999710' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T00:56:50.932 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:50 smithi047 ceph-mon[30960]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T00:56:50.933 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:50 smithi047 ceph-mon[30960]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T00:56:51.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 -- 172.21.15.47:0/727224144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 msgr2=0x7f183c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:51.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 --2- 172.21.15.47:0/727224144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 0x7f183c103f70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f182c009900 tx=0x7f182c02a410 comp rx=0 tx=0).stop 2024-09-21T00:56:51.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 -- 172.21.15.47:0/727224144 shutdown_connections 2024-09-21T00:56:51.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 --2- 172.21.15.47:0/727224144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c109df0 0x7f183c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 --2- 172.21.15.47:0/727224144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183c1094a0 0x7f183c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 --2- 172.21.15.47:0/727224144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 0x7f183c103f70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 -- 172.21.15.47:0/727224144 >> 172.21.15.47:0/727224144 conn(0x7f183c07b850 msgr2=0x7f183c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 -- 172.21.15.47:0/727224144 shutdown_connections 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.023+0000 7f1841e39640 1 -- 172.21.15.47:0/727224144 wait complete. 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.024+0000 7f1841e39640 1 Processor -- start 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f1841e39640 1 -- start start 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f1841e39640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 0x7f183c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f1841e39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c1094a0 0x7f183c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f1841e39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183c109df0 0x7f183c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f1841e39640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f183c113ab0 con 0x7f183c103b60 2024-09-21T00:56:51.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f1841e39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f183c113930 con 0x7f183c109df0 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f1841e39640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f183c113c30 con 0x7f183c1094a0 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 0x7f183c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 0x7f183c19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47228/0 (socket says 172.21.15.47:47228) 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183b7fe640 1 -- 172.21.15.47:0/917138478 learned_addr learned my addr 172.21.15.47:0/917138478 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183affd640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c1094a0 0x7f183c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183bfff640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183c109df0 0x7f183c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183b7fe640 1 -- 172.21.15.47:0/917138478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c1094a0 msgr2=0x7f183c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183b7fe640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c1094a0 0x7f183c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183b7fe640 1 -- 172.21.15.47:0/917138478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183c109df0 msgr2=0x7f183c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183b7fe640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183c109df0 0x7f183c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183b7fe640 1 -- 172.21.15.47:0/917138478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c1a0470 con 0x7f183c103b60 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.025+0000 7f183affd640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c1094a0 0x7f183c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.026+0000 7f183b7fe640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 0x7f183c19a500 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f182c005940 tx=0x7f182c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.026+0000 7f1838ff9640 1 -- 172.21.15.47:0/917138478 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c03f030 con 0x7f183c103b60 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.026+0000 7f1838ff9640 1 -- 172.21.15.47:0/917138478 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f182c003cb0 con 0x7f183c103b60 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.026+0000 7f1838ff9640 1 -- 172.21.15.47:0/917138478 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c035070 con 0x7f183c103b60 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.026+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c1a0700 con 0x7f183c103b60 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.026+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c1a6ec0 con 0x7f183c103b60 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.027+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c104de0 con 0x7f183c103b60 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.028+0000 7f1838ff9640 1 -- 172.21.15.47:0/917138478 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f182c042030 con 0x7f183c103b60 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.029+0000 7f1838ff9640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f18240b6510 0x7f18240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.029+0000 7f183affd640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f18240b6510 0x7f18240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:51.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.029+0000 7f1838ff9640 1 -- 172.21.15.47:0/917138478 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f182c107df0 con 0x7f183c103b60 2024-09-21T00:56:51.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.030+0000 7f183affd640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f18240b6510 0x7f18240b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18300058c0 tx=0x7f1830005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:51.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.032+0000 7f1838ff9640 1 -- 172.21.15.47:0/917138478 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f182c0ce730 con 0x7f183c103b60 2024-09-21T00:56:51.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.222+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f183c10bbc0 con 0x7f183c103b60 2024-09-21T00:56:51.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.224+0000 7f1838ff9640 1 -- 172.21.15.47:0/917138478 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22293 (secure 0 0 0) 0x7f182c0d2b10 con 0x7f183c103b60 2024-09-21T00:56:51.225 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:51.225 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:56:49.242027+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f18240b6510 msgr2=0x7f18240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f18240b6510 0x7f18240b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18300058c0 tx=0x7f1830005850 comp rx=0 tx=0).stop 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 msgr2=0x7f183c19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 0x7f183c19a500 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f182c005940 tx=0x7f182c0042f0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 shutdown_connections 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f18240b6510 0x7f18240b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183c109df0 0x7f183c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c1094a0 0x7f183c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 --2- 172.21.15.47:0/917138478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f183c103b60 0x7f183c19a500 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 >> 172.21.15.47:0/917138478 conn(0x7f183c07b850 msgr2=0x7f183c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:51.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 shutdown_connections 2024-09-21T00:56:51.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:51.226+0000 7f1841e39640 1 -- 172.21.15.47:0/917138478 wait complete. 2024-09-21T00:56:51.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:51 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] up:active 2024-09-21T00:56:51.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:51 smithi047 ceph-mon[30960]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:51.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:51 smithi047 ceph-mon[30960]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:51.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:51 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/917138478' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:51.824 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:56:51.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:51 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] up:active 2024-09-21T00:56:51.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:51 smithi114 ceph-mon[34309]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:51.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:51 smithi114 ceph-mon[34309]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:51.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:51 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/917138478' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:52.081 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:52.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:51 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] up:active 2024-09-21T00:56:52.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:51 smithi134 ceph-mon[34785]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:52.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:51 smithi134 ceph-mon[34785]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:52.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:51 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/917138478' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:52.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2898155827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa4103b60 msgr2=0x7f4fa4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2898155827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa4103b60 0x7f4fa4103f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009ca0 tx=0x7f4f9402a8e0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2898155827 shutdown_connections 2024-09-21T00:56:52.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2898155827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fa4109df0 0x7f4fa4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2898155827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fa41094a0 0x7f4fa41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2898155827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa4103b60 0x7f4fa4103f70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2898155827 >> 172.21.15.47:0/2898155827 conn(0x7f4fa407b850 msgr2=0x7f4fa407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:52.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2898155827 shutdown_connections 2024-09-21T00:56:52.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.548+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2898155827 wait complete. 2024-09-21T00:56:52.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.549+0000 7f4fa98bc640 1 Processor -- start 2024-09-21T00:56:52.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa98bc640 1 -- start start 2024-09-21T00:56:52.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa98bc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fa4103b60 0x7f4fa4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa98bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa41094a0 0x7f4fa4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa98bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fa4109df0 0x7f4fa4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa98bc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa4113bc0 con 0x7f4fa41094a0 2024-09-21T00:56:52.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa98bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa4113a40 con 0x7f4fa4109df0 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa98bc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa4113d40 con 0x7f4fa4103b60 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa41094a0 0x7f4fa4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa41094a0 0x7f4fa4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35268/0 (socket says 172.21.15.47:35268) 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa27fc640 1 -- 172.21.15.47:0/2323640237 learned_addr learned my addr 172.21.15.47:0/2323640237 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa2ffd640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fa4103b60 0x7f4fa4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.550+0000 7f4fa37fe640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fa4109df0 0x7f4fa4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa27fc640 1 -- 172.21.15.47:0/2323640237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fa4103b60 msgr2=0x7f4fa4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa27fc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fa4103b60 0x7f4fa4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa27fc640 1 -- 172.21.15.47:0/2323640237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fa4109df0 msgr2=0x7f4fa4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa27fc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fa4109df0 0x7f4fa4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa27fc640 1 -- 172.21.15.47:0/2323640237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa41a88d0 con 0x7f4fa41094a0 2024-09-21T00:56:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa27fc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa41094a0 0x7f4fa4075c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c006fd0 tx=0x7f4f8c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa88ba640 1 -- 172.21.15.47:0/2323640237 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c011830 con 0x7f4fa41094a0 2024-09-21T00:56:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa41a8bc0 con 0x7f4fa41094a0 2024-09-21T00:56:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa88ba640 1 -- 172.21.15.47:0/2323640237 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f8c016070 con 0x7f4fa41094a0 2024-09-21T00:56:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa88ba640 1 -- 172.21.15.47:0/2323640237 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c010e00 con 0x7f4fa41094a0 2024-09-21T00:56:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.551+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa41a9150 con 0x7f4fa41094a0 2024-09-21T00:56:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.552+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa4103ff0 con 0x7f4fa41094a0 2024-09-21T00:56:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.554+0000 7f4fa88ba640 1 -- 172.21.15.47:0/2323640237 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f4f8c01a3c0 con 0x7f4fa41094a0 2024-09-21T00:56:52.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.555+0000 7f4fa88ba640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f900b6510 0x7f4f900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:52.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.555+0000 7f4fa2ffd640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f900b6510 0x7f4f900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:52.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.555+0000 7f4fa88ba640 1 -- 172.21.15.47:0/2323640237 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f4f8c0e6d90 con 0x7f4fa41094a0 2024-09-21T00:56:52.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.555+0000 7f4fa2ffd640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f900b6510 0x7f4f900b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4077160 tx=0x7f4f94005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:52.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.558+0000 7f4fa88ba640 1 -- 172.21.15.47:0/2323640237 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f8c0ad770 con 0x7f4fa41094a0 2024-09-21T00:56:52.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.748+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fa4076a10 con 0x7f4fa41094a0 2024-09-21T00:56:52.749 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:52 smithi047 ceph-mon[30960]: pgmap v288: 97 pgs: 55 active+clean, 2 creating+activating, 8 creating+peering, 32 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 442 B/s wr, 1 op/s 2024-09-21T00:56:52.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.749+0000 7f4fa88ba640 1 -- 172.21.15.47:0/2323640237 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22293 (secure 0 0 0) 0x7f4fa4076a10 con 0x7f4fa41094a0 2024-09-21T00:56:52.750 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:56:52.750 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:56:49.242027+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:56:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f900b6510 msgr2=0x7f4f900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f900b6510 0x7f4f900b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4077160 tx=0x7f4f94005fd0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa41094a0 msgr2=0x7f4fa4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa41094a0 0x7f4fa4075c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c006fd0 tx=0x7f4f8c00b8e0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 shutdown_connections 2024-09-21T00:56:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f900b6510 0x7f4f900b8a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fa4109df0 0x7f4fa4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fa41094a0 0x7f4fa4075c50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 --2- 172.21.15.47:0/2323640237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fa4103b60 0x7f4fa4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:52.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 >> 172.21.15.47:0/2323640237 conn(0x7f4fa407b850 msgr2=0x7f4fa41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:52.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 shutdown_connections 2024-09-21T00:56:52.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:52.752+0000 7f4fa98bc640 1 -- 172.21.15.47:0/2323640237 wait complete. 2024-09-21T00:56:53.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:52 smithi134 ceph-mon[34785]: pgmap v288: 97 pgs: 55 active+clean, 2 creating+activating, 8 creating+peering, 32 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 442 B/s wr, 1 op/s 2024-09-21T00:56:53.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:52 smithi114 ceph-mon[34309]: pgmap v288: 97 pgs: 55 active+clean, 2 creating+activating, 8 creating+peering, 32 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 442 B/s wr, 1 op/s 2024-09-21T00:56:53.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T00:56:53.692 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:53.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:53 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2323640237' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:54.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:53 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2323640237' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:54.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:53 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2323640237' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:56:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 -- 172.21.15.47:0/4293205629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754102ae0 msgr2=0x7f1754102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 --2- 172.21.15.47:0/4293205629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754102ae0 0x7f1754102ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1744009900 tx=0x7f174402a410 comp rx=0 tx=0).stop 2024-09-21T00:56:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 -- 172.21.15.47:0/4293205629 shutdown_connections 2024-09-21T00:56:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 --2- 172.21.15.47:0/4293205629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1754108d20 0x7f175410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 --2- 172.21.15.47:0/4293205629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17541083d0 0x7f17541087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 --2- 172.21.15.47:0/4293205629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754102ae0 0x7f1754102ef0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 -- 172.21.15.47:0/4293205629 >> 172.21.15.47:0/4293205629 conn(0x7f1754079760 msgr2=0x7f1754079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 -- 172.21.15.47:0/4293205629 shutdown_connections 2024-09-21T00:56:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.173+0000 7f175af48640 1 -- 172.21.15.47:0/4293205629 wait complete. 2024-09-21T00:56:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f175af48640 1 Processor -- start 2024-09-21T00:56:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f175af48640 1 -- start start 2024-09-21T00:56:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f175af48640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1754102ae0 0x7f175419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f175af48640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17541083d0 0x7f175419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f175af48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754108d20 0x7f175419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f175af48640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1754112990 con 0x7f1754108d20 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f175af48640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1754112810 con 0x7f1754102ae0 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f175af48640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1754112b10 con 0x7f17541083d0 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f17594e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754108d20 0x7f175419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f17594e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754108d20 0x7f175419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35300/0 (socket says 172.21.15.47:35300) 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f17594e5640 1 -- 172.21.15.47:0/1084978996 learned_addr learned my addr 172.21.15.47:0/1084978996 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f1758ce4640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1754102ae0 0x7f175419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.174+0000 7f1753fff640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17541083d0 0x7f175419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f17594e5640 1 -- 172.21.15.47:0/1084978996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17541083d0 msgr2=0x7f175419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f17594e5640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17541083d0 0x7f175419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f17594e5640 1 -- 172.21.15.47:0/1084978996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1754102ae0 msgr2=0x7f175419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f17594e5640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1754102ae0 0x7f175419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f17594e5640 1 -- 172.21.15.47:0/1084978996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17541a04c0 con 0x7f1754108d20 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f17594e5640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754108d20 0x7f175419fd90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f174c00eaa0 tx=0x7f174c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f1751ffb640 1 -- 172.21.15.47:0/1084978996 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c00cdb0 con 0x7f1754108d20 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17541a07b0 con 0x7f1754108d20 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f1751ffb640 1 -- 172.21.15.47:0/1084978996 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f174c005020 con 0x7f1754108d20 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f1751ffb640 1 -- 172.21.15.47:0/1084978996 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c0116d0 con 0x7f1754108d20 2024-09-21T00:56:54.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.175+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17541a6f10 con 0x7f1754108d20 2024-09-21T00:56:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.176+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1754103d10 con 0x7f1754108d20 2024-09-21T00:56:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.178+0000 7f1751ffb640 1 -- 172.21.15.47:0/1084978996 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f174c0051d0 con 0x7f1754108d20 2024-09-21T00:56:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.179+0000 7f1751ffb640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f173c0b6510 0x7f173c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.179+0000 7f1758ce4640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f173c0b6510 0x7f173c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.179+0000 7f1751ffb640 1 -- 172.21.15.47:0/1084978996 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f174c0e72e0 con 0x7f1754108d20 2024-09-21T00:56:54.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.179+0000 7f1758ce4640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f173c0b6510 0x7f173c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1744031440 tx=0x7f1744009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:54.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.183+0000 7f1751ffb640 1 -- 172.21.15.47:0/1084978996 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f174c016030 con 0x7f1754108d20 2024-09-21T00:56:54.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.413+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f17541a70e0 con 0x7f1754108d20 2024-09-21T00:56:54.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.670+0000 7f1751ffb640 1 -- 172.21.15.47:0/1084978996 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f174c0b2000 con 0x7f1754108d20 2024-09-21T00:56:54.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f173c0b6510 msgr2=0x7f173c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f173c0b6510 0x7f173c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1744031440 tx=0x7f1744009560 comp rx=0 tx=0).stop 2024-09-21T00:56:54.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754108d20 msgr2=0x7f175419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754108d20 0x7f175419fd90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f174c00eaa0 tx=0x7f174c00ef60 comp rx=0 tx=0).stop 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 shutdown_connections 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f173c0b6510 0x7f173c0b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1754108d20 0x7f175419fd90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17541083d0 0x7f175419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.672+0000 7f175af48640 1 --2- 172.21.15.47:0/1084978996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1754102ae0 0x7f175419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.673+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 >> 172.21.15.47:0/1084978996 conn(0x7f1754079760 msgr2=0x7f1754106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.673+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 shutdown_connections 2024-09-21T00:56:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:54.673+0000 7f175af48640 1 -- 172.21.15.47:0/1084978996 wait complete. 2024-09-21T00:56:54.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:54 smithi047 ceph-mon[30960]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T00:56:54.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:54 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1084978996' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:56:55.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:54 smithi134 ceph-mon[34785]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T00:56:55.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:54 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1084978996' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:56:55.159 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 00:56:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b[62424]: 2024-09-21T00:56:54.911+0000 7f19e3186640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T00:56:55.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:54 smithi114 ceph-mon[34309]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T00:56:55.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:54 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1084978996' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T00:56:55.262 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T00:56:55.262 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T00:56:55.519 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:55.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:55 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1084978996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:56:55.929 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:55 smithi047 ceph-mon[30960]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:56.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 -- 172.21.15.47:0/2191522908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d741094d0 msgr2=0x7f2d741098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 --2- 172.21.15.47:0/2191522908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d741094d0 0x7f2d741098e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009900 tx=0x7f2d6802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:56.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 -- 172.21.15.47:0/2191522908 shutdown_connections 2024-09-21T00:56:56.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 --2- 172.21.15.47:0/2191522908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d74109e20 0x7f2d74110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 --2- 172.21.15.47:0/2191522908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d741094d0 0x7f2d741098e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 --2- 172.21.15.47:0/2191522908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d74103b90 0x7f2d74103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 -- 172.21.15.47:0/2191522908 >> 172.21.15.47:0/2191522908 conn(0x7f2d740ff5e0 msgr2=0x7f2d74101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 -- 172.21.15.47:0/2191522908 shutdown_connections 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 -- 172.21.15.47:0/2191522908 wait complete. 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.022+0000 7f2d794bb640 1 Processor -- start 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d794bb640 1 -- start start 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d794bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d74103b90 0x7f2d7419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d794bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d741094d0 0x7f2d7419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d794bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d74109e20 0x7f2d7419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d794bb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74113ae0 con 0x7f2d74109e20 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d794bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74113960 con 0x7f2d741094d0 2024-09-21T00:56:56.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d794bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74113c60 con 0x7f2d74103b90 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d74109e20 0x7f2d7419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d74109e20 0x7f2d7419fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35314/0 (socket says 172.21.15.47:35314) 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d737fe640 1 -- 172.21.15.47:0/899069050 learned_addr learned my addr 172.21.15.47:0/899069050 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d727fc640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d741094d0 0x7f2d7419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d72ffd640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d74103b90 0x7f2d7419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d737fe640 1 -- 172.21.15.47:0/899069050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d74103b90 msgr2=0x7f2d7419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d737fe640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d74103b90 0x7f2d7419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d737fe640 1 -- 172.21.15.47:0/899069050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d741094d0 msgr2=0x7f2d7419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.023+0000 7f2d737fe640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d741094d0 0x7f2d7419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.024+0000 7f2d737fe640 1 -- 172.21.15.47:0/899069050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d741a03e0 con 0x7f2d74109e20 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.024+0000 7f2d737fe640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d74109e20 0x7f2d7419fcb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00d750 tx=0x7f2d6c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:56.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.024+0000 7f2d5bfff640 1 -- 172.21.15.47:0/899069050 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c017070 con 0x7f2d74109e20 2024-09-21T00:56:56.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.024+0000 7f2d5bfff640 1 -- 172.21.15.47:0/899069050 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c0054d0 con 0x7f2d74109e20 2024-09-21T00:56:56.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.024+0000 7f2d5bfff640 1 -- 172.21.15.47:0/899069050 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c004c60 con 0x7f2d74109e20 2024-09-21T00:56:56.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.024+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d741a06d0 con 0x7f2d74109e20 2024-09-21T00:56:56.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.024+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d741a6e30 con 0x7f2d74109e20 2024-09-21T00:56:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.025+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d74103fa0 con 0x7f2d74109e20 2024-09-21T00:56:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.027+0000 7f2d5bfff640 1 -- 172.21.15.47:0/899069050 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f2d6c009bd0 con 0x7f2d74109e20 2024-09-21T00:56:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.028+0000 7f2d5bfff640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2d5c0b6510 0x7f2d5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.028+0000 7f2d72ffd640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2d5c0b6510 0x7f2d5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.028+0000 7f2d5bfff640 1 -- 172.21.15.47:0/899069050 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f2d6c0e6ec0 con 0x7f2d74109e20 2024-09-21T00:56:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.028+0000 7f2d72ffd640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2d5c0b6510 0x7f2d5c0b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d64005fd0 tx=0x7f2d64009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:56.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.031+0000 7f2d5bfff640 1 -- 172.21.15.47:0/899069050 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d6c0b1c80 con 0x7f2d74109e20 2024-09-21T00:56:56.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:55 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1084978996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:56:56.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:55 smithi134 ceph-mon[34785]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:56.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:55 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1084978996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T00:56:56.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:55 smithi114 ceph-mon[34309]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T00:56:56.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.260+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f2d7410bbf0 con 0x7f2d74109e20 2024-09-21T00:56:56.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.495+0000 7f2d5bfff640 1 -- 172.21.15.47:0/899069050 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f2d6c0d0020 con 0x7f2d74109e20 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2d5c0b6510 msgr2=0x7f2d5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2d5c0b6510 0x7f2d5c0b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d64005fd0 tx=0x7f2d64009680 comp rx=0 tx=0).stop 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d74109e20 msgr2=0x7f2d7419fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d74109e20 0x7f2d7419fcb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00d750 tx=0x7f2d6c00dc10 comp rx=0 tx=0).stop 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 shutdown_connections 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2d5c0b6510 0x7f2d5c0b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d74109e20 0x7f2d7419fcb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d741094d0 0x7f2d7419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 --2- 172.21.15.47:0/899069050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d74103b90 0x7f2d7419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:56.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 >> 172.21.15.47:0/899069050 conn(0x7f2d740ff5e0 msgr2=0x7f2d74101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:56.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 shutdown_connections 2024-09-21T00:56:56.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:56.499+0000 7f2d794bb640 1 -- 172.21.15.47:0/899069050 wait complete. 2024-09-21T00:56:56.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:56 smithi047 ceph-mon[30960]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T00:56:56.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:56 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/899069050' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:56:56.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:56 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/899069050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:56:56.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:56 smithi047 ceph-mon[30960]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T00:56:57.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:56 smithi134 ceph-mon[34785]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T00:56:57.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:56 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/899069050' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:56:57.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:56 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/899069050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:56:57.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:56 smithi134 ceph-mon[34785]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T00:56:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:56 smithi114 ceph-mon[34309]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T00:56:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:56 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/899069050' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T00:56:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:56 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/899069050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T00:56:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:56 smithi114 ceph-mon[34309]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T00:56:57.214 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T00:56:57.481 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:58.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 -- 172.21.15.47:0/2796177493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 msgr2=0x7fe158104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 --2- 172.21.15.47:0/2796177493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 0x7fe158104e40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe148009900 tx=0x7fe14802a410 comp rx=0 tx=0).stop 2024-09-21T00:56:58.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 -- 172.21.15.47:0/2796177493 shutdown_connections 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 --2- 172.21.15.47:0/2796177493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15810de60 0x7fe158110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 --2- 172.21.15.47:0/2796177493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158105380 0x7fe15810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 --2- 172.21.15.47:0/2796177493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 0x7fe158104e40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 -- 172.21.15.47:0/2796177493 >> 172.21.15.47:0/2796177493 conn(0x7fe158079760 msgr2=0x7fe158079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 -- 172.21.15.47:0/2796177493 shutdown_connections 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.044+0000 7fe15dd80640 1 -- 172.21.15.47:0/2796177493 wait complete. 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe15dd80640 1 Processor -- start 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe15dd80640 1 -- start start 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe15dd80640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 0x7fe15819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe15dd80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158105380 0x7fe15819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe15dd80640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15810de60 0x7fe15819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe15dd80640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe158113ac0 con 0x7fe158104a30 2024-09-21T00:56:58.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe15dd80640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe158113940 con 0x7fe15810de60 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe15dd80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe158113c40 con 0x7fe158105380 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 0x7fe15819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 0x7fe15819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35340/0 (socket says 172.21.15.47:35340) 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.045+0000 7fe1577fe640 1 -- 172.21.15.47:0/4153857778 learned_addr learned my addr 172.21.15.47:0/4153857778 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe156ffd640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158105380 0x7fe15819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe157fff640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15810de60 0x7fe15819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe1577fe640 1 -- 172.21.15.47:0/4153857778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158105380 msgr2=0x7fe15819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe1577fe640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158105380 0x7fe15819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe1577fe640 1 -- 172.21.15.47:0/4153857778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15810de60 msgr2=0x7fe15819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe1577fe640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15810de60 0x7fe15819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe1577fe640 1 -- 172.21.15.47:0/4153857778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1581a0480 con 0x7fe158104a30 2024-09-21T00:56:58.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe156ffd640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158105380 0x7fe15819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:56:58.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe1577fe640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 0x7fe15819a510 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe148032fd0 tx=0x7fe148004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:58.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe154ff9640 1 -- 172.21.15.47:0/4153857778 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14803f030 con 0x7fe158104a30 2024-09-21T00:56:58.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1581a0710 con 0x7fe158104a30 2024-09-21T00:56:58.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe154ff9640 1 -- 172.21.15.47:0/4153857778 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe148004490 con 0x7fe158104a30 2024-09-21T00:56:58.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe154ff9640 1 -- 172.21.15.47:0/4153857778 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148035070 con 0x7fe158104a30 2024-09-21T00:56:58.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.046+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1581a6ed0 con 0x7fe158104a30 2024-09-21T00:56:58.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.047+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe15806c1f0 con 0x7fe158104a30 2024-09-21T00:56:58.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.050+0000 7fe154ff9640 1 -- 172.21.15.47:0/4153857778 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fe148042030 con 0x7fe158104a30 2024-09-21T00:56:58.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.051+0000 7fe154ff9640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1440b6510 0x7fe1440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:56:58.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.051+0000 7fe156ffd640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1440b6510 0x7fe1440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:56:58.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.051+0000 7fe154ff9640 1 -- 172.21.15.47:0/4153857778 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fe148107bf0 con 0x7fe158104a30 2024-09-21T00:56:58.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.051+0000 7fe156ffd640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1440b6510 0x7fe1440b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1400058c0 tx=0x7fe140005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:56:58.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.054+0000 7fe154ff9640 1 -- 172.21.15.47:0/4153857778 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1480ce530 con 0x7fe158104a30 2024-09-21T00:56:58.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.282+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe158104e40 con 0x7fe158104a30 2024-09-21T00:56:58.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.679+0000 7fe154ff9640 1 -- 172.21.15.47:0/4153857778 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7fe158104e40 con 0x7fe158104a30 2024-09-21T00:56:58.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.681+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1440b6510 msgr2=0x7fe1440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.681+0000 7fe15dd80640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1440b6510 0x7fe1440b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1400058c0 tx=0x7fe140005850 comp rx=0 tx=0).stop 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.681+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 msgr2=0x7fe15819a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.681+0000 7fe15dd80640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 0x7fe15819a510 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe148032fd0 tx=0x7fe148004270 comp rx=0 tx=0).stop 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.682+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 shutdown_connections 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.682+0000 7fe15dd80640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1440b6510 0x7fe1440b8a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.682+0000 7fe15dd80640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe15810de60 0x7fe15819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.682+0000 7fe15dd80640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158105380 0x7fe15819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.682+0000 7fe15dd80640 1 --2- 172.21.15.47:0/4153857778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe158104a30 0x7fe15819a510 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.682+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 >> 172.21.15.47:0/4153857778 conn(0x7fe158079760 msgr2=0x7fe1581008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.682+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 shutdown_connections 2024-09-21T00:56:58.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:56:58.682+0000 7fe15dd80640 1 -- 172.21.15.47:0/4153857778 wait complete. 2024-09-21T00:56:58.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:58 smithi047 ceph-mon[30960]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 593 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T00:56:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:58 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4153857778' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:56:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:58 smithi134 ceph-mon[34785]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 593 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T00:56:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:58 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4153857778' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:56:59.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:58 smithi114 ceph-mon[34309]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 593 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T00:56:59.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:58 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4153857778' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T00:56:59.379 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T00:56:59.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T00:56:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:56:59.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:59 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4153857778' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:56:59.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:56:59 smithi047 ceph-mon[30960]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T00:57:00.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:59 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4153857778' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:57:00.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:56:59 smithi134 ceph-mon[34785]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T00:57:00.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:59 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4153857778' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T00:57:00.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:56:59 smithi114 ceph-mon[34309]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 -- 172.21.15.47:0/3890479050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 msgr2=0x7f52001098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 --2- 172.21.15.47:0/3890479050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 0x7f52001098b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009900 tx=0x7f51f402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 -- 172.21.15.47:0/3890479050 shutdown_connections 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 --2- 172.21.15.47:0/3890479050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5200109df0 0x7f5200110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 --2- 172.21.15.47:0/3890479050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 0x7f52001098b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 --2- 172.21.15.47:0/3890479050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5200103b60 0x7f5200103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 -- 172.21.15.47:0/3890479050 >> 172.21.15.47:0/3890479050 conn(0x7f520007b850 msgr2=0x7f520007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 -- 172.21.15.47:0/3890479050 shutdown_connections 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.142+0000 7f5205a84640 1 -- 172.21.15.47:0/3890479050 wait complete. 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f5205a84640 1 Processor -- start 2024-09-21T00:57:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f5205a84640 1 -- start start 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f5205a84640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5200103b60 0x7f520019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f5205a84640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 0x7f520019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f5205a84640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5200109df0 0x7f520019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f5205a84640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5200113ab0 con 0x7f52001094a0 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f5205a84640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5200113930 con 0x7f5200103b60 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f5205a84640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5200113c30 con 0x7f5200109df0 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f51feffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 0x7f520019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f51feffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 0x7f520019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35364/0 (socket says 172.21.15.47:35364) 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.143+0000 7f51feffd640 1 -- 172.21.15.47:0/50324589 learned_addr learned my addr 172.21.15.47:0/50324589 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51fffff640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5200109df0 0x7f520019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:00.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51ff7fe640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5200103b60 0x7f520019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51feffd640 1 -- 172.21.15.47:0/50324589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5200109df0 msgr2=0x7f520019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51feffd640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5200109df0 0x7f520019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51feffd640 1 -- 172.21.15.47:0/50324589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5200103b60 msgr2=0x7f520019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51feffd640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5200103b60 0x7f520019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51feffd640 1 -- 172.21.15.47:0/50324589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52001a0430 con 0x7f52001094a0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51ff7fe640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5200103b60 0x7f520019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51feffd640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 0x7f520019aa60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51f402a930 tx=0x7f51f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51fcff9640 1 -- 172.21.15.47:0/50324589 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f403f030 con 0x7f52001094a0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52001a06c0 con 0x7f52001094a0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51fcff9640 1 -- 172.21.15.47:0/50324589 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51f4003aa0 con 0x7f52001094a0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f51fcff9640 1 -- 172.21.15.47:0/50324589 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4035070 con 0x7f52001094a0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.144+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52001a6e80 con 0x7f52001094a0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.145+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5200104de0 con 0x7f52001094a0 2024-09-21T00:57:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.147+0000 7f51fcff9640 1 -- 172.21.15.47:0/50324589 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f51f4042030 con 0x7f52001094a0 2024-09-21T00:57:00.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.148+0000 7f51fcff9640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f51e80b6510 0x7f51e80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:00.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.148+0000 7f51ff7fe640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f51e80b6510 0x7f51e80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:00.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.148+0000 7f51fcff9640 1 -- 172.21.15.47:0/50324589 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f51f4107c40 con 0x7f52001094a0 2024-09-21T00:57:00.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.149+0000 7f51ff7fe640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f51e80b6510 0x7f51e80b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009b40 tx=0x7f51f0005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:00.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.151+0000 7f51fcff9640 1 -- 172.21.15.47:0/50324589 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51f40ce620 con 0x7f52001094a0 2024-09-21T00:57:00.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.364+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5200063800 con 0x7f51e80b6510 2024-09-21T00:57:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.387+0000 7f51fcff9640 1 -- 172.21.15.47:0/50324589 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5200063800 con 0x7f51e80b6510 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f51e80b6510 msgr2=0x7f51e80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f51e80b6510 0x7f51e80b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009b40 tx=0x7f51f0005e50 comp rx=0 tx=0).stop 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 msgr2=0x7f520019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 0x7f520019aa60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51f402a930 tx=0x7f51f4004270 comp rx=0 tx=0).stop 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 shutdown_connections 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f51e80b6510 0x7f51e80b8a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5200109df0 0x7f520019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52001094a0 0x7f520019aa60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 --2- 172.21.15.47:0/50324589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5200103b60 0x7f520019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 >> 172.21.15.47:0/50324589 conn(0x7f520007b850 msgr2=0x7f5200105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 shutdown_connections 2024-09-21T00:57:00.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:00.389+0000 7f5205a84640 1 -- 172.21.15.47:0/50324589 wait complete. 2024-09-21T00:57:00.693 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:57:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:57:00.371+0000 7f6429d7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:57:00.693 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:57:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:57:00.371+0000 7f6429d7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:57:00.693 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:57:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:57:00.371+0000 7f6429d7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:57:00.693 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:57:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:57:00.371+0000 7f6429d7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:57:00.693 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 00:57:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x[31187]: 2024-09-21T00:57:00.371+0000 7f6429d7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T00:57:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:00 smithi047 ceph-mon[30960]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:57:01.015 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T00:57:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:00 smithi134 ceph-mon[34785]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:57:01.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:00 smithi114 ceph-mon[34309]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:57:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- 172.21.15.47:0/3058101295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 msgr2=0x7fbf6c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 --2- 172.21.15.47:0/3058101295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 0x7fbf6c108830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009900 tx=0x7fbf5c02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- 172.21.15.47:0/3058101295 shutdown_connections 2024-09-21T00:57:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 --2- 172.21.15.47:0/3058101295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6c108d70 0x7fbf6c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 --2- 172.21.15.47:0/3058101295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 0x7fbf6c108830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 --2- 172.21.15.47:0/3058101295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf6c102ae0 0x7fbf6c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- 172.21.15.47:0/3058101295 >> 172.21.15.47:0/3058101295 conn(0x7fbf6c079770 msgr2=0x7fbf6c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- 172.21.15.47:0/3058101295 shutdown_connections 2024-09-21T00:57:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- 172.21.15.47:0/3058101295 wait complete. 2024-09-21T00:57:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 Processor -- start 2024-09-21T00:57:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- start start 2024-09-21T00:57:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6c102ae0 0x7fbf6c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 0x7fbf6c199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf6c108d70 0x7fbf6c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c112a30 con 0x7fbf6c108420 2024-09-21T00:57:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c1128b0 con 0x7fbf6c102ae0 2024-09-21T00:57:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf741dc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c112bb0 con 0x7fbf6c108d70 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf71777640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 0x7fbf6c199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf71777640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 0x7fbf6c199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49784/0 (socket says 172.21.15.47:49784) 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf71777640 1 -- 172.21.15.47:0/2772620584 learned_addr learned my addr 172.21.15.47:0/2772620584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf72779640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf6c108d70 0x7fbf6c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.760+0000 7fbf71f78640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6c102ae0 0x7fbf6c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf71777640 1 -- 172.21.15.47:0/2772620584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf6c108d70 msgr2=0x7fbf6c19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf71777640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf6c108d70 0x7fbf6c19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf71777640 1 -- 172.21.15.47:0/2772620584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6c102ae0 msgr2=0x7fbf6c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf71777640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6c102ae0 0x7fbf6c1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf71777640 1 -- 172.21.15.47:0/2772620584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c19f350 con 0x7fbf6c108420 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf72779640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf6c108d70 0x7fbf6c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf71777640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 0x7fbf6c199980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c02a930 tx=0x7fbf5c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf62ffd640 1 -- 172.21.15.47:0/2772620584 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c03f030 con 0x7fbf6c108420 2024-09-21T00:57:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf62ffd640 1 -- 172.21.15.47:0/2772620584 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf5c003aa0 con 0x7fbf6c108420 2024-09-21T00:57:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6c19f5e0 con 0x7fbf6c108420 2024-09-21T00:57:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf62ffd640 1 -- 172.21.15.47:0/2772620584 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c035070 con 0x7fbf6c108420 2024-09-21T00:57:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.761+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6c1a5da0 con 0x7fbf6c108420 2024-09-21T00:57:01.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.762+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6c103d60 con 0x7fbf6c108420 2024-09-21T00:57:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.764+0000 7fbf62ffd640 1 -- 172.21.15.47:0/2772620584 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fbf5c042030 con 0x7fbf6c108420 2024-09-21T00:57:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.765+0000 7fbf62ffd640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbf580b65a0 0x7fbf580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.765+0000 7fbf71f78640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbf580b65a0 0x7fbf580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.765+0000 7fbf62ffd640 1 -- 172.21.15.47:0/2772620584 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fbf5c107f30 con 0x7fbf6c108420 2024-09-21T00:57:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.765+0000 7fbf71f78640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbf580b65a0 0x7fbf580b8ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbf68005fd0 tx=0x7fbf68005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:01.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.769+0000 7fbf62ffd640 1 -- 172.21.15.47:0/2772620584 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf5c139710 con 0x7fbf6c108420 2024-09-21T00:57:01.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:01 smithi047 ceph-mon[30960]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:01.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:01.984+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fbf6c063800 con 0x7fbf580b65a0 2024-09-21T00:57:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.018+0000 7fbf62ffd640 1 -- 172.21.15.47:0/2772620584 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbf6c063800 con 0x7fbf580b65a0 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbf580b65a0 msgr2=0x7fbf580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbf580b65a0 0x7fbf580b8ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbf68005fd0 tx=0x7fbf68005850 comp rx=0 tx=0).stop 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 msgr2=0x7fbf6c199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 0x7fbf6c199980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c02a930 tx=0x7fbf5c004270 comp rx=0 tx=0).stop 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 shutdown_connections 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbf580b65a0 0x7fbf580b8ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf6c108d70 0x7fbf6c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf6c108420 0x7fbf6c199980 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 --2- 172.21.15.47:0/2772620584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6c102ae0 0x7fbf6c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 >> 172.21.15.47:0/2772620584 conn(0x7fbf6c079770 msgr2=0x7fbf6c1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 shutdown_connections 2024-09-21T00:57:02.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:02.020+0000 7fbf741dc640 1 -- 172.21.15.47:0/2772620584 wait complete. 2024-09-21T00:57:02.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:01 smithi134 ceph-mon[34785]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:02.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:01 smithi114 ceph-mon[34309]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:02.847 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:02 smithi047 ceph-mon[30960]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 793 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T00:57:02.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:02 smithi047 ceph-mon[30960]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-09-21T00:57:02.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:02 smithi047 ceph-mon[30960]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:02.883 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T00:57:03.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:02 smithi134 ceph-mon[34785]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 793 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T00:57:03.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:02 smithi134 ceph-mon[34785]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-09-21T00:57:03.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:02 smithi134 ceph-mon[34785]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:03.146 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:03.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:02 smithi114 ceph-mon[34309]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 793 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T00:57:03.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:02 smithi114 ceph-mon[34309]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-09-21T00:57:03.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:02 smithi114 ceph-mon[34309]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:03.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 -- 172.21.15.47:0/1620430622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0754102a60 msgr2=0x7f0754102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 --2- 172.21.15.47:0/1620430622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0754102a60 0x7f0754102e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0744009900 tx=0x7f074402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 -- 172.21.15.47:0/1620430622 shutdown_connections 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 --2- 172.21.15.47:0/1620430622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0754108cf0 0x7f075410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 --2- 172.21.15.47:0/1620430622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07541083a0 0x7f07541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 --2- 172.21.15.47:0/1620430622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0754102a60 0x7f0754102e70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 -- 172.21.15.47:0/1620430622 >> 172.21.15.47:0/1620430622 conn(0x7f0754079730 msgr2=0x7f0754079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 -- 172.21.15.47:0/1620430622 shutdown_connections 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.648+0000 7f075a915640 1 -- 172.21.15.47:0/1620430622 wait complete. 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f075a915640 1 Processor -- start 2024-09-21T00:57:03.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f075a915640 1 -- start start 2024-09-21T00:57:03.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f075a915640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0754102a60 0x7f07541994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f075a915640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541083a0 0x7f0754199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f075a915640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754108cf0 0x7f075419ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f075a915640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0754112a40 con 0x7f07541083a0 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f075a915640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f07541128c0 con 0x7f0754102a60 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f075a915640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0754112bc0 con 0x7f0754108cf0 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.649+0000 7f07537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541083a0 0x7f0754199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541083a0 0x7f0754199a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49810/0 (socket says 172.21.15.47:49810) 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07537fe640 1 -- 172.21.15.47:0/3645087559 learned_addr learned my addr 172.21.15.47:0/3645087559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f0753fff640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0754102a60 0x7f07541994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f0758eb2640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754108cf0 0x7f075419ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07537fe640 1 -- 172.21.15.47:0/3645087559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754108cf0 msgr2=0x7f075419ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07537fe640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754108cf0 0x7f075419ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07537fe640 1 -- 172.21.15.47:0/3645087559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0754102a60 msgr2=0x7f07541994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07537fe640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0754102a60 0x7f07541994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07537fe640 1 -- 172.21.15.47:0/3645087559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075419f420 con 0x7f07541083a0 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f0758eb2640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754108cf0 0x7f075419ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07537fe640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541083a0 0x7f0754199a50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f074800b450 tx=0x7f074800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07517fa640 1 -- 172.21.15.47:0/3645087559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748015020 con 0x7f07541083a0 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07517fa640 1 -- 172.21.15.47:0/3645087559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0748011d40 con 0x7f07541083a0 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075419f710 con 0x7f07541083a0 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f07517fa640 1 -- 172.21.15.47:0/3645087559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074800f340 con 0x7f07541083a0 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.650+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07541a5e70 con 0x7f07541083a0 2024-09-21T00:57:03.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.652+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0754103ce0 con 0x7f07541083a0 2024-09-21T00:57:03.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.653+0000 7f07517fa640 1 -- 172.21.15.47:0/3645087559 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f0748018020 con 0x7f07541083a0 2024-09-21T00:57:03.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.654+0000 7f07517fa640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f073c0b6620 0x7f073c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:03.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.654+0000 7f0753fff640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f073c0b6620 0x7f073c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:03.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.654+0000 7f07517fa640 1 -- 172.21.15.47:0/3645087559 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f07480e6c60 con 0x7f07541083a0 2024-09-21T00:57:03.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.654+0000 7f0753fff640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f073c0b6620 0x7f073c0b8b30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0744031440 tx=0x7f0744005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:03.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.658+0000 7f07517fa640 1 -- 172.21.15.47:0/3645087559 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f074801f020 con 0x7f07541083a0 2024-09-21T00:57:03.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.878+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f0754063800 con 0x7f073c0b6620 2024-09-21T00:57:03.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.885+0000 7f07517fa640 1 -- 172.21.15.47:0/3645087559 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0754063800 con 0x7f073c0b6620 2024-09-21T00:57:03.886 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/qa/sv_0/7310c6d0-a5a4-444d-9a5f-2c8a93d26b61 2024-09-21T00:57:03.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f073c0b6620 msgr2=0x7f073c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f073c0b6620 0x7f073c0b8b30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0744031440 tx=0x7f0744005e80 comp rx=0 tx=0).stop 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541083a0 msgr2=0x7f0754199a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541083a0 0x7f0754199a50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f074800b450 tx=0x7f074800b910 comp rx=0 tx=0).stop 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 shutdown_connections 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f073c0b6620 0x7f073c0b8b30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754108cf0 0x7f075419ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07541083a0 0x7f0754199a50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 --2- 172.21.15.47:0/3645087559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0754102a60 0x7f07541994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 >> 172.21.15.47:0/3645087559 conn(0x7f0754079730 msgr2=0x7f0754101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 shutdown_connections 2024-09-21T00:57:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:03.888+0000 7f075a915640 1 -- 172.21.15.47:0/3645087559 wait complete. 2024-09-21T00:57:04.519 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T00:57:04.777 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:04.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:04 smithi047 ceph-mon[30960]: pgmap v294: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-21T00:57:04.898 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:04 smithi047 ceph-mon[30960]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:05.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:04 smithi134 ceph-mon[34785]: pgmap v294: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-21T00:57:05.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:04 smithi134 ceph-mon[34785]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:05.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:04 smithi114 ceph-mon[34309]: pgmap v294: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-21T00:57:05.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:04 smithi114 ceph-mon[34309]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:05.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1033420090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2010de10 msgr2=0x7fdf20110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:05.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1033420090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2010de10 0x7fdf20110300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009ca0 tx=0x7fdf1802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1033420090 shutdown_connections 2024-09-21T00:57:05.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1033420090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2010de10 0x7fdf20110300 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1033420090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf20105300 0x7fdf2010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1033420090 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf201049b0 0x7fdf20104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1033420090 >> 172.21.15.47:0/1033420090 conn(0x7fdf20079720 msgr2=0x7fdf20079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1033420090 shutdown_connections 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1033420090 wait complete. 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.233+0000 7fdf27f0d640 1 Processor -- start 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf27f0d640 1 -- start start 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf27f0d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf201049b0 0x7fdf2019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf27f0d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20105300 0x7fdf2019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf27f0d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf2010de10 0x7fdf2019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf27f0d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20113a70 con 0x7fdf201049b0 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf27f0d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201138f0 con 0x7fdf2010de10 2024-09-21T00:57:05.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf27f0d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20113bf0 con 0x7fdf20105300 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf25ca9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf201049b0 0x7fdf2019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf25ca9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf201049b0 0x7fdf2019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49842/0 (socket says 172.21.15.47:49842) 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf25ca9640 1 -- 172.21.15.47:0/1049680826 learned_addr learned my addr 172.21.15.47:0/1049680826 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf254a8640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20105300 0x7fdf2019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf264aa640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf2010de10 0x7fdf2019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf25ca9640 1 -- 172.21.15.47:0/1049680826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20105300 msgr2=0x7fdf2019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf25ca9640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20105300 0x7fdf2019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf25ca9640 1 -- 172.21.15.47:0/1049680826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf2010de10 msgr2=0x7fdf2019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf25ca9640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf2010de10 0x7fdf2019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.234+0000 7fdf25ca9640 1 -- 172.21.15.47:0/1049680826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf201a02f0 con 0x7fdf201049b0 2024-09-21T00:57:05.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.235+0000 7fdf25ca9640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf201049b0 0x7fdf2019a440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d950 tx=0x7fdf1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:05.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.235+0000 7fdf12ffd640 1 -- 172.21.15.47:0/1049680826 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c017020 con 0x7fdf201049b0 2024-09-21T00:57:05.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.235+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf201a05e0 con 0x7fdf201049b0 2024-09-21T00:57:05.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.235+0000 7fdf12ffd640 1 -- 172.21.15.47:0/1049680826 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf1c009c30 con 0x7fdf201049b0 2024-09-21T00:57:05.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.235+0000 7fdf12ffd640 1 -- 172.21.15.47:0/1049680826 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00f6b0 con 0x7fdf201049b0 2024-09-21T00:57:05.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.235+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201a6e00 con 0x7fdf201049b0 2024-09-21T00:57:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.236+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2006c2e0 con 0x7fdf201049b0 2024-09-21T00:57:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.237+0000 7fdf12ffd640 1 -- 172.21.15.47:0/1049680826 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fdf1c01a020 con 0x7fdf201049b0 2024-09-21T00:57:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.238+0000 7fdf12ffd640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf0c0b65d0 0x7fdf0c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.238+0000 7fdf254a8640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf0c0b65d0 0x7fdf0c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.238+0000 7fdf12ffd640 1 -- 172.21.15.47:0/1049680826 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fdf1c0e73c0 con 0x7fdf201049b0 2024-09-21T00:57:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.239+0000 7fdf254a8640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf0c0b65d0 0x7fdf0c0b8ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf2010fa90 tx=0x7fdf1400c4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:05.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.241+0000 7fdf12ffd640 1 -- 172.21.15.47:0/1049680826 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf1c0adca0 con 0x7fdf201049b0 2024-09-21T00:57:05.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.455+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdf20108040 con 0x7fdf0c0b65d0 2024-09-21T00:57:05.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.483+0000 7fdf12ffd640 1 -- 172.21.15.47:0/1049680826 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdf20108040 con 0x7fdf0c0b65d0 2024-09-21T00:57:05.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf0c0b65d0 msgr2=0x7fdf0c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:05.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf0c0b65d0 0x7fdf0c0b8ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf2010fa90 tx=0x7fdf1400c4a0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf201049b0 msgr2=0x7fdf2019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:05.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf201049b0 0x7fdf2019a440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d950 tx=0x7fdf1c00de10 comp rx=0 tx=0).stop 2024-09-21T00:57:05.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 shutdown_connections 2024-09-21T00:57:05.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf0c0b65d0 0x7fdf0c0b8ae0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf2010de10 0x7fdf2019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf20105300 0x7fdf2019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 --2- 172.21.15.47:0/1049680826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf201049b0 0x7fdf2019a440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 >> 172.21.15.47:0/1049680826 conn(0x7fdf20079720 msgr2=0x7fdf20107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 shutdown_connections 2024-09-21T00:57:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:05.485+0000 7fdf27f0d640 1 -- 172.21.15.47:0/1049680826 wait complete. 2024-09-21T00:57:06.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T00:57:06.385 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:06.768 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:06 smithi047 ceph-mon[30960]: pgmap v295: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T00:57:06.768 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:06 smithi047 ceph-mon[30960]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 -- 172.21.15.47:0/918267185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 msgr2=0x7f4d04102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/918267185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 0x7f4d04102ef0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009900 tx=0x7f4cf402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 -- 172.21.15.47:0/918267185 shutdown_connections 2024-09-21T00:57:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/918267185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d04108d20 0x7f4d0410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/918267185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d041083d0 0x7f4d041087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/918267185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 0x7f4d04102ef0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 -- 172.21.15.47:0/918267185 >> 172.21.15.47:0/918267185 conn(0x7f4d04079760 msgr2=0x7f4d04079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 -- 172.21.15.47:0/918267185 shutdown_connections 2024-09-21T00:57:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.864+0000 7f4d09fa5640 1 -- 172.21.15.47:0/918267185 wait complete. 2024-09-21T00:57:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d09fa5640 1 Processor -- start 2024-09-21T00:57:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d09fa5640 1 -- start start 2024-09-21T00:57:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d09fa5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 0x7f4d04199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d09fa5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d041083d0 0x7f4d04199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d09fa5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d04108d20 0x7f4d0419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d09fa5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4d04112990 con 0x7f4d04102ae0 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d09fa5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4d04112810 con 0x7f4d041083d0 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d09fa5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d04112b10 con 0x7f4d04108d20 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d037fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 0x7f4d04199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d037fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 0x7f4d04199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49850/0 (socket says 172.21.15.47:49850) 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.865+0000 7f4d037fe640 1 -- 172.21.15.47:0/3542100872 learned_addr learned my addr 172.21.15.47:0/3542100872 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d03fff640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d04108d20 0x7f4d0419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d02ffd640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d041083d0 0x7f4d04199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d037fe640 1 -- 172.21.15.47:0/3542100872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d04108d20 msgr2=0x7f4d0419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d037fe640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d04108d20 0x7f4d0419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d037fe640 1 -- 172.21.15.47:0/3542100872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d041083d0 msgr2=0x7f4d04199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d037fe640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d041083d0 0x7f4d04199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d037fe640 1 -- 172.21.15.47:0/3542100872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0419f210 con 0x7f4d04102ae0 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d02ffd640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d041083d0 0x7f4d04199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d037fe640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 0x7f4d04199360 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4005940 tx=0x7f4cf40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d00ff9640 1 -- 172.21.15.47:0/3542100872 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf403f030 con 0x7f4d04102ae0 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0419f4a0 con 0x7f4d04102ae0 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d00ff9640 1 -- 172.21.15.47:0/3542100872 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cf4003cb0 con 0x7f4d04102ae0 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d00ff9640 1 -- 172.21.15.47:0/3542100872 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4035070 con 0x7f4d04102ae0 2024-09-21T00:57:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.866+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0419f980 con 0x7f4d04102ae0 2024-09-21T00:57:06.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.867+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d04103d10 con 0x7f4d04102ae0 2024-09-21T00:57:06.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.869+0000 7f4d00ff9640 1 -- 172.21.15.47:0/3542100872 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f4cf4042030 con 0x7f4d04102ae0 2024-09-21T00:57:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.870+0000 7f4d00ff9640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4cec0b65d0 0x7f4cec0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.870+0000 7f4d02ffd640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4cec0b65d0 0x7f4cec0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.870+0000 7f4d00ff9640 1 -- 172.21.15.47:0/3542100872 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f4cf4107ba0 con 0x7f4d04102ae0 2024-09-21T00:57:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.871+0000 7f4d02ffd640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4cec0b65d0 0x7f4cec0b8ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d04079e60 tx=0x7f4cf8005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:06.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:06.874+0000 7f4d00ff9640 1 -- 172.21.15.47:0/3542100872 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cf40ce480 con 0x7f4d04102ae0 2024-09-21T00:57:07.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.090+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f4d0410ab50 con 0x7f4cec0b65d0 2024-09-21T00:57:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:06 smithi134 ceph-mon[34785]: pgmap v295: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T00:57:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:06 smithi134 ceph-mon[34785]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:07.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.095+0000 7f4d00ff9640 1 -- 172.21.15.47:0/3542100872 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4d0410ab50 con 0x7f4cec0b65d0 2024-09-21T00:57:07.096 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/qa/sv_1/45519c2e-f169-4765-a889-8456142a55d7 2024-09-21T00:57:07.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4cec0b65d0 msgr2=0x7f4cec0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:07.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4cec0b65d0 0x7f4cec0b8ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d04079e60 tx=0x7f4cf8005e50 comp rx=0 tx=0).stop 2024-09-21T00:57:07.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 msgr2=0x7f4d04199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:07.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 0x7f4d04199360 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4005940 tx=0x7f4cf40042f0 comp rx=0 tx=0).stop 2024-09-21T00:57:07.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 shutdown_connections 2024-09-21T00:57:07.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4cec0b65d0 0x7f4cec0b8ae0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:07.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d04108d20 0x7f4d0419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:07.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d041083d0 0x7f4d04199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:07.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 --2- 172.21.15.47:0/3542100872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d04102ae0 0x7f4d04199360 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:07.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 >> 172.21.15.47:0/3542100872 conn(0x7f4d04079760 msgr2=0x7f4d041015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:07.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 shutdown_connections 2024-09-21T00:57:07.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:07.097+0000 7f4d09fa5640 1 -- 172.21.15.47:0/3542100872 wait complete. 2024-09-21T00:57:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:06 smithi114 ceph-mon[34309]: pgmap v295: 97 pgs: 97 active+clean; 585 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T00:57:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:06 smithi114 ceph-mon[34309]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:07.787 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:57:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:08.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 -- 172.21.15.47:0/3683707382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f328010de60 msgr2=0x7f3280110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:08.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 --2- 172.21.15.47:0/3683707382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f328010de60 0x7f3280110330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3278009ca0 tx=0x7f327802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 -- 172.21.15.47:0/3683707382 shutdown_connections 2024-09-21T00:57:08.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 --2- 172.21.15.47:0/3683707382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f328010de60 0x7f3280110330 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 --2- 172.21.15.47:0/3683707382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3280105380 0x7f328010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 --2- 172.21.15.47:0/3683707382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280104a30 0x7f3280104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 -- 172.21.15.47:0/3683707382 >> 172.21.15.47:0/3683707382 conn(0x7f3280079760 msgr2=0x7f3280079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 -- 172.21.15.47:0/3683707382 shutdown_connections 2024-09-21T00:57:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 -- 172.21.15.47:0/3683707382 wait complete. 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.509+0000 7f3285f76640 1 Processor -- start 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f3285f76640 1 -- start start 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f3285f76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3280104a30 0x7f328019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f3285f76640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280105380 0x7f328019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f3285f76640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f328010de60 0x7f328019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f3285f76640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3280113b10 con 0x7f3280104a30 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f3285f76640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3280113990 con 0x7f3280105380 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f3285f76640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3280113c90 con 0x7f328010de60 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f327f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3280104a30 0x7f328019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f327f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3280104a30 0x7f328019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49878/0 (socket says 172.21.15.47:49878) 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f327f7fe640 1 -- 172.21.15.47:0/2059641026 learned_addr learned my addr 172.21.15.47:0/2059641026 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.510+0000 7f327effd640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280105380 0x7f328019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327ffff640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f328010de60 0x7f328019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327f7fe640 1 -- 172.21.15.47:0/2059641026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f328010de60 msgr2=0x7f328019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327f7fe640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f328010de60 0x7f328019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327f7fe640 1 -- 172.21.15.47:0/2059641026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280105380 msgr2=0x7f328019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327f7fe640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280105380 0x7f328019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327f7fe640 1 -- 172.21.15.47:0/2059641026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32801a03b0 con 0x7f3280104a30 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327effd640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280105380 0x7f328019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327f7fe640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3280104a30 0x7f328019a440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9c0 tx=0x7f327000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327cff9640 1 -- 172.21.15.47:0/2059641026 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327000cd80 con 0x7f3280104a30 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327cff9640 1 -- 172.21.15.47:0/2059641026 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32700035f0 con 0x7f3280104a30 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f327cff9640 1 -- 172.21.15.47:0/2059641026 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270010690 con 0x7f3280104a30 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32801a06a0 con 0x7f3280104a30 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.511+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32801a6e00 con 0x7f3280104a30 2024-09-21T00:57:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.512+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328006c1f0 con 0x7f3280104a30 2024-09-21T00:57:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.514+0000 7f327cff9640 1 -- 172.21.15.47:0/2059641026 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f32700037a0 con 0x7f3280104a30 2024-09-21T00:57:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.515+0000 7f327cff9640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32680b65a0 0x7f32680b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.515+0000 7f327effd640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32680b65a0 0x7f32680b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.515+0000 7f327cff9640 1 -- 172.21.15.47:0/2059641026 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f32700e79d0 con 0x7f3280104a30 2024-09-21T00:57:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.515+0000 7f327effd640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32680b65a0 0x7f32680b8ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f32740058c0 tx=0x7f3274005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.518+0000 7f327cff9640 1 -- 172.21.15.47:0/2059641026 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32700ae1b0 con 0x7f3280104a30 2024-09-21T00:57:08.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.744+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3280104e40 con 0x7f3280104a30 2024-09-21T00:57:08.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.745+0000 7f327cff9640 1 -- 172.21.15.47:0/2059641026 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f32700a9070 con 0x7f3280104a30 2024-09-21T00:57:08.746 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:08.746 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:57:08.746 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32680b65a0 msgr2=0x7f32680b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32680b65a0 0x7f32680b8ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f32740058c0 tx=0x7f3274005850 comp rx=0 tx=0).stop 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3280104a30 msgr2=0x7f328019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3280104a30 0x7f328019a440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9c0 tx=0x7f327000ee80 comp rx=0 tx=0).stop 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 shutdown_connections 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32680b65a0 0x7f32680b8ab0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f328010de60 0x7f328019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3280105380 0x7f328019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 --2- 172.21.15.47:0/2059641026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3280104a30 0x7f328019a440 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 >> 172.21.15.47:0/2059641026 conn(0x7f3280079760 msgr2=0x7f3280105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:08.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 shutdown_connections 2024-09-21T00:57:08.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:08.747+0000 7f3285f76640 1 -- 172.21.15.47:0/2059641026 wait complete. 2024-09-21T00:57:08.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:08 smithi047 ceph-mon[30960]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:08.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:08 smithi047 ceph-mon[30960]: pgmap v296: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T00:57:08.962 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:08 smithi114 ceph-mon[34309]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:08.962 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:08 smithi114 ceph-mon[34309]: pgmap v296: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T00:57:09.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:08 smithi134 ceph-mon[34785]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:57:09.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:08 smithi134 ceph-mon[34785]: pgmap v296: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T00:57:09.376 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:57:09.642 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:09.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:09 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2059641026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:09.995 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:09 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2059641026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:10.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 -- 172.21.15.47:0/1582059190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 msgr2=0x7f55d0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:10.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 --2- 172.21.15.47:0/1582059190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 0x7f55d0102e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009860 tx=0x7f55cc02a340 comp rx=0 tx=0).stop 2024-09-21T00:57:10.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 -- 172.21.15.47:0/1582059190 shutdown_connections 2024-09-21T00:57:10.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 --2- 172.21.15.47:0/1582059190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d0108cf0 0x7f55d010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 --2- 172.21.15.47:0/1582059190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d01083a0 0x7f55d01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 --2- 172.21.15.47:0/1582059190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 0x7f55d0102e70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 -- 172.21.15.47:0/1582059190 >> 172.21.15.47:0/1582059190 conn(0x7f55d0079730 msgr2=0x7f55d0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:10.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 -- 172.21.15.47:0/1582059190 shutdown_connections 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 -- 172.21.15.47:0/1582059190 wait complete. 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.123+0000 7f55d83b4640 1 Processor -- start 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d83b4640 1 -- start start 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d83b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 0x7f55d019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d83b4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d01083a0 0x7f55d019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d83b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d0108cf0 0x7f55d019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d83b4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0112960 con 0x7f55d0108cf0 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d83b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f55d01127e0 con 0x7f55d0102a60 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d83b4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0112ae0 con 0x7f55d01083a0 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6951640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d0108cf0 0x7f55d019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6951640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d0108cf0 0x7f55d019fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49896/0 (socket says 172.21.15.47:49896) 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6951640 1 -- 172.21.15.47:0/2654199529 learned_addr learned my addr 172.21.15.47:0/2654199529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:10.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6150640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 0x7f55d019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d594f640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d01083a0 0x7f55d019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6951640 1 -- 172.21.15.47:0/2654199529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d01083a0 msgr2=0x7f55d019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6951640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d01083a0 0x7f55d019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6951640 1 -- 172.21.15.47:0/2654199529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 msgr2=0x7f55d019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6951640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 0x7f55d019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6951640 1 -- 172.21.15.47:0/2654199529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d01a0390 con 0x7f55d0108cf0 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d594f640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d01083a0 0x7f55d019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.124+0000 7f55d6150640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 0x7f55d019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.125+0000 7f55d6951640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d0108cf0 0x7f55d019fc60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f55c800eb10 tx=0x7f55c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.125+0000 7f55c37fe640 1 -- 172.21.15.47:0/2654199529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8004b20 con 0x7f55d0108cf0 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.125+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d01a0680 con 0x7f55d0108cf0 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.125+0000 7f55c37fe640 1 -- 172.21.15.47:0/2654199529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55c8004cc0 con 0x7f55d0108cf0 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.125+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d01a6de0 con 0x7f55d0108cf0 2024-09-21T00:57:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.125+0000 7f55c37fe640 1 -- 172.21.15.47:0/2654199529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8010690 con 0x7f55d0108cf0 2024-09-21T00:57:10.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.126+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d0102e70 con 0x7f55d0108cf0 2024-09-21T00:57:10.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.128+0000 7f55c37fe640 1 -- 172.21.15.47:0/2654199529 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f55c8005020 con 0x7f55d0108cf0 2024-09-21T00:57:10.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.129+0000 7f55c37fe640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f55bc0b65a0 0x7f55bc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:10.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.129+0000 7f55d6150640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f55bc0b65a0 0x7f55bc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:10.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.129+0000 7f55c37fe640 1 -- 172.21.15.47:0/2654199529 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f55c80e7960 con 0x7f55d0108cf0 2024-09-21T00:57:10.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.129+0000 7f55d6150640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f55bc0b65a0 0x7f55bc0b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f55cc02a930 tx=0x7f55cc0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:10.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.133+0000 7f55c37fe640 1 -- 172.21.15.47:0/2654199529 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55c80ae240 con 0x7f55d0108cf0 2024-09-21T00:57:10.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:09 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2059641026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:10.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.321+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55d01a7070 con 0x7f55d0108cf0 2024-09-21T00:57:10.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.323+0000 7f55c37fe640 1 -- 172.21.15.47:0/2654199529 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22293 (secure 0 0 0) 0x7f55c80cf8f0 con 0x7f55d0108cf0 2024-09-21T00:57:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:56:49.242027+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:57:10.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.325+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f55bc0b65a0 msgr2=0x7f55bc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:10.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.325+0000 7f55d83b4640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f55bc0b65a0 0x7f55bc0b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f55cc02a930 tx=0x7f55cc0058d0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.325+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d0108cf0 msgr2=0x7f55d019fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.325+0000 7f55d83b4640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d0108cf0 0x7f55d019fc60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f55c800eb10 tx=0x7f55c800c2d0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.326+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 shutdown_connections 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.326+0000 7f55d83b4640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f55bc0b65a0 0x7f55bc0b8ab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.326+0000 7f55d83b4640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55d0108cf0 0x7f55d019fc60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.326+0000 7f55d83b4640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d01083a0 0x7f55d019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.326+0000 7f55d83b4640 1 --2- 172.21.15.47:0/2654199529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d0102a60 0x7f55d019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.326+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 >> 172.21.15.47:0/2654199529 conn(0x7f55d0079730 msgr2=0x7f55d0106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.326+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 shutdown_connections 2024-09-21T00:57:10.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:10.326+0000 7f55d83b4640 1 -- 172.21.15.47:0/2654199529 wait complete. 2024-09-21T00:57:10.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:10 smithi047 ceph-mon[30960]: pgmap v297: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T00:57:10.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:10 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2654199529' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:11.013 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:10 smithi134 ceph-mon[34785]: pgmap v297: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T00:57:11.013 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:10 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2654199529' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:11.044 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T00:57:11.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:57:11.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:10 smithi114 ceph-mon[34309]: pgmap v297: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-21T00:57:11.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:10 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2654199529' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:11.301 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:11.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 -- 172.21.15.47:0/1805339748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c108cf0 msgr2=0x7f152c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:11.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 --2- 172.21.15.47:0/1805339748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c108cf0 0x7f152c10f520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1524009900 tx=0x7f152402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:11.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 -- 172.21.15.47:0/1805339748 shutdown_connections 2024-09-21T00:57:11.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 --2- 172.21.15.47:0/1805339748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c108cf0 0x7f152c10f520 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 --2- 172.21.15.47:0/1805339748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f152c1083a0 0x7f152c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 --2- 172.21.15.47:0/1805339748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f152c102a60 0x7f152c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 -- 172.21.15.47:0/1805339748 >> 172.21.15.47:0/1805339748 conn(0x7f152c079730 msgr2=0x7f152c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 -- 172.21.15.47:0/1805339748 shutdown_connections 2024-09-21T00:57:11.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.820+0000 7f153366d640 1 -- 172.21.15.47:0/1805339748 wait complete. 2024-09-21T00:57:11.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f153366d640 1 Processor -- start 2024-09-21T00:57:11.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f153366d640 1 -- start start 2024-09-21T00:57:11.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f153366d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f152c102a60 0x7f152c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:11.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f153366d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c1083a0 0x7f152c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:11.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f153366d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f152c108cf0 0x7f152c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f153366d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f152c112960 con 0x7f152c1083a0 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f153366d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f152c1127e0 con 0x7f152c102a60 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f153366d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f152c112ae0 con 0x7f152c108cf0 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f1530c08640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c1083a0 0x7f152c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f1530c08640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c1083a0 0x7f152c19a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46348/0 (socket says 172.21.15.47:46348) 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f1530c08640 1 -- 172.21.15.47:0/817258375 learned_addr learned my addr 172.21.15.47:0/817258375 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f1531c0a640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f152c108cf0 0x7f152c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.821+0000 7f1531409640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f152c102a60 0x7f152c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f1530c08640 1 -- 172.21.15.47:0/817258375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f152c108cf0 msgr2=0x7f152c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:11.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f1530c08640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f152c108cf0 0x7f152c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f1530c08640 1 -- 172.21.15.47:0/817258375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f152c102a60 msgr2=0x7f152c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f1530c08640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f152c102a60 0x7f152c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f1530c08640 1 -- 172.21.15.47:0/817258375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c1a0350 con 0x7f152c1083a0 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f1531c0a640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f152c108cf0 0x7f152c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f1530c08640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c1083a0 0x7f152c19a980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f152000d770 tx=0x7f152000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f151e7fc640 1 -- 172.21.15.47:0/817258375 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520017070 con 0x7f152c1083a0 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f151e7fc640 1 -- 172.21.15.47:0/817258375 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1520009c30 con 0x7f152c1083a0 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152c1a0640 con 0x7f152c1083a0 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f151e7fc640 1 -- 172.21.15.47:0/817258375 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152000f620 con 0x7f152c1083a0 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.822+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152c1a6da0 con 0x7f152c1083a0 2024-09-21T00:57:11.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.823+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f152c102e70 con 0x7f152c1083a0 2024-09-21T00:57:11.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.825+0000 7f151e7fc640 1 -- 172.21.15.47:0/817258375 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f152001a070 con 0x7f152c1083a0 2024-09-21T00:57:11.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.825+0000 7f151e7fc640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f15180b6620 0x7f15180b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:11.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.825+0000 7f1531409640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f15180b6620 0x7f15180b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:11.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.826+0000 7f151e7fc640 1 -- 172.21.15.47:0/817258375 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f15200e6c90 con 0x7f152c1083a0 2024-09-21T00:57:11.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.826+0000 7f1531409640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f15180b6620 0x7f15180b8b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1528005fd0 tx=0x7f1528009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:11.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:11.829+0000 7f151e7fc640 1 -- 172.21.15.47:0/817258375 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1520009de0 con 0x7f152c1083a0 2024-09-21T00:57:12.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.014+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f152c10bb30 con 0x7f15180b6620 2024-09-21T00:57:12.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.019+0000 7f151e7fc640 1 -- 172.21.15.47:0/817258375 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258621 (secure 0 0 0) 0x7f152c10bb30 con 0x7f15180b6620 2024-09-21T00:57:12.022 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:12.023 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-21T00:57:12.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f15180b6620 msgr2=0x7f15180b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f15180b6620 0x7f15180b8b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1528005fd0 tx=0x7f1528009500 comp rx=0 tx=0).stop 2024-09-21T00:57:12.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c1083a0 msgr2=0x7f152c19a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:12.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c1083a0 0x7f152c19a980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f152000d770 tx=0x7f152000dc30 comp rx=0 tx=0).stop 2024-09-21T00:57:12.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 shutdown_connections 2024-09-21T00:57:12.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f15180b6620 0x7f15180b8b30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f152c108cf0 0x7f152c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f152c1083a0 0x7f152c19a980 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 --2- 172.21.15.47:0/817258375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f152c102a60 0x7f152c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:12.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 >> 172.21.15.47:0/817258375 conn(0x7f152c079730 msgr2=0x7f152c06b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:12.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 shutdown_connections 2024-09-21T00:57:12.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:12.022+0000 7f153366d640 1 -- 172.21.15.47:0/817258375 wait complete. 2024-09-21T00:57:12.765 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-21T00:57:11.259028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636603,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":110,"num_read_kb":127,"num_write":191,"num_write_kb":2218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381412,"kb_used_data":11340,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560412,"statfs":{"total":1151940427776,"available":1151549861888,"internally_reserved":0,"allocated":11612160,"data_stored":6531765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43825,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":55,"num_write":23,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003382"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644246+0000","last_change":"2024-09-21T00:56:48.655444+0000","last_active":"2024-09-21T00:56:49.644246+0000","last_peered":"2024-09-21T00:56:49.644246+0000","last_clean":"2024-09-21T00:56:49.644246+0000","last_became_active":"2024-09-21T00:56:48.655083+0000","last_became_peered":"2024-09-21T00:56:48.655083+0000","last_unstale":"2024-09-21T00:56:49.644246+0000","last_undegraded":"2024-09-21T00:56:49.644246+0000","last_fullsized":"2024-09-21T00:56:49.644246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:07.300682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659744+0000","last_change":"2024-09-21T00:56:48.655066+0000","last_active":"2024-09-21T00:56:49.659744+0000","last_peered":"2024-09-21T00:56:49.659744+0000","last_clean":"2024-09-21T00:56:49.659744+0000","last_became_active":"2024-09-21T00:56:48.654679+0000","last_became_peered":"2024-09-21T00:56:48.654679+0000","last_unstale":"2024-09-21T00:56:49.659744+0000","last_undegraded":"2024-09-21T00:56:49.659744+0000","last_fullsized":"2024-09-21T00:56:49.659744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659646+0000","last_change":"2024-09-21T00:56:48.648770+0000","last_active":"2024-09-21T00:56:49.659646+0000","last_peered":"2024-09-21T00:56:49.659646+0000","last_clean":"2024-09-21T00:56:49.659646+0000","last_became_active":"2024-09-21T00:56:48.648383+0000","last_became_peered":"2024-09-21T00:56:48.648383+0000","last_unstale":"2024-09-21T00:56:49.659646+0000","last_undegraded":"2024-09-21T00:56:49.659646+0000","last_fullsized":"2024-09-21T00:56:49.659646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.616648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659345+0000","last_change":"2024-09-21T00:56:48.660074+0000","last_active":"2024-09-21T00:56:49.659345+0000","last_peered":"2024-09-21T00:56:49.659345+0000","last_clean":"2024-09-21T00:56:49.659345+0000","last_became_active":"2024-09-21T00:56:48.658784+0000","last_became_peered":"2024-09-21T00:56:48.658784+0000","last_unstale":"2024-09-21T00:56:49.659345+0000","last_undegraded":"2024-09-21T00:56:49.659345+0000","last_fullsized":"2024-09-21T00:56:49.659345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:50.368857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656231+0000","last_change":"2024-09-21T00:56:48.654307+0000","last_active":"2024-09-21T00:56:49.656231+0000","last_peered":"2024-09-21T00:56:49.656231+0000","last_clean":"2024-09-21T00:56:49.656231+0000","last_became_active":"2024-09-21T00:56:48.653898+0000","last_became_peered":"2024-09-21T00:56:48.653898+0000","last_unstale":"2024-09-21T00:56:49.656231+0000","last_undegraded":"2024-09-21T00:56:49.656231+0000","last_fullsized":"2024-09-21T00:56:49.656231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643638+0000","last_change":"2024-09-21T00:56:48.649950+0000","last_active":"2024-09-21T00:56:49.643638+0000","last_peered":"2024-09-21T00:56:49.643638+0000","last_clean":"2024-09-21T00:56:49.643638+0000","last_became_active":"2024-09-21T00:56:48.649305+0000","last_became_peered":"2024-09-21T00:56:48.649305+0000","last_unstale":"2024-09-21T00:56:49.643638+0000","last_undegraded":"2024-09-21T00:56:49.643638+0000","last_fullsized":"2024-09-21T00:56:49.643638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:56.456377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656357+0000","last_change":"2024-09-21T00:56:48.656109+0000","last_active":"2024-09-21T00:56:49.656357+0000","last_peered":"2024-09-21T00:56:49.656357+0000","last_clean":"2024-09-21T00:56:49.656357+0000","last_became_active":"2024-09-21T00:56:48.654465+0000","last_became_peered":"2024-09-21T00:56:48.654465+0000","last_unstale":"2024-09-21T00:56:49.656357+0000","last_undegraded":"2024-09-21T00:56:49.656357+0000","last_fullsized":"2024-09-21T00:56:49.656357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:05.779845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656342+0000","last_change":"2024-09-21T00:56:48.656351+0000","last_active":"2024-09-21T00:56:49.656342+0000","last_peered":"2024-09-21T00:56:49.656342+0000","last_clean":"2024-09-21T00:56:49.656342+0000","last_became_active":"2024-09-21T00:56:48.654388+0000","last_became_peered":"2024-09-21T00:56:48.654388+0000","last_unstale":"2024-09-21T00:56:49.656342+0000","last_undegraded":"2024-09-21T00:56:49.656342+0000","last_fullsized":"2024-09-21T00:56:49.656342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:39.441882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658496+0000","last_change":"2024-09-21T00:56:48.661083+0000","last_active":"2024-09-21T00:56:49.658496+0000","last_peered":"2024-09-21T00:56:49.658496+0000","last_clean":"2024-09-21T00:56:49.658496+0000","last_became_active":"2024-09-21T00:56:48.660418+0000","last_became_peered":"2024-09-21T00:56:48.660418+0000","last_unstale":"2024-09-21T00:56:49.658496+0000","last_undegraded":"2024-09-21T00:56:49.658496+0000","last_fullsized":"2024-09-21T00:56:49.658496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:02.494368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644114+0000","last_change":"2024-09-21T00:56:48.660257+0000","last_active":"2024-09-21T00:56:49.644114+0000","last_peered":"2024-09-21T00:56:49.644114+0000","last_clean":"2024-09-21T00:56:49.644114+0000","last_became_active":"2024-09-21T00:56:48.659894+0000","last_became_peered":"2024-09-21T00:56:48.659894+0000","last_unstale":"2024-09-21T00:56:49.644114+0000","last_undegraded":"2024-09-21T00:56:49.644114+0000","last_fullsized":"2024-09-21T00:56:49.644114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.012107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656069+0000","last_change":"2024-09-21T00:56:48.653146+0000","last_active":"2024-09-21T00:56:49.656069+0000","last_peered":"2024-09-21T00:56:49.656069+0000","last_clean":"2024-09-21T00:56:49.656069+0000","last_became_active":"2024-09-21T00:56:48.652599+0000","last_became_peered":"2024-09-21T00:56:48.652599+0000","last_unstale":"2024-09-21T00:56:49.656069+0000","last_undegraded":"2024-09-21T00:56:49.656069+0000","last_fullsized":"2024-09-21T00:56:49.656069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:16.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659583+0000","last_change":"2024-09-21T00:56:48.659521+0000","last_active":"2024-09-21T00:56:49.659583+0000","last_peered":"2024-09-21T00:56:49.659583+0000","last_clean":"2024-09-21T00:56:49.659583+0000","last_became_active":"2024-09-21T00:56:48.658168+0000","last_became_peered":"2024-09-21T00:56:48.658168+0000","last_unstale":"2024-09-21T00:56:49.659583+0000","last_undegraded":"2024-09-21T00:56:49.659583+0000","last_fullsized":"2024-09-21T00:56:49.659583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:51.910450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657680+0000","last_change":"2024-09-21T00:56:48.652163+0000","last_active":"2024-09-21T00:56:49.657680+0000","last_peered":"2024-09-21T00:56:49.657680+0000","last_clean":"2024-09-21T00:56:49.657680+0000","last_became_active":"2024-09-21T00:56:48.651839+0000","last_became_peered":"2024-09-21T00:56:48.651839+0000","last_unstale":"2024-09-21T00:56:49.657680+0000","last_undegraded":"2024-09-21T00:56:49.657680+0000","last_fullsized":"2024-09-21T00:56:49.657680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:50.682747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659831+0000","last_change":"2024-09-21T00:56:48.655106+0000","last_active":"2024-09-21T00:56:49.659831+0000","last_peered":"2024-09-21T00:56:49.659831+0000","last_clean":"2024-09-21T00:56:49.659831+0000","last_became_active":"2024-09-21T00:56:48.654722+0000","last_became_peered":"2024-09-21T00:56:48.654722+0000","last_unstale":"2024-09-21T00:56:49.659831+0000","last_undegraded":"2024-09-21T00:56:49.659831+0000","last_fullsized":"2024-09-21T00:56:49.659831+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:36.023960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659887+0000","last_change":"2024-09-21T00:56:48.648935+0000","last_active":"2024-09-21T00:56:49.659887+0000","last_peered":"2024-09-21T00:56:49.659887+0000","last_clean":"2024-09-21T00:56:49.659887+0000","last_became_active":"2024-09-21T00:56:48.648557+0000","last_became_peered":"2024-09-21T00:56:48.648557+0000","last_unstale":"2024-09-21T00:56:49.659887+0000","last_undegraded":"2024-09-21T00:56:49.659887+0000","last_fullsized":"2024-09-21T00:56:49.659887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:17.791401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656794+0000","last_change":"2024-09-21T00:56:48.651338+0000","last_active":"2024-09-21T00:56:49.656794+0000","last_peered":"2024-09-21T00:56:49.656794+0000","last_clean":"2024-09-21T00:56:49.656794+0000","last_became_active":"2024-09-21T00:56:48.650940+0000","last_became_peered":"2024-09-21T00:56:48.650940+0000","last_unstale":"2024-09-21T00:56:49.656794+0000","last_undegraded":"2024-09-21T00:56:49.656794+0000","last_fullsized":"2024-09-21T00:56:49.656794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644319+0000","last_change":"2024-09-21T00:56:48.655091+0000","last_active":"2024-09-21T00:56:49.644319+0000","last_peered":"2024-09-21T00:56:49.644319+0000","last_clean":"2024-09-21T00:56:49.644319+0000","last_became_active":"2024-09-21T00:56:48.654534+0000","last_became_peered":"2024-09-21T00:56:48.654534+0000","last_unstale":"2024-09-21T00:56:49.644319+0000","last_undegraded":"2024-09-21T00:56:49.644319+0000","last_fullsized":"2024-09-21T00:56:49.644319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:44.007171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.642624+0000","last_change":"2024-09-21T00:56:48.654933+0000","last_active":"2024-09-21T00:56:49.642624+0000","last_peered":"2024-09-21T00:56:49.642624+0000","last_clean":"2024-09-21T00:56:49.642624+0000","last_became_active":"2024-09-21T00:56:48.654523+0000","last_became_peered":"2024-09-21T00:56:48.654523+0000","last_unstale":"2024-09-21T00:56:49.642624+0000","last_undegraded":"2024-09-21T00:56:49.642624+0000","last_fullsized":"2024-09-21T00:56:49.642624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:58.190118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656633+0000","last_change":"2024-09-21T00:56:48.645166+0000","last_active":"2024-09-21T00:56:49.656633+0000","last_peered":"2024-09-21T00:56:49.656633+0000","last_clean":"2024-09-21T00:56:49.656633+0000","last_became_active":"2024-09-21T00:56:48.644695+0000","last_became_peered":"2024-09-21T00:56:48.644695+0000","last_unstale":"2024-09-21T00:56:49.656633+0000","last_undegraded":"2024-09-21T00:56:49.656633+0000","last_fullsized":"2024-09-21T00:56:49.656633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:07.564405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644049+0000","last_change":"2024-09-21T00:56:48.659215+0000","last_active":"2024-09-21T00:56:49.644049+0000","last_peered":"2024-09-21T00:56:49.644049+0000","last_clean":"2024-09-21T00:56:49.644049+0000","last_became_active":"2024-09-21T00:56:48.658783+0000","last_became_peered":"2024-09-21T00:56:48.658783+0000","last_unstale":"2024-09-21T00:56:49.644049+0000","last_undegraded":"2024-09-21T00:56:49.644049+0000","last_fullsized":"2024-09-21T00:56:49.644049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:08:58.663963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657588+0000","last_change":"2024-09-21T00:56:48.644461+0000","last_active":"2024-09-21T00:56:49.657588+0000","last_peered":"2024-09-21T00:56:49.657588+0000","last_clean":"2024-09-21T00:56:49.657588+0000","last_became_active":"2024-09-21T00:56:48.643842+0000","last_became_peered":"2024-09-21T00:56:48.643842+0000","last_unstale":"2024-09-21T00:56:49.657588+0000","last_undegraded":"2024-09-21T00:56:49.657588+0000","last_fullsized":"2024-09-21T00:56:49.657588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:12.673501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657354+0000","last_change":"2024-09-21T00:56:48.651212+0000","last_active":"2024-09-21T00:56:49.657354+0000","last_peered":"2024-09-21T00:56:49.657354+0000","last_clean":"2024-09-21T00:56:49.657354+0000","last_became_active":"2024-09-21T00:56:48.650802+0000","last_became_peered":"2024-09-21T00:56:48.650802+0000","last_unstale":"2024-09-21T00:56:49.657354+0000","last_undegraded":"2024-09-21T00:56:49.657354+0000","last_fullsized":"2024-09-21T00:56:49.657354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:06.310898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656834+0000","last_change":"2024-09-21T00:56:48.647772+0000","last_active":"2024-09-21T00:56:49.656834+0000","last_peered":"2024-09-21T00:56:49.656834+0000","last_clean":"2024-09-21T00:56:49.656834+0000","last_became_active":"2024-09-21T00:56:48.647379+0000","last_became_peered":"2024-09-21T00:56:48.647379+0000","last_unstale":"2024-09-21T00:56:49.656834+0000","last_undegraded":"2024-09-21T00:56:49.656834+0000","last_fullsized":"2024-09-21T00:56:49.656834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:06.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657734+0000","last_change":"2024-09-21T00:56:48.655841+0000","last_active":"2024-09-21T00:56:49.657734+0000","last_peered":"2024-09-21T00:56:49.657734+0000","last_clean":"2024-09-21T00:56:49.657734+0000","last_became_active":"2024-09-21T00:56:48.655270+0000","last_became_peered":"2024-09-21T00:56:48.655270+0000","last_unstale":"2024-09-21T00:56:49.657734+0000","last_undegraded":"2024-09-21T00:56:49.657734+0000","last_fullsized":"2024-09-21T00:56:49.657734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:28.350627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656883+0000","last_change":"2024-09-21T00:56:48.659457+0000","last_active":"2024-09-21T00:56:49.656883+0000","last_peered":"2024-09-21T00:56:49.656883+0000","last_clean":"2024-09-21T00:56:49.656883+0000","last_became_active":"2024-09-21T00:56:48.658999+0000","last_became_peered":"2024-09-21T00:56:48.658999+0000","last_unstale":"2024-09-21T00:56:49.656883+0000","last_undegraded":"2024-09-21T00:56:49.656883+0000","last_fullsized":"2024-09-21T00:56:49.656883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:56.196167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.660764+0000","last_change":"2024-09-21T00:56:48.656361+0000","last_active":"2024-09-21T00:56:49.660764+0000","last_peered":"2024-09-21T00:56:49.660764+0000","last_clean":"2024-09-21T00:56:49.660764+0000","last_became_active":"2024-09-21T00:56:48.655999+0000","last_became_peered":"2024-09-21T00:56:48.655999+0000","last_unstale":"2024-09-21T00:56:49.660764+0000","last_undegraded":"2024-09-21T00:56:49.660764+0000","last_fullsized":"2024-09-21T00:56:49.660764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:46.533280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644130+0000","last_change":"2024-09-21T00:56:48.656549+0000","last_active":"2024-09-21T00:56:49.644130+0000","last_peered":"2024-09-21T00:56:49.644130+0000","last_clean":"2024-09-21T00:56:49.644130+0000","last_became_active":"2024-09-21T00:56:48.656154+0000","last_became_peered":"2024-09-21T00:56:48.656154+0000","last_unstale":"2024-09-21T00:56:49.644130+0000","last_undegraded":"2024-09-21T00:56:49.644130+0000","last_fullsized":"2024-09-21T00:56:49.644130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:37.244726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657307+0000","last_change":"2024-09-21T00:56:48.645857+0000","last_active":"2024-09-21T00:56:49.657307+0000","last_peered":"2024-09-21T00:56:49.657307+0000","last_clean":"2024-09-21T00:56:49.657307+0000","last_became_active":"2024-09-21T00:56:48.644462+0000","last_became_peered":"2024-09-21T00:56:48.644462+0000","last_unstale":"2024-09-21T00:56:49.657307+0000","last_undegraded":"2024-09-21T00:56:49.657307+0000","last_fullsized":"2024-09-21T00:56:49.657307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:11.690074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659996+0000","last_change":"2024-09-21T00:56:48.649937+0000","last_active":"2024-09-21T00:56:49.659996+0000","last_peered":"2024-09-21T00:56:49.659996+0000","last_clean":"2024-09-21T00:56:49.659996+0000","last_became_active":"2024-09-21T00:56:48.649233+0000","last_became_peered":"2024-09-21T00:56:48.649233+0000","last_unstale":"2024-09-21T00:56:49.659996+0000","last_undegraded":"2024-09-21T00:56:49.659996+0000","last_fullsized":"2024-09-21T00:56:49.659996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:00.529143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657554+0000","last_change":"2024-09-21T00:56:48.645824+0000","last_active":"2024-09-21T00:56:49.657554+0000","last_peered":"2024-09-21T00:56:49.657554+0000","last_clean":"2024-09-21T00:56:49.657554+0000","last_became_active":"2024-09-21T00:56:48.645452+0000","last_became_peered":"2024-09-21T00:56:48.645452+0000","last_unstale":"2024-09-21T00:56:49.657554+0000","last_undegraded":"2024-09-21T00:56:49.657554+0000","last_fullsized":"2024-09-21T00:56:49.657554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:40.228469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659813+0000","last_change":"2024-09-21T00:56:48.653384+0000","last_active":"2024-09-21T00:56:49.659813+0000","last_peered":"2024-09-21T00:56:49.659813+0000","last_clean":"2024-09-21T00:56:49.659813+0000","last_became_active":"2024-09-21T00:56:48.653021+0000","last_became_peered":"2024-09-21T00:56:48.653021+0000","last_unstale":"2024-09-21T00:56:49.659813+0000","last_undegraded":"2024-09-21T00:56:49.659813+0000","last_fullsized":"2024-09-21T00:56:49.659813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:17.041766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643881+0000","last_change":"2024-09-21T00:56:48.656431+0000","last_active":"2024-09-21T00:56:49.643881+0000","last_peered":"2024-09-21T00:56:49.643881+0000","last_clean":"2024-09-21T00:56:49.643881+0000","last_became_active":"2024-09-21T00:56:48.656080+0000","last_became_peered":"2024-09-21T00:56:48.656080+0000","last_unstale":"2024-09-21T00:56:49.643881+0000","last_undegraded":"2024-09-21T00:56:49.643881+0000","last_fullsized":"2024-09-21T00:56:49.643881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:00.068094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656691+0000","last_change":"2024-09-21T00:56:48.653355+0000","last_active":"2024-09-21T00:56:49.656691+0000","last_peered":"2024-09-21T00:56:49.656691+0000","last_clean":"2024-09-21T00:56:49.656691+0000","last_became_active":"2024-09-21T00:56:48.652959+0000","last_became_peered":"2024-09-21T00:56:48.652959+0000","last_unstale":"2024-09-21T00:56:49.656691+0000","last_undegraded":"2024-09-21T00:56:49.656691+0000","last_fullsized":"2024-09-21T00:56:49.656691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:16.462806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656431+0000","last_change":"2024-09-21T00:56:46.634744+0000","last_active":"2024-09-21T00:56:49.656431+0000","last_peered":"2024-09-21T00:56:49.656431+0000","last_clean":"2024-09-21T00:56:49.656431+0000","last_became_active":"2024-09-21T00:56:46.634367+0000","last_became_peered":"2024-09-21T00:56:46.634367+0000","last_unstale":"2024-09-21T00:56:49.656431+0000","last_undegraded":"2024-09-21T00:56:49.656431+0000","last_fullsized":"2024-09-21T00:56:49.656431+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:40.923450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656411+0000","last_change":"2024-09-21T00:56:48.660277+0000","last_active":"2024-09-21T00:56:49.656411+0000","last_peered":"2024-09-21T00:56:49.656411+0000","last_clean":"2024-09-21T00:56:49.656411+0000","last_became_active":"2024-09-21T00:56:48.659491+0000","last_became_peered":"2024-09-21T00:56:48.659491+0000","last_unstale":"2024-09-21T00:56:49.656411+0000","last_undegraded":"2024-09-21T00:56:49.656411+0000","last_fullsized":"2024-09-21T00:56:49.656411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:39.032704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643709+0000","last_change":"2024-09-21T00:56:46.634466+0000","last_active":"2024-09-21T00:56:49.643709+0000","last_peered":"2024-09-21T00:56:49.643709+0000","last_clean":"2024-09-21T00:56:49.643709+0000","last_became_active":"2024-09-21T00:56:46.634031+0000","last_became_peered":"2024-09-21T00:56:46.634031+0000","last_unstale":"2024-09-21T00:56:49.643709+0000","last_undegraded":"2024-09-21T00:56:49.643709+0000","last_fullsized":"2024-09-21T00:56:49.643709+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:49.691014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.655908+0000","last_change":"2024-09-21T00:56:46.628156+0000","last_active":"2024-09-21T00:56:49.655908+0000","last_peered":"2024-09-21T00:56:49.655908+0000","last_clean":"2024-09-21T00:56:49.655908+0000","last_became_active":"2024-09-21T00:56:46.627735+0000","last_became_peered":"2024-09-21T00:56:46.627735+0000","last_unstale":"2024-09-21T00:56:49.655908+0000","last_undegraded":"2024-09-21T00:56:49.655908+0000","last_fullsized":"2024-09-21T00:56:49.655908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:55.188016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656563+0000","last_change":"2024-09-21T00:56:48.649571+0000","last_active":"2024-09-21T00:56:49.656563+0000","last_peered":"2024-09-21T00:56:49.656563+0000","last_clean":"2024-09-21T00:56:49.656563+0000","last_became_active":"2024-09-21T00:56:48.647345+0000","last_became_peered":"2024-09-21T00:56:48.647345+0000","last_unstale":"2024-09-21T00:56:49.656563+0000","last_undegraded":"2024-09-21T00:56:49.656563+0000","last_fullsized":"2024-09-21T00:56:49.656563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:43.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658306+0000","last_change":"2024-09-21T00:56:46.634886+0000","last_active":"2024-09-21T00:56:49.658306+0000","last_peered":"2024-09-21T00:56:49.658306+0000","last_clean":"2024-09-21T00:56:49.658306+0000","last_became_active":"2024-09-21T00:56:46.634481+0000","last_became_peered":"2024-09-21T00:56:46.634481+0000","last_unstale":"2024-09-21T00:56:49.658306+0000","last_undegraded":"2024-09-21T00:56:49.658306+0000","last_fullsized":"2024-09-21T00:56:49.658306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:15.062776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.642398+0000","last_change":"2024-09-21T00:56:48.655740+0000","last_active":"2024-09-21T00:56:49.642398+0000","last_peered":"2024-09-21T00:56:49.642398+0000","last_clean":"2024-09-21T00:56:49.642398+0000","last_became_active":"2024-09-21T00:56:48.655312+0000","last_became_peered":"2024-09-21T00:56:48.655312+0000","last_unstale":"2024-09-21T00:56:49.642398+0000","last_undegraded":"2024-09-21T00:56:49.642398+0000","last_fullsized":"2024-09-21T00:56:49.642398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.815954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643753+0000","last_change":"2024-09-21T00:56:46.636212+0000","last_active":"2024-09-21T00:56:49.643753+0000","last_peered":"2024-09-21T00:56:49.643753+0000","last_clean":"2024-09-21T00:56:49.643753+0000","last_became_active":"2024-09-21T00:56:46.635702+0000","last_became_peered":"2024-09-21T00:56:46.635702+0000","last_unstale":"2024-09-21T00:56:49.643753+0000","last_undegraded":"2024-09-21T00:56:49.643753+0000","last_fullsized":"2024-09-21T00:56:49.643753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:11.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658208+0000","last_change":"2024-09-21T00:56:48.646300+0000","last_active":"2024-09-21T00:56:49.658208+0000","last_peered":"2024-09-21T00:56:49.658208+0000","last_clean":"2024-09-21T00:56:49.658208+0000","last_became_active":"2024-09-21T00:56:48.645906+0000","last_became_peered":"2024-09-21T00:56:48.645906+0000","last_unstale":"2024-09-21T00:56:49.658208+0000","last_undegraded":"2024-09-21T00:56:49.658208+0000","last_fullsized":"2024-09-21T00:56:49.658208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:47.593609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656008+0000","last_change":"2024-09-21T00:56:46.639405+0000","last_active":"2024-09-21T00:56:49.656008+0000","last_peered":"2024-09-21T00:56:49.656008+0000","last_clean":"2024-09-21T00:56:49.656008+0000","last_became_active":"2024-09-21T00:56:46.638659+0000","last_became_peered":"2024-09-21T00:56:46.638659+0000","last_unstale":"2024-09-21T00:56:49.656008+0000","last_undegraded":"2024-09-21T00:56:49.656008+0000","last_fullsized":"2024-09-21T00:56:49.656008+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:19.718585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.660317+0000","last_change":"2024-09-21T00:56:48.657572+0000","last_active":"2024-09-21T00:56:49.660317+0000","last_peered":"2024-09-21T00:56:49.660317+0000","last_clean":"2024-09-21T00:56:49.660317+0000","last_became_active":"2024-09-21T00:56:48.657219+0000","last_became_peered":"2024-09-21T00:56:48.657219+0000","last_unstale":"2024-09-21T00:56:49.660317+0000","last_undegraded":"2024-09-21T00:56:49.660317+0000","last_fullsized":"2024-09-21T00:56:49.660317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:48.870835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.662569+0000","last_change":"2024-09-21T00:56:46.642710+0000","last_active":"2024-09-21T00:56:49.662569+0000","last_peered":"2024-09-21T00:56:49.662569+0000","last_clean":"2024-09-21T00:56:49.662569+0000","last_became_active":"2024-09-21T00:56:46.642273+0000","last_became_peered":"2024-09-21T00:56:46.642273+0000","last_unstale":"2024-09-21T00:56:49.662569+0000","last_undegraded":"2024-09-21T00:56:49.662569+0000","last_fullsized":"2024-09-21T00:56:49.662569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.751651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656806+0000","last_change":"2024-09-21T00:56:48.652566+0000","last_active":"2024-09-21T00:56:49.656806+0000","last_peered":"2024-09-21T00:56:49.656806+0000","last_clean":"2024-09-21T00:56:49.656806+0000","last_became_active":"2024-09-21T00:56:48.652201+0000","last_became_peered":"2024-09-21T00:56:48.652201+0000","last_unstale":"2024-09-21T00:56:49.656806+0000","last_undegraded":"2024-09-21T00:56:49.656806+0000","last_fullsized":"2024-09-21T00:56:49.656806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:54.778152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'19","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:57:06.531334+0000","last_change":"2024-09-21T00:56:46.639555+0000","last_active":"2024-09-21T00:57:06.531334+0000","last_peered":"2024-09-21T00:57:06.531334+0000","last_clean":"2024-09-21T00:57:06.531334+0000","last_became_active":"2024-09-21T00:56:46.639200+0000","last_became_peered":"2024-09-21T00:56:46.639200+0000","last_unstale":"2024-09-21T00:57:06.531334+0000","last_undegraded":"2024-09-21T00:57:06.531334+0000","last_fullsized":"2024-09-21T00:57:06.531334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:49.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45203,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":57,"num_write":19,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659499+0000","last_change":"2024-09-21T00:56:48.653950+0000","last_active":"2024-09-21T00:56:49.659499+0000","last_peered":"2024-09-21T00:56:49.659499+0000","last_clean":"2024-09-21T00:56:49.659499+0000","last_became_active":"2024-09-21T00:56:48.653570+0000","last_became_peered":"2024-09-21T00:56:48.653570+0000","last_unstale":"2024-09-21T00:56:49.659499+0000","last_undegraded":"2024-09-21T00:56:49.659499+0000","last_fullsized":"2024-09-21T00:56:49.659499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:43.708982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.663701+0000","last_change":"2024-09-21T00:56:46.635861+0000","last_active":"2024-09-21T00:56:49.663701+0000","last_peered":"2024-09-21T00:56:49.663701+0000","last_clean":"2024-09-21T00:56:49.663701+0000","last_became_active":"2024-09-21T00:56:46.635452+0000","last_became_peered":"2024-09-21T00:56:46.635452+0000","last_unstale":"2024-09-21T00:56:49.663701+0000","last_undegraded":"2024-09-21T00:56:49.663701+0000","last_fullsized":"2024-09-21T00:56:49.663701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:15.591100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657400+0000","last_change":"2024-09-21T00:56:48.645567+0000","last_active":"2024-09-21T00:56:49.657400+0000","last_peered":"2024-09-21T00:56:49.657400+0000","last_clean":"2024-09-21T00:56:49.657400+0000","last_became_active":"2024-09-21T00:56:48.644499+0000","last_became_peered":"2024-09-21T00:56:48.644499+0000","last_unstale":"2024-09-21T00:56:49.657400+0000","last_undegraded":"2024-09-21T00:56:49.657400+0000","last_fullsized":"2024-09-21T00:56:49.657400+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:08.655065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.655796+0000","last_change":"2024-09-21T00:56:46.633014+0000","last_active":"2024-09-21T00:56:49.655796+0000","last_peered":"2024-09-21T00:56:49.655796+0000","last_clean":"2024-09-21T00:56:49.655796+0000","last_became_active":"2024-09-21T00:56:46.632656+0000","last_became_peered":"2024-09-21T00:56:46.632656+0000","last_unstale":"2024-09-21T00:56:49.655796+0000","last_undegraded":"2024-09-21T00:56:49.655796+0000","last_fullsized":"2024-09-21T00:56:49.655796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:46.270469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656461+0000","last_change":"2024-09-21T00:56:48.659797+0000","last_active":"2024-09-21T00:56:49.656461+0000","last_peered":"2024-09-21T00:56:49.656461+0000","last_clean":"2024-09-21T00:56:49.656461+0000","last_became_active":"2024-09-21T00:56:48.659430+0000","last_became_peered":"2024-09-21T00:56:48.659430+0000","last_unstale":"2024-09-21T00:56:49.656461+0000","last_undegraded":"2024-09-21T00:56:49.656461+0000","last_fullsized":"2024-09-21T00:56:49.656461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:45.006414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658947+0000","last_change":"2024-09-21T00:56:46.636792+0000","last_active":"2024-09-21T00:56:49.658947+0000","last_peered":"2024-09-21T00:56:49.658947+0000","last_clean":"2024-09-21T00:56:49.658947+0000","last_became_active":"2024-09-21T00:56:46.636383+0000","last_became_peered":"2024-09-21T00:56:46.636383+0000","last_unstale":"2024-09-21T00:56:49.658947+0000","last_undegraded":"2024-09-21T00:56:49.658947+0000","last_fullsized":"2024-09-21T00:56:49.658947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:37.078166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656007+0000","last_change":"2024-09-21T00:56:48.657065+0000","last_active":"2024-09-21T00:56:49.656007+0000","last_peered":"2024-09-21T00:56:49.656007+0000","last_clean":"2024-09-21T00:56:49.656007+0000","last_became_active":"2024-09-21T00:56:48.656658+0000","last_became_peered":"2024-09-21T00:56:48.656658+0000","last_unstale":"2024-09-21T00:56:49.656007+0000","last_undegraded":"2024-09-21T00:56:49.656007+0000","last_fullsized":"2024-09-21T00:56:49.656007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:31.713457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.666800+0000","last_change":"2024-09-21T00:56:46.642099+0000","last_active":"2024-09-21T00:56:49.666800+0000","last_peered":"2024-09-21T00:56:49.666800+0000","last_clean":"2024-09-21T00:56:49.666800+0000","last_became_active":"2024-09-21T00:56:46.641526+0000","last_became_peered":"2024-09-21T00:56:46.641526+0000","last_unstale":"2024-09-21T00:56:49.666800+0000","last_undegraded":"2024-09-21T00:56:49.666800+0000","last_fullsized":"2024-09-21T00:56:49.666800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:12.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656575+0000","last_change":"2024-09-21T00:56:48.660991+0000","last_active":"2024-09-21T00:56:49.656575+0000","last_peered":"2024-09-21T00:56:49.656575+0000","last_clean":"2024-09-21T00:56:49.656575+0000","last_became_active":"2024-09-21T00:56:48.660623+0000","last_became_peered":"2024-09-21T00:56:48.660623+0000","last_unstale":"2024-09-21T00:56:49.656575+0000","last_undegraded":"2024-09-21T00:56:49.656575+0000","last_fullsized":"2024-09-21T00:56:49.656575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:34.291977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.664686+0000","last_change":"2024-09-21T00:56:46.637482+0000","last_active":"2024-09-21T00:56:49.664686+0000","last_peered":"2024-09-21T00:56:49.664686+0000","last_clean":"2024-09-21T00:56:49.664686+0000","last_became_active":"2024-09-21T00:56:46.634812+0000","last_became_peered":"2024-09-21T00:56:46.634812+0000","last_unstale":"2024-09-21T00:56:49.664686+0000","last_undegraded":"2024-09-21T00:56:49.664686+0000","last_fullsized":"2024-09-21T00:56:49.664686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:30.990625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644091+0000","last_change":"2024-09-21T00:56:48.658930+0000","last_active":"2024-09-21T00:56:49.644091+0000","last_peered":"2024-09-21T00:56:49.644091+0000","last_clean":"2024-09-21T00:56:49.644091+0000","last_became_active":"2024-09-21T00:56:48.658545+0000","last_became_peered":"2024-09-21T00:56:48.658545+0000","last_unstale":"2024-09-21T00:56:49.644091+0000","last_undegraded":"2024-09-21T00:56:49.644091+0000","last_fullsized":"2024-09-21T00:56:49.644091+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:30:57.850371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.663804+0000","last_change":"2024-09-21T00:56:46.628768+0000","last_active":"2024-09-21T00:56:49.663804+0000","last_peered":"2024-09-21T00:56:49.663804+0000","last_clean":"2024-09-21T00:56:49.663804+0000","last_became_active":"2024-09-21T00:56:46.628374+0000","last_became_peered":"2024-09-21T00:56:46.628374+0000","last_unstale":"2024-09-21T00:56:49.663804+0000","last_undegraded":"2024-09-21T00:56:49.663804+0000","last_fullsized":"2024-09-21T00:56:49.663804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:58:15.133651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657555+0000","last_change":"2024-09-21T00:56:48.648097+0000","last_active":"2024-09-21T00:56:49.657555+0000","last_peered":"2024-09-21T00:56:49.657555+0000","last_clean":"2024-09-21T00:56:49.657555+0000","last_became_active":"2024-09-21T00:56:48.647619+0000","last_became_peered":"2024-09-21T00:56:48.647619+0000","last_unstale":"2024-09-21T00:56:49.657555+0000","last_undegraded":"2024-09-21T00:56:49.657555+0000","last_fullsized":"2024-09-21T00:56:49.657555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:08.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.664338+0000","last_change":"2024-09-21T00:56:46.636947+0000","last_active":"2024-09-21T00:56:49.664338+0000","last_peered":"2024-09-21T00:56:49.664338+0000","last_clean":"2024-09-21T00:56:49.664338+0000","last_became_active":"2024-09-21T00:56:46.636469+0000","last_became_peered":"2024-09-21T00:56:46.636469+0000","last_unstale":"2024-09-21T00:56:49.664338+0000","last_undegraded":"2024-09-21T00:56:49.664338+0000","last_fullsized":"2024-09-21T00:56:49.664338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:31.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:51.964462+0000","last_change":"2024-09-21T00:56:48.655750+0000","last_active":"2024-09-21T00:56:51.964462+0000","last_peered":"2024-09-21T00:56:51.964462+0000","last_clean":"2024-09-21T00:56:51.964462+0000","last_became_active":"2024-09-21T00:56:48.655315+0000","last_became_peered":"2024-09-21T00:56:48.655315+0000","last_unstale":"2024-09-21T00:56:51.964462+0000","last_undegraded":"2024-09-21T00:56:51.964462+0000","last_fullsized":"2024-09-21T00:56:51.964462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:48.121314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.663255+0000","last_change":"2024-09-21T00:56:47.391206+0000","last_active":"2024-09-21T00:56:49.663255+0000","last_peered":"2024-09-21T00:56:49.663255+0000","last_clean":"2024-09-21T00:56:49.663255+0000","last_became_active":"2024-09-21T00:56:47.390708+0000","last_became_peered":"2024-09-21T00:56:47.390708+0000","last_unstale":"2024-09-21T00:56:49.663255+0000","last_undegraded":"2024-09-21T00:56:49.663255+0000","last_fullsized":"2024-09-21T00:56:49.663255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:59.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656454+0000","last_change":"2024-09-21T00:56:48.648452+0000","last_active":"2024-09-21T00:56:49.656454+0000","last_peered":"2024-09-21T00:56:49.656454+0000","last_clean":"2024-09-21T00:56:49.656454+0000","last_became_active":"2024-09-21T00:56:48.647682+0000","last_became_peered":"2024-09-21T00:56:48.647682+0000","last_unstale":"2024-09-21T00:56:49.656454+0000","last_undegraded":"2024-09-21T00:56:49.656454+0000","last_fullsized":"2024-09-21T00:56:49.656454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:45.844596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656103+0000","last_change":"2024-09-21T00:55:37.551147+0000","last_active":"2024-09-21T00:56:49.656103+0000","last_peered":"2024-09-21T00:56:49.656103+0000","last_clean":"2024-09-21T00:56:49.656103+0000","last_became_active":"2024-09-21T00:55:37.545124+0000","last_became_peered":"2024-09-21T00:55:37.545124+0000","last_unstale":"2024-09-21T00:56:49.656103+0000","last_undegraded":"2024-09-21T00:56:49.656103+0000","last_fullsized":"2024-09-21T00:56:49.656103+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_clean_scrub_stamp":"2024-09-21T00:52:17.996374+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:20.205607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659138+0000","last_change":"2024-09-21T00:56:46.637264+0000","last_active":"2024-09-21T00:56:49.659138+0000","last_peered":"2024-09-21T00:56:49.659138+0000","last_clean":"2024-09-21T00:56:49.659138+0000","last_became_active":"2024-09-21T00:56:46.636320+0000","last_became_peered":"2024-09-21T00:56:46.636320+0000","last_unstale":"2024-09-21T00:56:49.659138+0000","last_undegraded":"2024-09-21T00:56:49.659138+0000","last_fullsized":"2024-09-21T00:56:49.659138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:42.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656673+0000","last_change":"2024-09-21T00:56:48.651051+0000","last_active":"2024-09-21T00:56:49.656673+0000","last_peered":"2024-09-21T00:56:49.656673+0000","last_clean":"2024-09-21T00:56:49.656673+0000","last_became_active":"2024-09-21T00:56:48.650693+0000","last_became_peered":"2024-09-21T00:56:48.650693+0000","last_unstale":"2024-09-21T00:56:49.656673+0000","last_undegraded":"2024-09-21T00:56:49.656673+0000","last_fullsized":"2024-09-21T00:56:49.656673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:49.575213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656095+0000","last_change":"2024-09-21T00:56:46.634826+0000","last_active":"2024-09-21T00:56:49.656095+0000","last_peered":"2024-09-21T00:56:49.656095+0000","last_clean":"2024-09-21T00:56:49.656095+0000","last_became_active":"2024-09-21T00:56:46.634370+0000","last_became_peered":"2024-09-21T00:56:46.634370+0000","last_unstale":"2024-09-21T00:56:49.656095+0000","last_undegraded":"2024-09-21T00:56:49.656095+0000","last_fullsized":"2024-09-21T00:56:49.656095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:29.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.655734+0000","last_change":"2024-09-21T00:56:48.646296+0000","last_active":"2024-09-21T00:56:49.655734+0000","last_peered":"2024-09-21T00:56:49.655734+0000","last_clean":"2024-09-21T00:56:49.655734+0000","last_became_active":"2024-09-21T00:56:48.644271+0000","last_became_peered":"2024-09-21T00:56:48.644271+0000","last_unstale":"2024-09-21T00:56:49.655734+0000","last_undegraded":"2024-09-21T00:56:49.655734+0000","last_fullsized":"2024-09-21T00:56:49.655734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:27.609714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657305+0000","last_change":"2024-09-21T00:56:46.641852+0000","last_active":"2024-09-21T00:56:49.657305+0000","last_peered":"2024-09-21T00:56:49.657305+0000","last_clean":"2024-09-21T00:56:49.657305+0000","last_became_active":"2024-09-21T00:56:46.641449+0000","last_became_peered":"2024-09-21T00:56:46.641449+0000","last_unstale":"2024-09-21T00:56:49.657305+0000","last_undegraded":"2024-09-21T00:56:49.657305+0000","last_fullsized":"2024-09-21T00:56:49.657305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:51.086321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658023+0000","last_change":"2024-09-21T00:56:48.660295+0000","last_active":"2024-09-21T00:56:49.658023+0000","last_peered":"2024-09-21T00:56:49.658023+0000","last_clean":"2024-09-21T00:56:49.658023+0000","last_became_active":"2024-09-21T00:56:48.659638+0000","last_became_peered":"2024-09-21T00:56:48.659638+0000","last_unstale":"2024-09-21T00:56:49.658023+0000","last_undegraded":"2024-09-21T00:56:49.658023+0000","last_fullsized":"2024-09-21T00:56:49.658023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:34.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656087+0000","last_change":"2024-09-21T00:56:46.639317+0000","last_active":"2024-09-21T00:56:49.656087+0000","last_peered":"2024-09-21T00:56:49.656087+0000","last_clean":"2024-09-21T00:56:49.656087+0000","last_became_active":"2024-09-21T00:56:46.638732+0000","last_became_peered":"2024-09-21T00:56:46.638732+0000","last_unstale":"2024-09-21T00:56:49.656087+0000","last_undegraded":"2024-09-21T00:56:49.656087+0000","last_fullsized":"2024-09-21T00:56:49.656087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643583+0000","last_change":"2024-09-21T00:56:48.651038+0000","last_active":"2024-09-21T00:56:49.643583+0000","last_peered":"2024-09-21T00:56:49.643583+0000","last_clean":"2024-09-21T00:56:49.643583+0000","last_became_active":"2024-09-21T00:56:48.650682+0000","last_became_peered":"2024-09-21T00:56:48.650682+0000","last_unstale":"2024-09-21T00:56:49.643583+0000","last_undegraded":"2024-09-21T00:56:49.643583+0000","last_fullsized":"2024-09-21T00:56:49.643583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.015768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.642539+0000","last_change":"2024-09-21T00:56:46.641993+0000","last_active":"2024-09-21T00:56:49.642539+0000","last_peered":"2024-09-21T00:56:49.642539+0000","last_clean":"2024-09-21T00:56:49.642539+0000","last_became_active":"2024-09-21T00:56:46.641631+0000","last_became_peered":"2024-09-21T00:56:46.641631+0000","last_unstale":"2024-09-21T00:56:49.642539+0000","last_undegraded":"2024-09-21T00:56:49.642539+0000","last_fullsized":"2024-09-21T00:56:49.642539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:12.986551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:51.966239+0000","last_change":"2024-09-21T00:56:48.649620+0000","last_active":"2024-09-21T00:56:51.966239+0000","last_peered":"2024-09-21T00:56:51.966239+0000","last_clean":"2024-09-21T00:56:51.966239+0000","last_became_active":"2024-09-21T00:56:48.645757+0000","last_became_peered":"2024-09-21T00:56:48.645757+0000","last_unstale":"2024-09-21T00:56:51.966239+0000","last_undegraded":"2024-09-21T00:56:51.966239+0000","last_fullsized":"2024-09-21T00:56:51.966239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:12.802042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659665+0000","last_change":"2024-09-21T00:56:46.641723+0000","last_active":"2024-09-21T00:56:49.659665+0000","last_peered":"2024-09-21T00:56:49.659665+0000","last_clean":"2024-09-21T00:56:49.659665+0000","last_became_active":"2024-09-21T00:56:46.641219+0000","last_became_peered":"2024-09-21T00:56:46.641219+0000","last_unstale":"2024-09-21T00:56:49.659665+0000","last_undegraded":"2024-09-21T00:56:49.659665+0000","last_fullsized":"2024-09-21T00:56:49.659665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:47.676869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657392+0000","last_change":"2024-09-21T00:56:48.641940+0000","last_active":"2024-09-21T00:56:49.657392+0000","last_peered":"2024-09-21T00:56:49.657392+0000","last_clean":"2024-09-21T00:56:49.657392+0000","last_became_active":"2024-09-21T00:56:48.641521+0000","last_became_peered":"2024-09-21T00:56:48.641521+0000","last_unstale":"2024-09-21T00:56:49.657392+0000","last_undegraded":"2024-09-21T00:56:49.657392+0000","last_fullsized":"2024-09-21T00:56:49.657392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:38.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'5","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:57:04.654664+0000","last_change":"2024-09-21T00:56:46.631037+0000","last_active":"2024-09-21T00:57:04.654664+0000","last_peered":"2024-09-21T00:57:04.654664+0000","last_clean":"2024-09-21T00:57:04.654664+0000","last_became_active":"2024-09-21T00:56:46.630612+0000","last_became_peered":"2024-09-21T00:56:46.630612+0000","last_unstale":"2024-09-21T00:57:04.654664+0000","last_undegraded":"2024-09-21T00:57:04.654664+0000","last_fullsized":"2024-09-21T00:57:04.654664+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.390614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657132+0000","last_change":"2024-09-21T00:56:48.649774+0000","last_active":"2024-09-21T00:56:49.657132+0000","last_peered":"2024-09-21T00:56:49.657132+0000","last_clean":"2024-09-21T00:56:49.657132+0000","last_became_active":"2024-09-21T00:56:48.649380+0000","last_became_peered":"2024-09-21T00:56:48.649380+0000","last_unstale":"2024-09-21T00:56:49.657132+0000","last_undegraded":"2024-09-21T00:56:49.657132+0000","last_fullsized":"2024-09-21T00:56:49.657132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:12.595820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.662588+0000","last_change":"2024-09-21T00:56:47.391328+0000","last_active":"2024-09-21T00:56:49.662588+0000","last_peered":"2024-09-21T00:56:49.662588+0000","last_clean":"2024-09-21T00:56:49.662588+0000","last_became_active":"2024-09-21T00:56:47.390860+0000","last_became_peered":"2024-09-21T00:56:47.390860+0000","last_unstale":"2024-09-21T00:56:49.662588+0000","last_undegraded":"2024-09-21T00:56:49.662588+0000","last_fullsized":"2024-09-21T00:56:49.662588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:24.267908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.660009+0000","last_change":"2024-09-21T00:56:48.657644+0000","last_active":"2024-09-21T00:56:49.660009+0000","last_peered":"2024-09-21T00:56:49.660009+0000","last_clean":"2024-09-21T00:56:49.660009+0000","last_became_active":"2024-09-21T00:56:48.657263+0000","last_became_peered":"2024-09-21T00:56:48.657263+0000","last_unstale":"2024-09-21T00:56:49.660009+0000","last_undegraded":"2024-09-21T00:56:49.660009+0000","last_fullsized":"2024-09-21T00:56:49.660009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:20.635667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657202+0000","last_change":"2024-09-21T00:56:46.641749+0000","last_active":"2024-09-21T00:56:49.657202+0000","last_peered":"2024-09-21T00:56:49.657202+0000","last_clean":"2024-09-21T00:56:49.657202+0000","last_became_active":"2024-09-21T00:56:46.641373+0000","last_became_peered":"2024-09-21T00:56:46.641373+0000","last_unstale":"2024-09-21T00:56:49.657202+0000","last_undegraded":"2024-09-21T00:56:49.657202+0000","last_fullsized":"2024-09-21T00:56:49.657202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:56.376410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657524+0000","last_change":"2024-09-21T00:56:48.656028+0000","last_active":"2024-09-21T00:56:49.657524+0000","last_peered":"2024-09-21T00:56:49.657524+0000","last_clean":"2024-09-21T00:56:49.657524+0000","last_became_active":"2024-09-21T00:56:48.655380+0000","last_became_peered":"2024-09-21T00:56:48.655380+0000","last_unstale":"2024-09-21T00:56:49.657524+0000","last_undegraded":"2024-09-21T00:56:49.657524+0000","last_fullsized":"2024-09-21T00:56:49.657524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:37.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656783+0000","last_change":"2024-09-21T00:56:46.635884+0000","last_active":"2024-09-21T00:56:49.656783+0000","last_peered":"2024-09-21T00:56:49.656783+0000","last_clean":"2024-09-21T00:56:49.656783+0000","last_became_active":"2024-09-21T00:56:46.635545+0000","last_became_peered":"2024-09-21T00:56:46.635545+0000","last_unstale":"2024-09-21T00:56:49.656783+0000","last_undegraded":"2024-09-21T00:56:49.656783+0000","last_fullsized":"2024-09-21T00:56:49.656783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:03.170611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644178+0000","last_change":"2024-09-21T00:56:48.649548+0000","last_active":"2024-09-21T00:56:49.644178+0000","last_peered":"2024-09-21T00:56:49.644178+0000","last_clean":"2024-09-21T00:56:49.644178+0000","last_became_active":"2024-09-21T00:56:48.649157+0000","last_became_peered":"2024-09-21T00:56:48.649157+0000","last_unstale":"2024-09-21T00:56:49.644178+0000","last_undegraded":"2024-09-21T00:56:49.644178+0000","last_fullsized":"2024-09-21T00:56:49.644178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:46.794274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656475+0000","last_change":"2024-09-21T00:56:46.632139+0000","last_active":"2024-09-21T00:56:49.656475+0000","last_peered":"2024-09-21T00:56:49.656475+0000","last_clean":"2024-09-21T00:56:49.656475+0000","last_became_active":"2024-09-21T00:56:46.631680+0000","last_became_peered":"2024-09-21T00:56:46.631680+0000","last_unstale":"2024-09-21T00:56:49.656475+0000","last_undegraded":"2024-09-21T00:56:49.656475+0000","last_fullsized":"2024-09-21T00:56:49.656475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:21:17.909161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656225+0000","last_change":"2024-09-21T00:56:48.654956+0000","last_active":"2024-09-21T00:56:49.656225+0000","last_peered":"2024-09-21T00:56:49.656225+0000","last_clean":"2024-09-21T00:56:49.656225+0000","last_became_active":"2024-09-21T00:56:48.654354+0000","last_became_peered":"2024-09-21T00:56:48.654354+0000","last_unstale":"2024-09-21T00:56:49.656225+0000","last_undegraded":"2024-09-21T00:56:49.656225+0000","last_fullsized":"2024-09-21T00:56:49.656225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:56.540664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.664409+0000","last_change":"2024-09-21T00:56:46.635804+0000","last_active":"2024-09-21T00:56:49.664409+0000","last_peered":"2024-09-21T00:56:49.664409+0000","last_clean":"2024-09-21T00:56:49.664409+0000","last_became_active":"2024-09-21T00:56:46.635404+0000","last_became_peered":"2024-09-21T00:56:46.635404+0000","last_unstale":"2024-09-21T00:56:49.664409+0000","last_undegraded":"2024-09-21T00:56:49.664409+0000","last_fullsized":"2024-09-21T00:56:49.664409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:39.360870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656259+0000","last_change":"2024-09-21T00:56:48.647881+0000","last_active":"2024-09-21T00:56:49.656259+0000","last_peered":"2024-09-21T00:56:49.656259+0000","last_clean":"2024-09-21T00:56:49.656259+0000","last_became_active":"2024-09-21T00:56:48.647391+0000","last_became_peered":"2024-09-21T00:56:48.647391+0000","last_unstale":"2024-09-21T00:56:49.656259+0000","last_undegraded":"2024-09-21T00:56:49.656259+0000","last_fullsized":"2024-09-21T00:56:49.656259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:57.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657648+0000","last_change":"2024-09-21T00:56:48.662093+0000","last_active":"2024-09-21T00:56:49.657648+0000","last_peered":"2024-09-21T00:56:49.657648+0000","last_clean":"2024-09-21T00:56:49.657648+0000","last_became_active":"2024-09-21T00:56:48.661652+0000","last_became_peered":"2024-09-21T00:56:48.661652+0000","last_unstale":"2024-09-21T00:56:49.657648+0000","last_undegraded":"2024-09-21T00:56:49.657648+0000","last_fullsized":"2024-09-21T00:56:49.657648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:42:29.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.664263+0000","last_change":"2024-09-21T00:56:46.633958+0000","last_active":"2024-09-21T00:56:49.664263+0000","last_peered":"2024-09-21T00:56:49.664263+0000","last_clean":"2024-09-21T00:56:49.664263+0000","last_became_active":"2024-09-21T00:56:46.633473+0000","last_became_peered":"2024-09-21T00:56:46.633473+0000","last_unstale":"2024-09-21T00:56:49.664263+0000","last_undegraded":"2024-09-21T00:56:49.664263+0000","last_fullsized":"2024-09-21T00:56:49.664263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:03:41.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656870+0000","last_change":"2024-09-21T00:56:48.647961+0000","last_active":"2024-09-21T00:56:49.656870+0000","last_peered":"2024-09-21T00:56:49.656870+0000","last_clean":"2024-09-21T00:56:49.656870+0000","last_became_active":"2024-09-21T00:56:48.647301+0000","last_became_peered":"2024-09-21T00:56:48.647301+0000","last_unstale":"2024-09-21T00:56:49.656870+0000","last_undegraded":"2024-09-21T00:56:49.656870+0000","last_fullsized":"2024-09-21T00:56:49.656870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:21.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.665437+0000","last_change":"2024-09-21T00:56:46.637114+0000","last_active":"2024-09-21T00:56:49.665437+0000","last_peered":"2024-09-21T00:56:49.665437+0000","last_clean":"2024-09-21T00:56:49.665437+0000","last_became_active":"2024-09-21T00:56:46.636244+0000","last_became_peered":"2024-09-21T00:56:46.636244+0000","last_unstale":"2024-09-21T00:56:49.665437+0000","last_undegraded":"2024-09-21T00:56:49.665437+0000","last_fullsized":"2024-09-21T00:56:49.665437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:36.374016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659973+0000","last_change":"2024-09-21T00:56:48.647249+0000","last_active":"2024-09-21T00:56:49.659973+0000","last_peered":"2024-09-21T00:56:49.659973+0000","last_clean":"2024-09-21T00:56:49.659973+0000","last_became_active":"2024-09-21T00:56:48.646888+0000","last_became_peered":"2024-09-21T00:56:48.646888+0000","last_unstale":"2024-09-21T00:56:49.659973+0000","last_undegraded":"2024-09-21T00:56:49.659973+0000","last_fullsized":"2024-09-21T00:56:49.659973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:02.997909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657349+0000","last_change":"2024-09-21T00:56:46.642781+0000","last_active":"2024-09-21T00:56:49.657349+0000","last_peered":"2024-09-21T00:56:49.657349+0000","last_clean":"2024-09-21T00:56:49.657349+0000","last_became_active":"2024-09-21T00:56:46.642346+0000","last_became_peered":"2024-09-21T00:56:46.642346+0000","last_unstale":"2024-09-21T00:56:49.657349+0000","last_undegraded":"2024-09-21T00:56:49.657349+0000","last_fullsized":"2024-09-21T00:56:49.657349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.050014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656285+0000","last_change":"2024-09-21T00:56:48.651942+0000","last_active":"2024-09-21T00:56:49.656285+0000","last_peered":"2024-09-21T00:56:49.656285+0000","last_clean":"2024-09-21T00:56:49.656285+0000","last_became_active":"2024-09-21T00:56:48.650577+0000","last_became_peered":"2024-09-21T00:56:48.650577+0000","last_unstale":"2024-09-21T00:56:49.656285+0000","last_undegraded":"2024-09-21T00:56:49.656285+0000","last_fullsized":"2024-09-21T00:56:49.656285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:44.176473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.662877+0000","last_change":"2024-09-21T00:56:46.634428+0000","last_active":"2024-09-21T00:56:49.662877+0000","last_peered":"2024-09-21T00:56:49.662877+0000","last_clean":"2024-09-21T00:56:49.662877+0000","last_became_active":"2024-09-21T00:56:46.634037+0000","last_became_peered":"2024-09-21T00:56:46.634037+0000","last_unstale":"2024-09-21T00:56:49.662877+0000","last_undegraded":"2024-09-21T00:56:49.662877+0000","last_fullsized":"2024-09-21T00:56:49.662877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:25.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":46001,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":34,"num_read_kb":63,"num_write":66,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":154362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743439,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":798720,"data_stored":385163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939668,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28452,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716700,"statfs":{"total":95995035648,"available":95965900800,"internally_reserved":0,"allocated":1462272,"data_stored":1021045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103194,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":385745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266719,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36132,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709020,"statfs":{"total":95995035648,"available":95958036480,"internally_reserved":0,"allocated":806912,"data_stored":385767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495651,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716760,"statfs":{"total":95995035648,"available":95965962240,"internally_reserved":0,"allocated":1400832,"data_stored":976230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626473,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40288,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704864,"statfs":{"total":95995035648,"available":95953780736,"internally_reserved":0,"allocated":802816,"data_stored":385280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":975830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":802816,"data_stored":385185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":385501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":430400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":430366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":802816,"data_stored":385253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":45237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":45397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:57:12.769 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:57:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:12 smithi134 ceph-mon[34785]: pgmap v298: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-09-21T00:57:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:12 smithi134 ceph-mon[34785]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:13.153 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:12 smithi047 ceph-mon[30960]: pgmap v298: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-09-21T00:57:13.153 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:12 smithi047 ceph-mon[30960]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:12 smithi114 ceph-mon[34309]: pgmap v298: 97 pgs: 97 active+clean; 622 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-09-21T00:57:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:12 smithi114 ceph-mon[34309]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:13.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 -- 172.21.15.47:0/1045216864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9801094a0 msgr2=0x7fb9801098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 --2- 172.21.15.47:0/1045216864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9801094a0 0x7fb9801098b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb970009900 tx=0x7fb97002a410 comp rx=0 tx=0).stop 2024-09-21T00:57:13.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 -- 172.21.15.47:0/1045216864 shutdown_connections 2024-09-21T00:57:13.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 --2- 172.21.15.47:0/1045216864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb980109df0 0x7fb980110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 --2- 172.21.15.47:0/1045216864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9801094a0 0x7fb9801098b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 --2- 172.21.15.47:0/1045216864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb980103b60 0x7fb980103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 -- 172.21.15.47:0/1045216864 >> 172.21.15.47:0/1045216864 conn(0x7fb98007b850 msgr2=0x7fb98007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:13.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 -- 172.21.15.47:0/1045216864 shutdown_connections 2024-09-21T00:57:13.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.503+0000 7fb986e2f640 1 -- 172.21.15.47:0/1045216864 wait complete. 2024-09-21T00:57:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb986e2f640 1 Processor -- start 2024-09-21T00:57:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb986e2f640 1 -- start start 2024-09-21T00:57:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb986e2f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb980103b60 0x7fb98019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb986e2f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9801094a0 0x7fb98019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb986e2f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb980109df0 0x7fb98019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb986e2f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb980113af0 con 0x7fb980103b60 2024-09-21T00:57:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb986e2f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb980113970 con 0x7fb980109df0 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb986e2f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb980113c70 con 0x7fb9801094a0 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.504+0000 7fb984bcb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb980103b60 0x7fb98019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb984bcb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb980103b60 0x7fb98019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46356/0 (socket says 172.21.15.47:46356) 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb984bcb640 1 -- 172.21.15.47:0/3812194900 learned_addr learned my addr 172.21.15.47:0/3812194900 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb97ffff640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9801094a0 0x7fb98019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb9853cc640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb980109df0 0x7fb98019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb984bcb640 1 -- 172.21.15.47:0/3812194900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9801094a0 msgr2=0x7fb98019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb984bcb640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9801094a0 0x7fb98019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb984bcb640 1 -- 172.21.15.47:0/3812194900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb980109df0 msgr2=0x7fb98019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb984bcb640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb980109df0 0x7fb98019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb984bcb640 1 -- 172.21.15.47:0/3812194900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9801a0450 con 0x7fb980103b60 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb97ffff640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9801094a0 0x7fb98019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb984bcb640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb980103b60 0x7fb98019a4e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb96800d770 tx=0x7fb96800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb97dffb640 1 -- 172.21.15.47:0/3812194900 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968017070 con 0x7fb980103b60 2024-09-21T00:57:13.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb97dffb640 1 -- 172.21.15.47:0/3812194900 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9680054d0 con 0x7fb980103b60 2024-09-21T00:57:13.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.505+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9801a0740 con 0x7fb980103b60 2024-09-21T00:57:13.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.506+0000 7fb97dffb640 1 -- 172.21.15.47:0/3812194900 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968004c30 con 0x7fb980103b60 2024-09-21T00:57:13.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.506+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9801a6ea0 con 0x7fb980103b60 2024-09-21T00:57:13.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.507+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb980103f70 con 0x7fb980103b60 2024-09-21T00:57:13.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.508+0000 7fb97dffb640 1 -- 172.21.15.47:0/3812194900 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fb968004eb0 con 0x7fb980103b60 2024-09-21T00:57:13.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.509+0000 7fb97dffb640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb96c0b6620 0x7fb96c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:13.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.509+0000 7fb97ffff640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb96c0b6620 0x7fb96c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:13.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.509+0000 7fb97dffb640 1 -- 172.21.15.47:0/3812194900 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fb9680e6f20 con 0x7fb980103b60 2024-09-21T00:57:13.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.510+0000 7fb97ffff640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb96c0b6620 0x7fb96c0b8b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb970009230 tx=0x7fb970000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:13.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.513+0000 7fb97dffb640 1 -- 172.21.15.47:0/3812194900 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9680ad700 con 0x7fb980103b60 2024-09-21T00:57:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.698+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb980063800 con 0x7fb96c0b6620 2024-09-21T00:57:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.702+0000 7fb97dffb640 1 -- 172.21.15.47:0/3812194900 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258622 (secure 0 0 0) 0x7fb980063800 con 0x7fb96c0b6620 2024-09-21T00:57:13.705 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:13.706 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-21T00:57:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb96c0b6620 msgr2=0x7fb96c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb96c0b6620 0x7fb96c0b8b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb970009230 tx=0x7fb970000bc0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb980103b60 msgr2=0x7fb98019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb980103b60 0x7fb98019a4e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb96800d770 tx=0x7fb96800dc30 comp rx=0 tx=0).stop 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 shutdown_connections 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb96c0b6620 0x7fb96c0b8b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb980109df0 0x7fb98019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9801094a0 0x7fb98019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 --2- 172.21.15.47:0/3812194900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb980103b60 0x7fb98019a4e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 >> 172.21.15.47:0/3812194900 conn(0x7fb98007b850 msgr2=0x7fb9801054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 shutdown_connections 2024-09-21T00:57:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:13.706+0000 7fb986e2f640 1 -- 172.21.15.47:0/3812194900 wait complete. 2024-09-21T00:57:14.478 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-21T00:57:13.259585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652962,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":121,"num_read_kb":148,"num_write":204,"num_write_kb":2238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381444,"kb_used_data":11372,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560380,"statfs":{"total":1151940427776,"available":1151549829120,"internally_reserved":0,"allocated":11644928,"data_stored":6564483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":60184,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":75,"num_write":36,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003299"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644246+0000","last_change":"2024-09-21T00:56:48.655444+0000","last_active":"2024-09-21T00:56:49.644246+0000","last_peered":"2024-09-21T00:56:49.644246+0000","last_clean":"2024-09-21T00:56:49.644246+0000","last_became_active":"2024-09-21T00:56:48.655083+0000","last_became_peered":"2024-09-21T00:56:48.655083+0000","last_unstale":"2024-09-21T00:56:49.644246+0000","last_undegraded":"2024-09-21T00:56:49.644246+0000","last_fullsized":"2024-09-21T00:56:49.644246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:07.300682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659744+0000","last_change":"2024-09-21T00:56:48.655066+0000","last_active":"2024-09-21T00:56:49.659744+0000","last_peered":"2024-09-21T00:56:49.659744+0000","last_clean":"2024-09-21T00:56:49.659744+0000","last_became_active":"2024-09-21T00:56:48.654679+0000","last_became_peered":"2024-09-21T00:56:48.654679+0000","last_unstale":"2024-09-21T00:56:49.659744+0000","last_undegraded":"2024-09-21T00:56:49.659744+0000","last_fullsized":"2024-09-21T00:56:49.659744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659646+0000","last_change":"2024-09-21T00:56:48.648770+0000","last_active":"2024-09-21T00:56:49.659646+0000","last_peered":"2024-09-21T00:56:49.659646+0000","last_clean":"2024-09-21T00:56:49.659646+0000","last_became_active":"2024-09-21T00:56:48.648383+0000","last_became_peered":"2024-09-21T00:56:48.648383+0000","last_unstale":"2024-09-21T00:56:49.659646+0000","last_undegraded":"2024-09-21T00:56:49.659646+0000","last_fullsized":"2024-09-21T00:56:49.659646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.616648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659345+0000","last_change":"2024-09-21T00:56:48.660074+0000","last_active":"2024-09-21T00:56:49.659345+0000","last_peered":"2024-09-21T00:56:49.659345+0000","last_clean":"2024-09-21T00:56:49.659345+0000","last_became_active":"2024-09-21T00:56:48.658784+0000","last_became_peered":"2024-09-21T00:56:48.658784+0000","last_unstale":"2024-09-21T00:56:49.659345+0000","last_undegraded":"2024-09-21T00:56:49.659345+0000","last_fullsized":"2024-09-21T00:56:49.659345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:50.368857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656231+0000","last_change":"2024-09-21T00:56:48.654307+0000","last_active":"2024-09-21T00:56:49.656231+0000","last_peered":"2024-09-21T00:56:49.656231+0000","last_clean":"2024-09-21T00:56:49.656231+0000","last_became_active":"2024-09-21T00:56:48.653898+0000","last_became_peered":"2024-09-21T00:56:48.653898+0000","last_unstale":"2024-09-21T00:56:49.656231+0000","last_undegraded":"2024-09-21T00:56:49.656231+0000","last_fullsized":"2024-09-21T00:56:49.656231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643638+0000","last_change":"2024-09-21T00:56:48.649950+0000","last_active":"2024-09-21T00:56:49.643638+0000","last_peered":"2024-09-21T00:56:49.643638+0000","last_clean":"2024-09-21T00:56:49.643638+0000","last_became_active":"2024-09-21T00:56:48.649305+0000","last_became_peered":"2024-09-21T00:56:48.649305+0000","last_unstale":"2024-09-21T00:56:49.643638+0000","last_undegraded":"2024-09-21T00:56:49.643638+0000","last_fullsized":"2024-09-21T00:56:49.643638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:56.456377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656357+0000","last_change":"2024-09-21T00:56:48.656109+0000","last_active":"2024-09-21T00:56:49.656357+0000","last_peered":"2024-09-21T00:56:49.656357+0000","last_clean":"2024-09-21T00:56:49.656357+0000","last_became_active":"2024-09-21T00:56:48.654465+0000","last_became_peered":"2024-09-21T00:56:48.654465+0000","last_unstale":"2024-09-21T00:56:49.656357+0000","last_undegraded":"2024-09-21T00:56:49.656357+0000","last_fullsized":"2024-09-21T00:56:49.656357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:05.779845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656342+0000","last_change":"2024-09-21T00:56:48.656351+0000","last_active":"2024-09-21T00:56:49.656342+0000","last_peered":"2024-09-21T00:56:49.656342+0000","last_clean":"2024-09-21T00:56:49.656342+0000","last_became_active":"2024-09-21T00:56:48.654388+0000","last_became_peered":"2024-09-21T00:56:48.654388+0000","last_unstale":"2024-09-21T00:56:49.656342+0000","last_undegraded":"2024-09-21T00:56:49.656342+0000","last_fullsized":"2024-09-21T00:56:49.656342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:39.441882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658496+0000","last_change":"2024-09-21T00:56:48.661083+0000","last_active":"2024-09-21T00:56:49.658496+0000","last_peered":"2024-09-21T00:56:49.658496+0000","last_clean":"2024-09-21T00:56:49.658496+0000","last_became_active":"2024-09-21T00:56:48.660418+0000","last_became_peered":"2024-09-21T00:56:48.660418+0000","last_unstale":"2024-09-21T00:56:49.658496+0000","last_undegraded":"2024-09-21T00:56:49.658496+0000","last_fullsized":"2024-09-21T00:56:49.658496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:02.494368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644114+0000","last_change":"2024-09-21T00:56:48.660257+0000","last_active":"2024-09-21T00:56:49.644114+0000","last_peered":"2024-09-21T00:56:49.644114+0000","last_clean":"2024-09-21T00:56:49.644114+0000","last_became_active":"2024-09-21T00:56:48.659894+0000","last_became_peered":"2024-09-21T00:56:48.659894+0000","last_unstale":"2024-09-21T00:56:49.644114+0000","last_undegraded":"2024-09-21T00:56:49.644114+0000","last_fullsized":"2024-09-21T00:56:49.644114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.012107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656069+0000","last_change":"2024-09-21T00:56:48.653146+0000","last_active":"2024-09-21T00:56:49.656069+0000","last_peered":"2024-09-21T00:56:49.656069+0000","last_clean":"2024-09-21T00:56:49.656069+0000","last_became_active":"2024-09-21T00:56:48.652599+0000","last_became_peered":"2024-09-21T00:56:48.652599+0000","last_unstale":"2024-09-21T00:56:49.656069+0000","last_undegraded":"2024-09-21T00:56:49.656069+0000","last_fullsized":"2024-09-21T00:56:49.656069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:16.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659583+0000","last_change":"2024-09-21T00:56:48.659521+0000","last_active":"2024-09-21T00:56:49.659583+0000","last_peered":"2024-09-21T00:56:49.659583+0000","last_clean":"2024-09-21T00:56:49.659583+0000","last_became_active":"2024-09-21T00:56:48.658168+0000","last_became_peered":"2024-09-21T00:56:48.658168+0000","last_unstale":"2024-09-21T00:56:49.659583+0000","last_undegraded":"2024-09-21T00:56:49.659583+0000","last_fullsized":"2024-09-21T00:56:49.659583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:51.910450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657680+0000","last_change":"2024-09-21T00:56:48.652163+0000","last_active":"2024-09-21T00:56:49.657680+0000","last_peered":"2024-09-21T00:56:49.657680+0000","last_clean":"2024-09-21T00:56:49.657680+0000","last_became_active":"2024-09-21T00:56:48.651839+0000","last_became_peered":"2024-09-21T00:56:48.651839+0000","last_unstale":"2024-09-21T00:56:49.657680+0000","last_undegraded":"2024-09-21T00:56:49.657680+0000","last_fullsized":"2024-09-21T00:56:49.657680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:50.682747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659831+0000","last_change":"2024-09-21T00:56:48.655106+0000","last_active":"2024-09-21T00:56:49.659831+0000","last_peered":"2024-09-21T00:56:49.659831+0000","last_clean":"2024-09-21T00:56:49.659831+0000","last_became_active":"2024-09-21T00:56:48.654722+0000","last_became_peered":"2024-09-21T00:56:48.654722+0000","last_unstale":"2024-09-21T00:56:49.659831+0000","last_undegraded":"2024-09-21T00:56:49.659831+0000","last_fullsized":"2024-09-21T00:56:49.659831+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:36.023960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659887+0000","last_change":"2024-09-21T00:56:48.648935+0000","last_active":"2024-09-21T00:56:49.659887+0000","last_peered":"2024-09-21T00:56:49.659887+0000","last_clean":"2024-09-21T00:56:49.659887+0000","last_became_active":"2024-09-21T00:56:48.648557+0000","last_became_peered":"2024-09-21T00:56:48.648557+0000","last_unstale":"2024-09-21T00:56:49.659887+0000","last_undegraded":"2024-09-21T00:56:49.659887+0000","last_fullsized":"2024-09-21T00:56:49.659887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:17.791401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656794+0000","last_change":"2024-09-21T00:56:48.651338+0000","last_active":"2024-09-21T00:56:49.656794+0000","last_peered":"2024-09-21T00:56:49.656794+0000","last_clean":"2024-09-21T00:56:49.656794+0000","last_became_active":"2024-09-21T00:56:48.650940+0000","last_became_peered":"2024-09-21T00:56:48.650940+0000","last_unstale":"2024-09-21T00:56:49.656794+0000","last_undegraded":"2024-09-21T00:56:49.656794+0000","last_fullsized":"2024-09-21T00:56:49.656794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644319+0000","last_change":"2024-09-21T00:56:48.655091+0000","last_active":"2024-09-21T00:56:49.644319+0000","last_peered":"2024-09-21T00:56:49.644319+0000","last_clean":"2024-09-21T00:56:49.644319+0000","last_became_active":"2024-09-21T00:56:48.654534+0000","last_became_peered":"2024-09-21T00:56:48.654534+0000","last_unstale":"2024-09-21T00:56:49.644319+0000","last_undegraded":"2024-09-21T00:56:49.644319+0000","last_fullsized":"2024-09-21T00:56:49.644319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:44.007171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.642624+0000","last_change":"2024-09-21T00:56:48.654933+0000","last_active":"2024-09-21T00:56:49.642624+0000","last_peered":"2024-09-21T00:56:49.642624+0000","last_clean":"2024-09-21T00:56:49.642624+0000","last_became_active":"2024-09-21T00:56:48.654523+0000","last_became_peered":"2024-09-21T00:56:48.654523+0000","last_unstale":"2024-09-21T00:56:49.642624+0000","last_undegraded":"2024-09-21T00:56:49.642624+0000","last_fullsized":"2024-09-21T00:56:49.642624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:58.190118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656633+0000","last_change":"2024-09-21T00:56:48.645166+0000","last_active":"2024-09-21T00:56:49.656633+0000","last_peered":"2024-09-21T00:56:49.656633+0000","last_clean":"2024-09-21T00:56:49.656633+0000","last_became_active":"2024-09-21T00:56:48.644695+0000","last_became_peered":"2024-09-21T00:56:48.644695+0000","last_unstale":"2024-09-21T00:56:49.656633+0000","last_undegraded":"2024-09-21T00:56:49.656633+0000","last_fullsized":"2024-09-21T00:56:49.656633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:07.564405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644049+0000","last_change":"2024-09-21T00:56:48.659215+0000","last_active":"2024-09-21T00:56:49.644049+0000","last_peered":"2024-09-21T00:56:49.644049+0000","last_clean":"2024-09-21T00:56:49.644049+0000","last_became_active":"2024-09-21T00:56:48.658783+0000","last_became_peered":"2024-09-21T00:56:48.658783+0000","last_unstale":"2024-09-21T00:56:49.644049+0000","last_undegraded":"2024-09-21T00:56:49.644049+0000","last_fullsized":"2024-09-21T00:56:49.644049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:08:58.663963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657588+0000","last_change":"2024-09-21T00:56:48.644461+0000","last_active":"2024-09-21T00:56:49.657588+0000","last_peered":"2024-09-21T00:56:49.657588+0000","last_clean":"2024-09-21T00:56:49.657588+0000","last_became_active":"2024-09-21T00:56:48.643842+0000","last_became_peered":"2024-09-21T00:56:48.643842+0000","last_unstale":"2024-09-21T00:56:49.657588+0000","last_undegraded":"2024-09-21T00:56:49.657588+0000","last_fullsized":"2024-09-21T00:56:49.657588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:12.673501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657354+0000","last_change":"2024-09-21T00:56:48.651212+0000","last_active":"2024-09-21T00:56:49.657354+0000","last_peered":"2024-09-21T00:56:49.657354+0000","last_clean":"2024-09-21T00:56:49.657354+0000","last_became_active":"2024-09-21T00:56:48.650802+0000","last_became_peered":"2024-09-21T00:56:48.650802+0000","last_unstale":"2024-09-21T00:56:49.657354+0000","last_undegraded":"2024-09-21T00:56:49.657354+0000","last_fullsized":"2024-09-21T00:56:49.657354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:06.310898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656834+0000","last_change":"2024-09-21T00:56:48.647772+0000","last_active":"2024-09-21T00:56:49.656834+0000","last_peered":"2024-09-21T00:56:49.656834+0000","last_clean":"2024-09-21T00:56:49.656834+0000","last_became_active":"2024-09-21T00:56:48.647379+0000","last_became_peered":"2024-09-21T00:56:48.647379+0000","last_unstale":"2024-09-21T00:56:49.656834+0000","last_undegraded":"2024-09-21T00:56:49.656834+0000","last_fullsized":"2024-09-21T00:56:49.656834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:06.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657734+0000","last_change":"2024-09-21T00:56:48.655841+0000","last_active":"2024-09-21T00:56:49.657734+0000","last_peered":"2024-09-21T00:56:49.657734+0000","last_clean":"2024-09-21T00:56:49.657734+0000","last_became_active":"2024-09-21T00:56:48.655270+0000","last_became_peered":"2024-09-21T00:56:48.655270+0000","last_unstale":"2024-09-21T00:56:49.657734+0000","last_undegraded":"2024-09-21T00:56:49.657734+0000","last_fullsized":"2024-09-21T00:56:49.657734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:28.350627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656883+0000","last_change":"2024-09-21T00:56:48.659457+0000","last_active":"2024-09-21T00:56:49.656883+0000","last_peered":"2024-09-21T00:56:49.656883+0000","last_clean":"2024-09-21T00:56:49.656883+0000","last_became_active":"2024-09-21T00:56:48.658999+0000","last_became_peered":"2024-09-21T00:56:48.658999+0000","last_unstale":"2024-09-21T00:56:49.656883+0000","last_undegraded":"2024-09-21T00:56:49.656883+0000","last_fullsized":"2024-09-21T00:56:49.656883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:56.196167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.660764+0000","last_change":"2024-09-21T00:56:48.656361+0000","last_active":"2024-09-21T00:56:49.660764+0000","last_peered":"2024-09-21T00:56:49.660764+0000","last_clean":"2024-09-21T00:56:49.660764+0000","last_became_active":"2024-09-21T00:56:48.655999+0000","last_became_peered":"2024-09-21T00:56:48.655999+0000","last_unstale":"2024-09-21T00:56:49.660764+0000","last_undegraded":"2024-09-21T00:56:49.660764+0000","last_fullsized":"2024-09-21T00:56:49.660764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:46.533280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644130+0000","last_change":"2024-09-21T00:56:48.656549+0000","last_active":"2024-09-21T00:56:49.644130+0000","last_peered":"2024-09-21T00:56:49.644130+0000","last_clean":"2024-09-21T00:56:49.644130+0000","last_became_active":"2024-09-21T00:56:48.656154+0000","last_became_peered":"2024-09-21T00:56:48.656154+0000","last_unstale":"2024-09-21T00:56:49.644130+0000","last_undegraded":"2024-09-21T00:56:49.644130+0000","last_fullsized":"2024-09-21T00:56:49.644130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:37.244726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657307+0000","last_change":"2024-09-21T00:56:48.645857+0000","last_active":"2024-09-21T00:56:49.657307+0000","last_peered":"2024-09-21T00:56:49.657307+0000","last_clean":"2024-09-21T00:56:49.657307+0000","last_became_active":"2024-09-21T00:56:48.644462+0000","last_became_peered":"2024-09-21T00:56:48.644462+0000","last_unstale":"2024-09-21T00:56:49.657307+0000","last_undegraded":"2024-09-21T00:56:49.657307+0000","last_fullsized":"2024-09-21T00:56:49.657307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:11.690074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659996+0000","last_change":"2024-09-21T00:56:48.649937+0000","last_active":"2024-09-21T00:56:49.659996+0000","last_peered":"2024-09-21T00:56:49.659996+0000","last_clean":"2024-09-21T00:56:49.659996+0000","last_became_active":"2024-09-21T00:56:48.649233+0000","last_became_peered":"2024-09-21T00:56:48.649233+0000","last_unstale":"2024-09-21T00:56:49.659996+0000","last_undegraded":"2024-09-21T00:56:49.659996+0000","last_fullsized":"2024-09-21T00:56:49.659996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:00.529143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657554+0000","last_change":"2024-09-21T00:56:48.645824+0000","last_active":"2024-09-21T00:56:49.657554+0000","last_peered":"2024-09-21T00:56:49.657554+0000","last_clean":"2024-09-21T00:56:49.657554+0000","last_became_active":"2024-09-21T00:56:48.645452+0000","last_became_peered":"2024-09-21T00:56:48.645452+0000","last_unstale":"2024-09-21T00:56:49.657554+0000","last_undegraded":"2024-09-21T00:56:49.657554+0000","last_fullsized":"2024-09-21T00:56:49.657554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:40.228469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659813+0000","last_change":"2024-09-21T00:56:48.653384+0000","last_active":"2024-09-21T00:56:49.659813+0000","last_peered":"2024-09-21T00:56:49.659813+0000","last_clean":"2024-09-21T00:56:49.659813+0000","last_became_active":"2024-09-21T00:56:48.653021+0000","last_became_peered":"2024-09-21T00:56:48.653021+0000","last_unstale":"2024-09-21T00:56:49.659813+0000","last_undegraded":"2024-09-21T00:56:49.659813+0000","last_fullsized":"2024-09-21T00:56:49.659813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:17.041766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643881+0000","last_change":"2024-09-21T00:56:48.656431+0000","last_active":"2024-09-21T00:56:49.643881+0000","last_peered":"2024-09-21T00:56:49.643881+0000","last_clean":"2024-09-21T00:56:49.643881+0000","last_became_active":"2024-09-21T00:56:48.656080+0000","last_became_peered":"2024-09-21T00:56:48.656080+0000","last_unstale":"2024-09-21T00:56:49.643881+0000","last_undegraded":"2024-09-21T00:56:49.643881+0000","last_fullsized":"2024-09-21T00:56:49.643881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:00.068094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656691+0000","last_change":"2024-09-21T00:56:48.653355+0000","last_active":"2024-09-21T00:56:49.656691+0000","last_peered":"2024-09-21T00:56:49.656691+0000","last_clean":"2024-09-21T00:56:49.656691+0000","last_became_active":"2024-09-21T00:56:48.652959+0000","last_became_peered":"2024-09-21T00:56:48.652959+0000","last_unstale":"2024-09-21T00:56:49.656691+0000","last_undegraded":"2024-09-21T00:56:49.656691+0000","last_fullsized":"2024-09-21T00:56:49.656691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:16.462806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656431+0000","last_change":"2024-09-21T00:56:46.634744+0000","last_active":"2024-09-21T00:56:49.656431+0000","last_peered":"2024-09-21T00:56:49.656431+0000","last_clean":"2024-09-21T00:56:49.656431+0000","last_became_active":"2024-09-21T00:56:46.634367+0000","last_became_peered":"2024-09-21T00:56:46.634367+0000","last_unstale":"2024-09-21T00:56:49.656431+0000","last_undegraded":"2024-09-21T00:56:49.656431+0000","last_fullsized":"2024-09-21T00:56:49.656431+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:40.923450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656411+0000","last_change":"2024-09-21T00:56:48.660277+0000","last_active":"2024-09-21T00:56:49.656411+0000","last_peered":"2024-09-21T00:56:49.656411+0000","last_clean":"2024-09-21T00:56:49.656411+0000","last_became_active":"2024-09-21T00:56:48.659491+0000","last_became_peered":"2024-09-21T00:56:48.659491+0000","last_unstale":"2024-09-21T00:56:49.656411+0000","last_undegraded":"2024-09-21T00:56:49.656411+0000","last_fullsized":"2024-09-21T00:56:49.656411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:39.032704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643709+0000","last_change":"2024-09-21T00:56:46.634466+0000","last_active":"2024-09-21T00:56:49.643709+0000","last_peered":"2024-09-21T00:56:49.643709+0000","last_clean":"2024-09-21T00:56:49.643709+0000","last_became_active":"2024-09-21T00:56:46.634031+0000","last_became_peered":"2024-09-21T00:56:46.634031+0000","last_unstale":"2024-09-21T00:56:49.643709+0000","last_undegraded":"2024-09-21T00:56:49.643709+0000","last_fullsized":"2024-09-21T00:56:49.643709+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:49.691014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.655908+0000","last_change":"2024-09-21T00:56:46.628156+0000","last_active":"2024-09-21T00:56:49.655908+0000","last_peered":"2024-09-21T00:56:49.655908+0000","last_clean":"2024-09-21T00:56:49.655908+0000","last_became_active":"2024-09-21T00:56:46.627735+0000","last_became_peered":"2024-09-21T00:56:46.627735+0000","last_unstale":"2024-09-21T00:56:49.655908+0000","last_undegraded":"2024-09-21T00:56:49.655908+0000","last_fullsized":"2024-09-21T00:56:49.655908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:55.188016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656563+0000","last_change":"2024-09-21T00:56:48.649571+0000","last_active":"2024-09-21T00:56:49.656563+0000","last_peered":"2024-09-21T00:56:49.656563+0000","last_clean":"2024-09-21T00:56:49.656563+0000","last_became_active":"2024-09-21T00:56:48.647345+0000","last_became_peered":"2024-09-21T00:56:48.647345+0000","last_unstale":"2024-09-21T00:56:49.656563+0000","last_undegraded":"2024-09-21T00:56:49.656563+0000","last_fullsized":"2024-09-21T00:56:49.656563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:43.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658306+0000","last_change":"2024-09-21T00:56:46.634886+0000","last_active":"2024-09-21T00:56:49.658306+0000","last_peered":"2024-09-21T00:56:49.658306+0000","last_clean":"2024-09-21T00:56:49.658306+0000","last_became_active":"2024-09-21T00:56:46.634481+0000","last_became_peered":"2024-09-21T00:56:46.634481+0000","last_unstale":"2024-09-21T00:56:49.658306+0000","last_undegraded":"2024-09-21T00:56:49.658306+0000","last_fullsized":"2024-09-21T00:56:49.658306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:15.062776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.642398+0000","last_change":"2024-09-21T00:56:48.655740+0000","last_active":"2024-09-21T00:56:49.642398+0000","last_peered":"2024-09-21T00:56:49.642398+0000","last_clean":"2024-09-21T00:56:49.642398+0000","last_became_active":"2024-09-21T00:56:48.655312+0000","last_became_peered":"2024-09-21T00:56:48.655312+0000","last_unstale":"2024-09-21T00:56:49.642398+0000","last_undegraded":"2024-09-21T00:56:49.642398+0000","last_fullsized":"2024-09-21T00:56:49.642398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.815954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643753+0000","last_change":"2024-09-21T00:56:46.636212+0000","last_active":"2024-09-21T00:56:49.643753+0000","last_peered":"2024-09-21T00:56:49.643753+0000","last_clean":"2024-09-21T00:56:49.643753+0000","last_became_active":"2024-09-21T00:56:46.635702+0000","last_became_peered":"2024-09-21T00:56:46.635702+0000","last_unstale":"2024-09-21T00:56:49.643753+0000","last_undegraded":"2024-09-21T00:56:49.643753+0000","last_fullsized":"2024-09-21T00:56:49.643753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:11.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658208+0000","last_change":"2024-09-21T00:56:48.646300+0000","last_active":"2024-09-21T00:56:49.658208+0000","last_peered":"2024-09-21T00:56:49.658208+0000","last_clean":"2024-09-21T00:56:49.658208+0000","last_became_active":"2024-09-21T00:56:48.645906+0000","last_became_peered":"2024-09-21T00:56:48.645906+0000","last_unstale":"2024-09-21T00:56:49.658208+0000","last_undegraded":"2024-09-21T00:56:49.658208+0000","last_fullsized":"2024-09-21T00:56:49.658208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:47.593609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656008+0000","last_change":"2024-09-21T00:56:46.639405+0000","last_active":"2024-09-21T00:56:49.656008+0000","last_peered":"2024-09-21T00:56:49.656008+0000","last_clean":"2024-09-21T00:56:49.656008+0000","last_became_active":"2024-09-21T00:56:46.638659+0000","last_became_peered":"2024-09-21T00:56:46.638659+0000","last_unstale":"2024-09-21T00:56:49.656008+0000","last_undegraded":"2024-09-21T00:56:49.656008+0000","last_fullsized":"2024-09-21T00:56:49.656008+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:19.718585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.660317+0000","last_change":"2024-09-21T00:56:48.657572+0000","last_active":"2024-09-21T00:56:49.660317+0000","last_peered":"2024-09-21T00:56:49.660317+0000","last_clean":"2024-09-21T00:56:49.660317+0000","last_became_active":"2024-09-21T00:56:48.657219+0000","last_became_peered":"2024-09-21T00:56:48.657219+0000","last_unstale":"2024-09-21T00:56:49.660317+0000","last_undegraded":"2024-09-21T00:56:49.660317+0000","last_fullsized":"2024-09-21T00:56:49.660317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:48.870835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.662569+0000","last_change":"2024-09-21T00:56:46.642710+0000","last_active":"2024-09-21T00:56:49.662569+0000","last_peered":"2024-09-21T00:56:49.662569+0000","last_clean":"2024-09-21T00:56:49.662569+0000","last_became_active":"2024-09-21T00:56:46.642273+0000","last_became_peered":"2024-09-21T00:56:46.642273+0000","last_unstale":"2024-09-21T00:56:49.662569+0000","last_undegraded":"2024-09-21T00:56:49.662569+0000","last_fullsized":"2024-09-21T00:56:49.662569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.751651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656806+0000","last_change":"2024-09-21T00:56:48.652566+0000","last_active":"2024-09-21T00:56:49.656806+0000","last_peered":"2024-09-21T00:56:49.656806+0000","last_clean":"2024-09-21T00:56:49.656806+0000","last_became_active":"2024-09-21T00:56:48.652201+0000","last_became_peered":"2024-09-21T00:56:48.652201+0000","last_unstale":"2024-09-21T00:56:49.656806+0000","last_undegraded":"2024-09-21T00:56:49.656806+0000","last_fullsized":"2024-09-21T00:56:49.656806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:54.778152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'25","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:57:11.541424+0000","last_change":"2024-09-21T00:56:46.639555+0000","last_active":"2024-09-21T00:57:11.541424+0000","last_peered":"2024-09-21T00:57:11.541424+0000","last_clean":"2024-09-21T00:57:11.541424+0000","last_became_active":"2024-09-21T00:56:46.639200+0000","last_became_peered":"2024-09-21T00:56:46.639200+0000","last_unstale":"2024-09-21T00:57:11.541424+0000","last_undegraded":"2024-09-21T00:57:11.541424+0000","last_fullsized":"2024-09-21T00:57:11.541424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:49.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61562,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":78,"num_write":25,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659499+0000","last_change":"2024-09-21T00:56:48.653950+0000","last_active":"2024-09-21T00:56:49.659499+0000","last_peered":"2024-09-21T00:56:49.659499+0000","last_clean":"2024-09-21T00:56:49.659499+0000","last_became_active":"2024-09-21T00:56:48.653570+0000","last_became_peered":"2024-09-21T00:56:48.653570+0000","last_unstale":"2024-09-21T00:56:49.659499+0000","last_undegraded":"2024-09-21T00:56:49.659499+0000","last_fullsized":"2024-09-21T00:56:49.659499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:43.708982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.663701+0000","last_change":"2024-09-21T00:56:46.635861+0000","last_active":"2024-09-21T00:56:49.663701+0000","last_peered":"2024-09-21T00:56:49.663701+0000","last_clean":"2024-09-21T00:56:49.663701+0000","last_became_active":"2024-09-21T00:56:46.635452+0000","last_became_peered":"2024-09-21T00:56:46.635452+0000","last_unstale":"2024-09-21T00:56:49.663701+0000","last_undegraded":"2024-09-21T00:56:49.663701+0000","last_fullsized":"2024-09-21T00:56:49.663701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:15.591100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657400+0000","last_change":"2024-09-21T00:56:48.645567+0000","last_active":"2024-09-21T00:56:49.657400+0000","last_peered":"2024-09-21T00:56:49.657400+0000","last_clean":"2024-09-21T00:56:49.657400+0000","last_became_active":"2024-09-21T00:56:48.644499+0000","last_became_peered":"2024-09-21T00:56:48.644499+0000","last_unstale":"2024-09-21T00:56:49.657400+0000","last_undegraded":"2024-09-21T00:56:49.657400+0000","last_fullsized":"2024-09-21T00:56:49.657400+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:08.655065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.655796+0000","last_change":"2024-09-21T00:56:46.633014+0000","last_active":"2024-09-21T00:56:49.655796+0000","last_peered":"2024-09-21T00:56:49.655796+0000","last_clean":"2024-09-21T00:56:49.655796+0000","last_became_active":"2024-09-21T00:56:46.632656+0000","last_became_peered":"2024-09-21T00:56:46.632656+0000","last_unstale":"2024-09-21T00:56:49.655796+0000","last_undegraded":"2024-09-21T00:56:49.655796+0000","last_fullsized":"2024-09-21T00:56:49.655796+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:46.270469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656461+0000","last_change":"2024-09-21T00:56:48.659797+0000","last_active":"2024-09-21T00:56:49.656461+0000","last_peered":"2024-09-21T00:56:49.656461+0000","last_clean":"2024-09-21T00:56:49.656461+0000","last_became_active":"2024-09-21T00:56:48.659430+0000","last_became_peered":"2024-09-21T00:56:48.659430+0000","last_unstale":"2024-09-21T00:56:49.656461+0000","last_undegraded":"2024-09-21T00:56:49.656461+0000","last_fullsized":"2024-09-21T00:56:49.656461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:45.006414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658947+0000","last_change":"2024-09-21T00:56:46.636792+0000","last_active":"2024-09-21T00:56:49.658947+0000","last_peered":"2024-09-21T00:56:49.658947+0000","last_clean":"2024-09-21T00:56:49.658947+0000","last_became_active":"2024-09-21T00:56:46.636383+0000","last_became_peered":"2024-09-21T00:56:46.636383+0000","last_unstale":"2024-09-21T00:56:49.658947+0000","last_undegraded":"2024-09-21T00:56:49.658947+0000","last_fullsized":"2024-09-21T00:56:49.658947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:37.078166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656007+0000","last_change":"2024-09-21T00:56:48.657065+0000","last_active":"2024-09-21T00:56:49.656007+0000","last_peered":"2024-09-21T00:56:49.656007+0000","last_clean":"2024-09-21T00:56:49.656007+0000","last_became_active":"2024-09-21T00:56:48.656658+0000","last_became_peered":"2024-09-21T00:56:48.656658+0000","last_unstale":"2024-09-21T00:56:49.656007+0000","last_undegraded":"2024-09-21T00:56:49.656007+0000","last_fullsized":"2024-09-21T00:56:49.656007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:31.713457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.666800+0000","last_change":"2024-09-21T00:56:46.642099+0000","last_active":"2024-09-21T00:56:49.666800+0000","last_peered":"2024-09-21T00:56:49.666800+0000","last_clean":"2024-09-21T00:56:49.666800+0000","last_became_active":"2024-09-21T00:56:46.641526+0000","last_became_peered":"2024-09-21T00:56:46.641526+0000","last_unstale":"2024-09-21T00:56:49.666800+0000","last_undegraded":"2024-09-21T00:56:49.666800+0000","last_fullsized":"2024-09-21T00:56:49.666800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:12.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656575+0000","last_change":"2024-09-21T00:56:48.660991+0000","last_active":"2024-09-21T00:56:49.656575+0000","last_peered":"2024-09-21T00:56:49.656575+0000","last_clean":"2024-09-21T00:56:49.656575+0000","last_became_active":"2024-09-21T00:56:48.660623+0000","last_became_peered":"2024-09-21T00:56:48.660623+0000","last_unstale":"2024-09-21T00:56:49.656575+0000","last_undegraded":"2024-09-21T00:56:49.656575+0000","last_fullsized":"2024-09-21T00:56:49.656575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:34.291977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.664686+0000","last_change":"2024-09-21T00:56:46.637482+0000","last_active":"2024-09-21T00:56:49.664686+0000","last_peered":"2024-09-21T00:56:49.664686+0000","last_clean":"2024-09-21T00:56:49.664686+0000","last_became_active":"2024-09-21T00:56:46.634812+0000","last_became_peered":"2024-09-21T00:56:46.634812+0000","last_unstale":"2024-09-21T00:56:49.664686+0000","last_undegraded":"2024-09-21T00:56:49.664686+0000","last_fullsized":"2024-09-21T00:56:49.664686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:30.990625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644091+0000","last_change":"2024-09-21T00:56:48.658930+0000","last_active":"2024-09-21T00:56:49.644091+0000","last_peered":"2024-09-21T00:56:49.644091+0000","last_clean":"2024-09-21T00:56:49.644091+0000","last_became_active":"2024-09-21T00:56:48.658545+0000","last_became_peered":"2024-09-21T00:56:48.658545+0000","last_unstale":"2024-09-21T00:56:49.644091+0000","last_undegraded":"2024-09-21T00:56:49.644091+0000","last_fullsized":"2024-09-21T00:56:49.644091+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:30:57.850371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.663804+0000","last_change":"2024-09-21T00:56:46.628768+0000","last_active":"2024-09-21T00:56:49.663804+0000","last_peered":"2024-09-21T00:56:49.663804+0000","last_clean":"2024-09-21T00:56:49.663804+0000","last_became_active":"2024-09-21T00:56:46.628374+0000","last_became_peered":"2024-09-21T00:56:46.628374+0000","last_unstale":"2024-09-21T00:56:49.663804+0000","last_undegraded":"2024-09-21T00:56:49.663804+0000","last_fullsized":"2024-09-21T00:56:49.663804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:58:15.133651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657555+0000","last_change":"2024-09-21T00:56:48.648097+0000","last_active":"2024-09-21T00:56:49.657555+0000","last_peered":"2024-09-21T00:56:49.657555+0000","last_clean":"2024-09-21T00:56:49.657555+0000","last_became_active":"2024-09-21T00:56:48.647619+0000","last_became_peered":"2024-09-21T00:56:48.647619+0000","last_unstale":"2024-09-21T00:56:49.657555+0000","last_undegraded":"2024-09-21T00:56:49.657555+0000","last_fullsized":"2024-09-21T00:56:49.657555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:08.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.664338+0000","last_change":"2024-09-21T00:56:46.636947+0000","last_active":"2024-09-21T00:56:49.664338+0000","last_peered":"2024-09-21T00:56:49.664338+0000","last_clean":"2024-09-21T00:56:49.664338+0000","last_became_active":"2024-09-21T00:56:46.636469+0000","last_became_peered":"2024-09-21T00:56:46.636469+0000","last_unstale":"2024-09-21T00:56:49.664338+0000","last_undegraded":"2024-09-21T00:56:49.664338+0000","last_fullsized":"2024-09-21T00:56:49.664338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:31.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:51.964462+0000","last_change":"2024-09-21T00:56:48.655750+0000","last_active":"2024-09-21T00:56:51.964462+0000","last_peered":"2024-09-21T00:56:51.964462+0000","last_clean":"2024-09-21T00:56:51.964462+0000","last_became_active":"2024-09-21T00:56:48.655315+0000","last_became_peered":"2024-09-21T00:56:48.655315+0000","last_unstale":"2024-09-21T00:56:51.964462+0000","last_undegraded":"2024-09-21T00:56:51.964462+0000","last_fullsized":"2024-09-21T00:56:51.964462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:48.121314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.663255+0000","last_change":"2024-09-21T00:56:47.391206+0000","last_active":"2024-09-21T00:56:49.663255+0000","last_peered":"2024-09-21T00:56:49.663255+0000","last_clean":"2024-09-21T00:56:49.663255+0000","last_became_active":"2024-09-21T00:56:47.390708+0000","last_became_peered":"2024-09-21T00:56:47.390708+0000","last_unstale":"2024-09-21T00:56:49.663255+0000","last_undegraded":"2024-09-21T00:56:49.663255+0000","last_fullsized":"2024-09-21T00:56:49.663255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:59.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656454+0000","last_change":"2024-09-21T00:56:48.648452+0000","last_active":"2024-09-21T00:56:49.656454+0000","last_peered":"2024-09-21T00:56:49.656454+0000","last_clean":"2024-09-21T00:56:49.656454+0000","last_became_active":"2024-09-21T00:56:48.647682+0000","last_became_peered":"2024-09-21T00:56:48.647682+0000","last_unstale":"2024-09-21T00:56:49.656454+0000","last_undegraded":"2024-09-21T00:56:49.656454+0000","last_fullsized":"2024-09-21T00:56:49.656454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:45.844596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656103+0000","last_change":"2024-09-21T00:55:37.551147+0000","last_active":"2024-09-21T00:56:49.656103+0000","last_peered":"2024-09-21T00:56:49.656103+0000","last_clean":"2024-09-21T00:56:49.656103+0000","last_became_active":"2024-09-21T00:55:37.545124+0000","last_became_peered":"2024-09-21T00:55:37.545124+0000","last_unstale":"2024-09-21T00:56:49.656103+0000","last_undegraded":"2024-09-21T00:56:49.656103+0000","last_fullsized":"2024-09-21T00:56:49.656103+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_clean_scrub_stamp":"2024-09-21T00:52:17.996374+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:20.205607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659138+0000","last_change":"2024-09-21T00:56:46.637264+0000","last_active":"2024-09-21T00:56:49.659138+0000","last_peered":"2024-09-21T00:56:49.659138+0000","last_clean":"2024-09-21T00:56:49.659138+0000","last_became_active":"2024-09-21T00:56:46.636320+0000","last_became_peered":"2024-09-21T00:56:46.636320+0000","last_unstale":"2024-09-21T00:56:49.659138+0000","last_undegraded":"2024-09-21T00:56:49.659138+0000","last_fullsized":"2024-09-21T00:56:49.659138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:42.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656673+0000","last_change":"2024-09-21T00:56:48.651051+0000","last_active":"2024-09-21T00:56:49.656673+0000","last_peered":"2024-09-21T00:56:49.656673+0000","last_clean":"2024-09-21T00:56:49.656673+0000","last_became_active":"2024-09-21T00:56:48.650693+0000","last_became_peered":"2024-09-21T00:56:48.650693+0000","last_unstale":"2024-09-21T00:56:49.656673+0000","last_undegraded":"2024-09-21T00:56:49.656673+0000","last_fullsized":"2024-09-21T00:56:49.656673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:49.575213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656095+0000","last_change":"2024-09-21T00:56:46.634826+0000","last_active":"2024-09-21T00:56:49.656095+0000","last_peered":"2024-09-21T00:56:49.656095+0000","last_clean":"2024-09-21T00:56:49.656095+0000","last_became_active":"2024-09-21T00:56:46.634370+0000","last_became_peered":"2024-09-21T00:56:46.634370+0000","last_unstale":"2024-09-21T00:56:49.656095+0000","last_undegraded":"2024-09-21T00:56:49.656095+0000","last_fullsized":"2024-09-21T00:56:49.656095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:29.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.655734+0000","last_change":"2024-09-21T00:56:48.646296+0000","last_active":"2024-09-21T00:56:49.655734+0000","last_peered":"2024-09-21T00:56:49.655734+0000","last_clean":"2024-09-21T00:56:49.655734+0000","last_became_active":"2024-09-21T00:56:48.644271+0000","last_became_peered":"2024-09-21T00:56:48.644271+0000","last_unstale":"2024-09-21T00:56:49.655734+0000","last_undegraded":"2024-09-21T00:56:49.655734+0000","last_fullsized":"2024-09-21T00:56:49.655734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:27.609714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657305+0000","last_change":"2024-09-21T00:56:46.641852+0000","last_active":"2024-09-21T00:56:49.657305+0000","last_peered":"2024-09-21T00:56:49.657305+0000","last_clean":"2024-09-21T00:56:49.657305+0000","last_became_active":"2024-09-21T00:56:46.641449+0000","last_became_peered":"2024-09-21T00:56:46.641449+0000","last_unstale":"2024-09-21T00:56:49.657305+0000","last_undegraded":"2024-09-21T00:56:49.657305+0000","last_fullsized":"2024-09-21T00:56:49.657305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:51.086321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.658023+0000","last_change":"2024-09-21T00:56:48.660295+0000","last_active":"2024-09-21T00:56:49.658023+0000","last_peered":"2024-09-21T00:56:49.658023+0000","last_clean":"2024-09-21T00:56:49.658023+0000","last_became_active":"2024-09-21T00:56:48.659638+0000","last_became_peered":"2024-09-21T00:56:48.659638+0000","last_unstale":"2024-09-21T00:56:49.658023+0000","last_undegraded":"2024-09-21T00:56:49.658023+0000","last_fullsized":"2024-09-21T00:56:49.658023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:34.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656087+0000","last_change":"2024-09-21T00:56:46.639317+0000","last_active":"2024-09-21T00:56:49.656087+0000","last_peered":"2024-09-21T00:56:49.656087+0000","last_clean":"2024-09-21T00:56:49.656087+0000","last_became_active":"2024-09-21T00:56:46.638732+0000","last_became_peered":"2024-09-21T00:56:46.638732+0000","last_unstale":"2024-09-21T00:56:49.656087+0000","last_undegraded":"2024-09-21T00:56:49.656087+0000","last_fullsized":"2024-09-21T00:56:49.656087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.643583+0000","last_change":"2024-09-21T00:56:48.651038+0000","last_active":"2024-09-21T00:56:49.643583+0000","last_peered":"2024-09-21T00:56:49.643583+0000","last_clean":"2024-09-21T00:56:49.643583+0000","last_became_active":"2024-09-21T00:56:48.650682+0000","last_became_peered":"2024-09-21T00:56:48.650682+0000","last_unstale":"2024-09-21T00:56:49.643583+0000","last_undegraded":"2024-09-21T00:56:49.643583+0000","last_fullsized":"2024-09-21T00:56:49.643583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.015768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.642539+0000","last_change":"2024-09-21T00:56:46.641993+0000","last_active":"2024-09-21T00:56:49.642539+0000","last_peered":"2024-09-21T00:56:49.642539+0000","last_clean":"2024-09-21T00:56:49.642539+0000","last_became_active":"2024-09-21T00:56:46.641631+0000","last_became_peered":"2024-09-21T00:56:46.641631+0000","last_unstale":"2024-09-21T00:56:49.642539+0000","last_undegraded":"2024-09-21T00:56:49.642539+0000","last_fullsized":"2024-09-21T00:56:49.642539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:12.986551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:51.966239+0000","last_change":"2024-09-21T00:56:48.649620+0000","last_active":"2024-09-21T00:56:51.966239+0000","last_peered":"2024-09-21T00:56:51.966239+0000","last_clean":"2024-09-21T00:56:51.966239+0000","last_became_active":"2024-09-21T00:56:48.645757+0000","last_became_peered":"2024-09-21T00:56:48.645757+0000","last_unstale":"2024-09-21T00:56:51.966239+0000","last_undegraded":"2024-09-21T00:56:51.966239+0000","last_fullsized":"2024-09-21T00:56:51.966239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:12.802042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659665+0000","last_change":"2024-09-21T00:56:46.641723+0000","last_active":"2024-09-21T00:56:49.659665+0000","last_peered":"2024-09-21T00:56:49.659665+0000","last_clean":"2024-09-21T00:56:49.659665+0000","last_became_active":"2024-09-21T00:56:46.641219+0000","last_became_peered":"2024-09-21T00:56:46.641219+0000","last_unstale":"2024-09-21T00:56:49.659665+0000","last_undegraded":"2024-09-21T00:56:49.659665+0000","last_fullsized":"2024-09-21T00:56:49.659665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:47.676869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657392+0000","last_change":"2024-09-21T00:56:48.641940+0000","last_active":"2024-09-21T00:56:49.657392+0000","last_peered":"2024-09-21T00:56:49.657392+0000","last_clean":"2024-09-21T00:56:49.657392+0000","last_became_active":"2024-09-21T00:56:48.641521+0000","last_became_peered":"2024-09-21T00:56:48.641521+0000","last_unstale":"2024-09-21T00:56:49.657392+0000","last_undegraded":"2024-09-21T00:56:49.657392+0000","last_fullsized":"2024-09-21T00:56:49.657392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:38.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:57:09.655840+0000","last_change":"2024-09-21T00:56:46.631037+0000","last_active":"2024-09-21T00:57:09.655840+0000","last_peered":"2024-09-21T00:57:09.655840+0000","last_clean":"2024-09-21T00:57:09.655840+0000","last_became_active":"2024-09-21T00:56:46.630612+0000","last_became_peered":"2024-09-21T00:56:46.630612+0000","last_unstale":"2024-09-21T00:57:09.655840+0000","last_undegraded":"2024-09-21T00:57:09.655840+0000","last_fullsized":"2024-09-21T00:57:09.655840+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.390614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657132+0000","last_change":"2024-09-21T00:56:48.649774+0000","last_active":"2024-09-21T00:56:49.657132+0000","last_peered":"2024-09-21T00:56:49.657132+0000","last_clean":"2024-09-21T00:56:49.657132+0000","last_became_active":"2024-09-21T00:56:48.649380+0000","last_became_peered":"2024-09-21T00:56:48.649380+0000","last_unstale":"2024-09-21T00:56:49.657132+0000","last_undegraded":"2024-09-21T00:56:49.657132+0000","last_fullsized":"2024-09-21T00:56:49.657132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:12.595820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.662588+0000","last_change":"2024-09-21T00:56:47.391328+0000","last_active":"2024-09-21T00:56:49.662588+0000","last_peered":"2024-09-21T00:56:49.662588+0000","last_clean":"2024-09-21T00:56:49.662588+0000","last_became_active":"2024-09-21T00:56:47.390860+0000","last_became_peered":"2024-09-21T00:56:47.390860+0000","last_unstale":"2024-09-21T00:56:49.662588+0000","last_undegraded":"2024-09-21T00:56:49.662588+0000","last_fullsized":"2024-09-21T00:56:49.662588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:24.267908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.660009+0000","last_change":"2024-09-21T00:56:48.657644+0000","last_active":"2024-09-21T00:56:49.660009+0000","last_peered":"2024-09-21T00:56:49.660009+0000","last_clean":"2024-09-21T00:56:49.660009+0000","last_became_active":"2024-09-21T00:56:48.657263+0000","last_became_peered":"2024-09-21T00:56:48.657263+0000","last_unstale":"2024-09-21T00:56:49.660009+0000","last_undegraded":"2024-09-21T00:56:49.660009+0000","last_fullsized":"2024-09-21T00:56:49.660009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:20.635667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657202+0000","last_change":"2024-09-21T00:56:46.641749+0000","last_active":"2024-09-21T00:56:49.657202+0000","last_peered":"2024-09-21T00:56:49.657202+0000","last_clean":"2024-09-21T00:56:49.657202+0000","last_became_active":"2024-09-21T00:56:46.641373+0000","last_became_peered":"2024-09-21T00:56:46.641373+0000","last_unstale":"2024-09-21T00:56:49.657202+0000","last_undegraded":"2024-09-21T00:56:49.657202+0000","last_fullsized":"2024-09-21T00:56:49.657202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:56.376410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657524+0000","last_change":"2024-09-21T00:56:48.656028+0000","last_active":"2024-09-21T00:56:49.657524+0000","last_peered":"2024-09-21T00:56:49.657524+0000","last_clean":"2024-09-21T00:56:49.657524+0000","last_became_active":"2024-09-21T00:56:48.655380+0000","last_became_peered":"2024-09-21T00:56:48.655380+0000","last_unstale":"2024-09-21T00:56:49.657524+0000","last_undegraded":"2024-09-21T00:56:49.657524+0000","last_fullsized":"2024-09-21T00:56:49.657524+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:37.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656783+0000","last_change":"2024-09-21T00:56:46.635884+0000","last_active":"2024-09-21T00:56:49.656783+0000","last_peered":"2024-09-21T00:56:49.656783+0000","last_clean":"2024-09-21T00:56:49.656783+0000","last_became_active":"2024-09-21T00:56:46.635545+0000","last_became_peered":"2024-09-21T00:56:46.635545+0000","last_unstale":"2024-09-21T00:56:49.656783+0000","last_undegraded":"2024-09-21T00:56:49.656783+0000","last_fullsized":"2024-09-21T00:56:49.656783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:03.170611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.644178+0000","last_change":"2024-09-21T00:56:48.649548+0000","last_active":"2024-09-21T00:56:49.644178+0000","last_peered":"2024-09-21T00:56:49.644178+0000","last_clean":"2024-09-21T00:56:49.644178+0000","last_became_active":"2024-09-21T00:56:48.649157+0000","last_became_peered":"2024-09-21T00:56:48.649157+0000","last_unstale":"2024-09-21T00:56:49.644178+0000","last_undegraded":"2024-09-21T00:56:49.644178+0000","last_fullsized":"2024-09-21T00:56:49.644178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:46.794274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656475+0000","last_change":"2024-09-21T00:56:46.632139+0000","last_active":"2024-09-21T00:56:49.656475+0000","last_peered":"2024-09-21T00:56:49.656475+0000","last_clean":"2024-09-21T00:56:49.656475+0000","last_became_active":"2024-09-21T00:56:46.631680+0000","last_became_peered":"2024-09-21T00:56:46.631680+0000","last_unstale":"2024-09-21T00:56:49.656475+0000","last_undegraded":"2024-09-21T00:56:49.656475+0000","last_fullsized":"2024-09-21T00:56:49.656475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:21:17.909161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656225+0000","last_change":"2024-09-21T00:56:48.654956+0000","last_active":"2024-09-21T00:56:49.656225+0000","last_peered":"2024-09-21T00:56:49.656225+0000","last_clean":"2024-09-21T00:56:49.656225+0000","last_became_active":"2024-09-21T00:56:48.654354+0000","last_became_peered":"2024-09-21T00:56:48.654354+0000","last_unstale":"2024-09-21T00:56:49.656225+0000","last_undegraded":"2024-09-21T00:56:49.656225+0000","last_fullsized":"2024-09-21T00:56:49.656225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:56.540664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.664409+0000","last_change":"2024-09-21T00:56:46.635804+0000","last_active":"2024-09-21T00:56:49.664409+0000","last_peered":"2024-09-21T00:56:49.664409+0000","last_clean":"2024-09-21T00:56:49.664409+0000","last_became_active":"2024-09-21T00:56:46.635404+0000","last_became_peered":"2024-09-21T00:56:46.635404+0000","last_unstale":"2024-09-21T00:56:49.664409+0000","last_undegraded":"2024-09-21T00:56:49.664409+0000","last_fullsized":"2024-09-21T00:56:49.664409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:38:39.360870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656259+0000","last_change":"2024-09-21T00:56:48.647881+0000","last_active":"2024-09-21T00:56:49.656259+0000","last_peered":"2024-09-21T00:56:49.656259+0000","last_clean":"2024-09-21T00:56:49.656259+0000","last_became_active":"2024-09-21T00:56:48.647391+0000","last_became_peered":"2024-09-21T00:56:48.647391+0000","last_unstale":"2024-09-21T00:56:49.656259+0000","last_undegraded":"2024-09-21T00:56:49.656259+0000","last_fullsized":"2024-09-21T00:56:49.656259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:57.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657648+0000","last_change":"2024-09-21T00:56:48.662093+0000","last_active":"2024-09-21T00:56:49.657648+0000","last_peered":"2024-09-21T00:56:49.657648+0000","last_clean":"2024-09-21T00:56:49.657648+0000","last_became_active":"2024-09-21T00:56:48.661652+0000","last_became_peered":"2024-09-21T00:56:48.661652+0000","last_unstale":"2024-09-21T00:56:49.657648+0000","last_undegraded":"2024-09-21T00:56:49.657648+0000","last_fullsized":"2024-09-21T00:56:49.657648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:42:29.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.664263+0000","last_change":"2024-09-21T00:56:46.633958+0000","last_active":"2024-09-21T00:56:49.664263+0000","last_peered":"2024-09-21T00:56:49.664263+0000","last_clean":"2024-09-21T00:56:49.664263+0000","last_became_active":"2024-09-21T00:56:46.633473+0000","last_became_peered":"2024-09-21T00:56:46.633473+0000","last_unstale":"2024-09-21T00:56:49.664263+0000","last_undegraded":"2024-09-21T00:56:49.664263+0000","last_fullsized":"2024-09-21T00:56:49.664263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:03:41.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656870+0000","last_change":"2024-09-21T00:56:48.647961+0000","last_active":"2024-09-21T00:56:49.656870+0000","last_peered":"2024-09-21T00:56:49.656870+0000","last_clean":"2024-09-21T00:56:49.656870+0000","last_became_active":"2024-09-21T00:56:48.647301+0000","last_became_peered":"2024-09-21T00:56:48.647301+0000","last_unstale":"2024-09-21T00:56:49.656870+0000","last_undegraded":"2024-09-21T00:56:49.656870+0000","last_fullsized":"2024-09-21T00:56:49.656870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:21.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.665437+0000","last_change":"2024-09-21T00:56:46.637114+0000","last_active":"2024-09-21T00:56:49.665437+0000","last_peered":"2024-09-21T00:56:49.665437+0000","last_clean":"2024-09-21T00:56:49.665437+0000","last_became_active":"2024-09-21T00:56:46.636244+0000","last_became_peered":"2024-09-21T00:56:46.636244+0000","last_unstale":"2024-09-21T00:56:49.665437+0000","last_undegraded":"2024-09-21T00:56:49.665437+0000","last_fullsized":"2024-09-21T00:56:49.665437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:36.374016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.659973+0000","last_change":"2024-09-21T00:56:48.647249+0000","last_active":"2024-09-21T00:56:49.659973+0000","last_peered":"2024-09-21T00:56:49.659973+0000","last_clean":"2024-09-21T00:56:49.659973+0000","last_became_active":"2024-09-21T00:56:48.646888+0000","last_became_peered":"2024-09-21T00:56:48.646888+0000","last_unstale":"2024-09-21T00:56:49.659973+0000","last_undegraded":"2024-09-21T00:56:49.659973+0000","last_fullsized":"2024-09-21T00:56:49.659973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:02.997909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.657349+0000","last_change":"2024-09-21T00:56:46.642781+0000","last_active":"2024-09-21T00:56:49.657349+0000","last_peered":"2024-09-21T00:56:49.657349+0000","last_clean":"2024-09-21T00:56:49.657349+0000","last_became_active":"2024-09-21T00:56:46.642346+0000","last_became_peered":"2024-09-21T00:56:46.642346+0000","last_unstale":"2024-09-21T00:56:49.657349+0000","last_undegraded":"2024-09-21T00:56:49.657349+0000","last_fullsized":"2024-09-21T00:56:49.657349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.050014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.656285+0000","last_change":"2024-09-21T00:56:48.651942+0000","last_active":"2024-09-21T00:56:49.656285+0000","last_peered":"2024-09-21T00:56:49.656285+0000","last_clean":"2024-09-21T00:56:49.656285+0000","last_became_active":"2024-09-21T00:56:48.650577+0000","last_became_peered":"2024-09-21T00:56:48.650577+0000","last_unstale":"2024-09-21T00:56:49.656285+0000","last_undegraded":"2024-09-21T00:56:49.656285+0000","last_fullsized":"2024-09-21T00:56:49.656285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:44.176473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T00:56:49.662877+0000","last_change":"2024-09-21T00:56:46.634428+0000","last_active":"2024-09-21T00:56:49.662877+0000","last_peered":"2024-09-21T00:56:49.662877+0000","last_clean":"2024-09-21T00:56:49.662877+0000","last_became_active":"2024-09-21T00:56:46.634037+0000","last_became_peered":"2024-09-21T00:56:46.634037+0000","last_unstale":"2024-09-21T00:56:49.662877+0000","last_undegraded":"2024-09-21T00:56:49.662877+0000","last_fullsized":"2024-09-21T00:56:49.662877+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:25.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62360,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":45,"num_read_kb":84,"num_write":79,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":187080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743439,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":798720,"data_stored":385163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1478656,"data_stored":1037404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":385745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36132,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709020,"statfs":{"total":95995035648,"available":95958036480,"internally_reserved":0,"allocated":806912,"data_stored":385767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28392,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716760,"statfs":{"total":95995035648,"available":95965962240,"internally_reserved":0,"allocated":1400832,"data_stored":976230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40288,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704864,"statfs":{"total":95995035648,"available":95953780736,"internally_reserved":0,"allocated":802816,"data_stored":385280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":975830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":802816,"data_stored":385185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":385501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":446759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":430366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":802816,"data_stored":385253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:57:14.482 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T00:57:14.483 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T00:57:14.483 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T00:57:14.749 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:14.984 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:14 smithi047 ceph-mon[30960]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T00:57:14.985 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:14 smithi047 ceph-mon[30960]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:15.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:14 smithi134 ceph-mon[34785]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T00:57:15.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:14 smithi134 ceph-mon[34785]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:14 smithi114 ceph-mon[34309]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T00:57:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:14 smithi114 ceph-mon[34309]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 -- 172.21.15.47:0/2199960694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2458102660 msgr2=0x7f2458102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 --2- 172.21.15.47:0/2199960694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2458102660 0x7f2458102ad0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2454009900 tx=0x7f245402a480 comp rx=0 tx=0).stop 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 -- 172.21.15.47:0/2199960694 shutdown_connections 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 --2- 172.21.15.47:0/2199960694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2458104090 0x7f245810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 --2- 172.21.15.47:0/2199960694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24581036f0 0x7f2458103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 --2- 172.21.15.47:0/2199960694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2458102660 0x7f2458102ad0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 -- 172.21.15.47:0/2199960694 >> 172.21.15.47:0/2199960694 conn(0x7f24580fdfd0 msgr2=0x7f2458100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 -- 172.21.15.47:0/2199960694 shutdown_connections 2024-09-21T00:57:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 -- 172.21.15.47:0/2199960694 wait complete. 2024-09-21T00:57:15.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.205+0000 7f2460061640 1 Processor -- start 2024-09-21T00:57:15.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f2460061640 1 -- start start 2024-09-21T00:57:15.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f2460061640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2458102660 0x7f2458199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:15.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f2460061640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24581036f0 0x7f245819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:15.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f2460061640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2458104090 0x7f245819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f2460061640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f245810e280 con 0x7f24581036f0 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f2460061640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f245810e100 con 0x7f2458104090 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f2460061640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f245810e400 con 0x7f2458102660 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24581036f0 0x7f245819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24581036f0 0x7f245819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46374/0 (socket says 172.21.15.47:46374) 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 -- 172.21.15.47:0/4078065527 learned_addr learned my addr 172.21.15.47:0/4078065527 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245ddfd640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2458102660 0x7f2458199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245e5fe640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2458104090 0x7f245819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 -- 172.21.15.47:0/4078065527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2458102660 msgr2=0x7f2458199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2458102660 0x7f2458199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 -- 172.21.15.47:0/4078065527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2458104090 msgr2=0x7f245819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2458104090 0x7f245819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 -- 172.21.15.47:0/4078065527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245819b9e0 con 0x7f24581036f0 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.206+0000 7f245d5fc640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24581036f0 0x7f245819a620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f244800c890 tx=0x7f244800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.207+0000 7f244effd640 1 -- 172.21.15.47:0/4078065527 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448004220 con 0x7f24581036f0 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.207+0000 7f244effd640 1 -- 172.21.15.47:0/4078065527 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24480043c0 con 0x7f24581036f0 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.207+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245819bcd0 con 0x7f24581036f0 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.207+0000 7f244effd640 1 -- 172.21.15.47:0/4078065527 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448004a00 con 0x7f24581036f0 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.207+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24581a23d0 con 0x7f24581036f0 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.208+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24581a25a0 con 0x7f24581036f0 2024-09-21T00:57:15.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.209+0000 7f244effd640 1 -- 172.21.15.47:0/4078065527 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f24480079b0 con 0x7f24581036f0 2024-09-21T00:57:15.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.210+0000 7f244effd640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b65a0 0x7f24440b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:15.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.210+0000 7f245ddfd640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b65a0 0x7f24440b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:15.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.210+0000 7f244effd640 1 -- 172.21.15.47:0/4078065527 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f24480e7470 con 0x7f24581036f0 2024-09-21T00:57:15.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.211+0000 7f245ddfd640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b65a0 0x7f24440b8ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2454000c00 tx=0x7f2454031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:15.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.213+0000 7f244effd640 1 -- 172.21.15.47:0/4078065527 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2448014030 con 0x7f24581036f0 2024-09-21T00:57:15.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.473+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f24581a2810 con 0x7f24581036f0 2024-09-21T00:57:15.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.476+0000 7f244effd640 1 -- 172.21.15.47:0/4078065527 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f24480add50 con 0x7f24581036f0 2024-09-21T00:57:15.476 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-09-21T00:57:15.477 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDrGe5msRZLHBAAXo3HZaRG8lvhb+sUoQkOeA== 2024-09-21T00:57:15.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b65a0 msgr2=0x7f24440b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:15.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b65a0 0x7f24440b8ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2454000c00 tx=0x7f2454031400 comp rx=0 tx=0).stop 2024-09-21T00:57:15.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24581036f0 msgr2=0x7f245819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:15.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24581036f0 0x7f245819a620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f244800c890 tx=0x7f244800cd50 comp rx=0 tx=0).stop 2024-09-21T00:57:15.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 shutdown_connections 2024-09-21T00:57:15.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b65a0 0x7f24440b8ab0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2458104090 0x7f245819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24581036f0 0x7f245819a620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 --2- 172.21.15.47:0/4078065527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2458102660 0x7f2458199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:15.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 >> 172.21.15.47:0/4078065527 conn(0x7f24580fdfd0 msgr2=0x7f245806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:15.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 shutdown_connections 2024-09-21T00:57:15.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:15.478+0000 7f2460061640 1 -- 172.21.15.47:0/4078065527 wait complete. 2024-09-21T00:57:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:15 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4078065527' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:57:16.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:15 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4078065527' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:57:16.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:15 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4078065527' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:57:16.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:15 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4078065527' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:57:16.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:15 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4078065527' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T00:57:16.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:15 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4078065527' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T00:57:16.262 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:57:16.262 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T00:57:16.262 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T00:57:16.304 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T00:57:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:17.004 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:16 smithi047 ceph-mon[30960]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-21T00:57:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:16 smithi134 ceph-mon[34785]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-21T00:57:17.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 -- 172.21.15.47:0/2117012151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 msgr2=0x7f5ac0104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:17.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/2117012151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 0x7f5ac0104e40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009ca0 tx=0x7f5ab002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 -- 172.21.15.47:0/2117012151 shutdown_connections 2024-09-21T00:57:17.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/2117012151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac010de60 0x7f5ac0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/2117012151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ac0105380 0x7f5ac010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/2117012151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 0x7f5ac0104e40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 -- 172.21.15.47:0/2117012151 >> 172.21.15.47:0/2117012151 conn(0x7f5ac00797b0 msgr2=0x7f5ac0079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:17.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 -- 172.21.15.47:0/2117012151 shutdown_connections 2024-09-21T00:57:17.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.097+0000 7f5ac50e2640 1 -- 172.21.15.47:0/2117012151 wait complete. 2024-09-21T00:57:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5ac50e2640 1 Processor -- start 2024-09-21T00:57:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5ac50e2640 1 -- start start 2024-09-21T00:57:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5ac50e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 0x7f5ac019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5ac50e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ac0105380 0x7f5ac019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5ac50e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac010de60 0x7f5ac019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5ac50e2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113ac0 con 0x7f5ac0104a30 2024-09-21T00:57:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5ac50e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113940 con 0x7f5ac010de60 2024-09-21T00:57:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5ac50e2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113c40 con 0x7f5ac0105380 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5abed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 0x7f5ac019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5abed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 0x7f5ac019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46398/0 (socket says 172.21.15.47:46398) 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5abed9d640 1 -- 172.21.15.47:0/1913627216 learned_addr learned my addr 172.21.15.47:0/1913627216 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5abe59c640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ac0105380 0x7f5ac019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.098+0000 7f5abf59e640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac010de60 0x7f5ac019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5abed9d640 1 -- 172.21.15.47:0/1913627216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ac0105380 msgr2=0x7f5ac019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5abed9d640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ac0105380 0x7f5ac019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5abed9d640 1 -- 172.21.15.47:0/1913627216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac010de60 msgr2=0x7f5ac019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5abed9d640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac010de60 0x7f5ac019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5abed9d640 1 -- 172.21.15.47:0/1913627216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac01a0420 con 0x7f5ac0104a30 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5abed9d640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 0x7f5ac019a4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0006010 tx=0x7f5ab00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5aa7fff640 1 -- 172.21.15.47:0/1913627216 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0003bf0 con 0x7f5ac0104a30 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01a06b0 con 0x7f5ac0104a30 2024-09-21T00:57:17.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5aa7fff640 1 -- 172.21.15.47:0/1913627216 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ab0003d90 con 0x7f5ac0104a30 2024-09-21T00:57:17.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5aa7fff640 1 -- 172.21.15.47:0/1913627216 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab002fc20 con 0x7f5ac0104a30 2024-09-21T00:57:17.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.099+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac01a6e70 con 0x7f5ac0104a30 2024-09-21T00:57:17.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.100+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac0104e40 con 0x7f5ac0104a30 2024-09-21T00:57:17.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.102+0000 7f5aa7fff640 1 -- 172.21.15.47:0/1913627216 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5ab00046a0 con 0x7f5ac0104a30 2024-09-21T00:57:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.103+0000 7f5aa7fff640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5aa80b65a0 0x7f5aa80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.103+0000 7f5abe59c640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5aa80b65a0 0x7f5aa80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.103+0000 7f5aa7fff640 1 -- 172.21.15.47:0/1913627216 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f5ab01087a0 con 0x7f5ac0104a30 2024-09-21T00:57:17.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.103+0000 7f5abe59c640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5aa80b65a0 0x7f5aa80b8ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ac007a0a0 tx=0x7f5ab400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:17.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.106+0000 7f5aa7fff640 1 -- 172.21.15.47:0/1913627216 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ab00cf080 con 0x7f5ac0104a30 2024-09-21T00:57:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:16 smithi114 ceph-mon[34309]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-21T00:57:17.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.295+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5ac0108fa0 con 0x7f5ac0104a30 2024-09-21T00:57:17.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.296+0000 7f5aa7fff640 1 -- 172.21.15.47:0/1913627216 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v51) ==== 86+0+133 (secure 0 0 0) 0x7f5ab00d3460 con 0x7f5ac0104a30 2024-09-21T00:57:17.297 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5aa80b65a0 msgr2=0x7f5aa80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5aa80b65a0 0x7f5aa80b8ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ac007a0a0 tx=0x7f5ab400b390 comp rx=0 tx=0).stop 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 msgr2=0x7f5ac019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 0x7f5ac019a4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0006010 tx=0x7f5ab00319f0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 shutdown_connections 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5aa80b65a0 0x7f5aa80b8ab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ac010de60 0x7f5ac019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ac0105380 0x7f5ac019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 --2- 172.21.15.47:0/1913627216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ac0104a30 0x7f5ac019a4b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:17.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 >> 172.21.15.47:0/1913627216 conn(0x7f5ac00797b0 msgr2=0x7f5ac01007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:17.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 shutdown_connections 2024-09-21T00:57:17.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:17.299+0000 7f5ac50e2640 1 -- 172.21.15.47:0/1913627216 wait complete. 2024-09-21T00:57:17.922 INFO:teuthology.orchestra.run.smithi047.stdout:[{"version":51,"timestamp":"2024-09-21T00:56:39.562328+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T00:57:17.922 INFO:tasks.ceph_manager:config epoch is 51 2024-09-21T00:57:17.923 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T00:57:17.923 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T00:57:17.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T00:57:18.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:17 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1913627216' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:57:18.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:17 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1913627216' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:57:18.181 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:18.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:17 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1913627216' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T00:57:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 -- 172.21.15.47:0/75082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa810de20 msgr2=0x7fdfa8110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/75082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa810de20 0x7fdfa8110310 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009ca0 tx=0x7fdfa002a8e0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 -- 172.21.15.47:0/75082 shutdown_connections 2024-09-21T00:57:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/75082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa810de20 0x7fdfa8110310 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/75082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa8105310 0x7fdfa810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/75082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa81049c0 0x7fdfa8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 -- 172.21.15.47:0/75082 >> 172.21.15.47:0/75082 conn(0x7fdfa8079710 msgr2=0x7fdfa8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 -- 172.21.15.47:0/75082 shutdown_connections 2024-09-21T00:57:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.629+0000 7fdfaf28a640 1 -- 172.21.15.47:0/75082 wait complete. 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfaf28a640 1 Processor -- start 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfaf28a640 1 -- start start 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfaf28a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa81049c0 0x7fdfa819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfaf28a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8105310 0x7fdfa819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfaf28a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa810de20 0x7fdfa819fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfaf28a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa8113b60 con 0x7fdfa81049c0 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfaf28a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa81139e0 con 0x7fdfa810de20 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfaf28a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa8113ce0 con 0x7fdfa8105310 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.630+0000 7fdfad026640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa81049c0 0x7fdfa819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad026640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa81049c0 0x7fdfa819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46414/0 (socket says 172.21.15.47:46414) 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad026640 1 -- 172.21.15.47:0/1772037186 learned_addr learned my addr 172.21.15.47:0/1772037186 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad827640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa810de20 0x7fdfa819fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfac825640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8105310 0x7fdfa819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad026640 1 -- 172.21.15.47:0/1772037186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8105310 msgr2=0x7fdfa819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad026640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8105310 0x7fdfa819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad026640 1 -- 172.21.15.47:0/1772037186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa810de20 msgr2=0x7fdfa819fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad026640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa810de20 0x7fdfa819fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad026640 1 -- 172.21.15.47:0/1772037186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa81a0540 con 0x7fdfa81049c0 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfad026640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa81049c0 0x7fdfa819a5d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400b4a0 tx=0x7fdfa400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdf9e7fc640 1 -- 172.21.15.47:0/1772037186 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4014070 con 0x7fdfa81049c0 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa81a0830 con 0x7fdfa81049c0 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdf9e7fc640 1 -- 172.21.15.47:0/1772037186 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfa4010ac0 con 0x7fdfa81049c0 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdf9e7fc640 1 -- 172.21.15.47:0/1772037186 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4017c30 con 0x7fdfa81049c0 2024-09-21T00:57:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.631+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa81a6f90 con 0x7fdfa81049c0 2024-09-21T00:57:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.632+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa806c280 con 0x7fdfa81049c0 2024-09-21T00:57:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.634+0000 7fdf9e7fc640 1 -- 172.21.15.47:0/1772037186 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fdfa4017070 con 0x7fdfa81049c0 2024-09-21T00:57:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.635+0000 7fdf9e7fc640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf940b65a0 0x7fdf940b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:18.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.635+0000 7fdfac825640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf940b65a0 0x7fdf940b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:18.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.635+0000 7fdf9e7fc640 1 -- 172.21.15.47:0/1772037186 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fdfa40e6900 con 0x7fdfa81049c0 2024-09-21T00:57:18.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.635+0000 7fdfac825640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf940b65a0 0x7fdf940b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdfa810fbd0 tx=0x7fdf98008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.638+0000 7fdf9e7fc640 1 -- 172.21.15.47:0/1772037186 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfa40ad1e0 con 0x7fdfa81049c0 2024-09-21T00:57:18.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.874+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdfa8104e50 con 0x7fdfa81049c0 2024-09-21T00:57:18.875 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:18 smithi047 ceph-mon[30960]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-21T00:57:18.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.880+0000 7fdf9e7fc640 1 -- 172.21.15.47:0/1772037186 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) ==== 74+0+296435 (secure 0 0 0) 0x7fdfa40b15c0 con 0x7fdfa81049c0 2024-09-21T00:57:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf940b65a0 msgr2=0x7fdf940b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf940b65a0 0x7fdf940b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdfa810fbd0 tx=0x7fdf98008040 comp rx=0 tx=0).stop 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa81049c0 msgr2=0x7fdfa819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa81049c0 0x7fdfa819a5d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400b4a0 tx=0x7fdfa400b960 comp rx=0 tx=0).stop 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 shutdown_connections 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdf940b65a0 0x7fdf940b8ab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa810de20 0x7fdfa819fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8105310 0x7fdfa819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 --2- 172.21.15.47:0/1772037186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfa81049c0 0x7fdfa819a5d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 >> 172.21.15.47:0/1772037186 conn(0x7fdfa8079710 msgr2=0x7fdfa8106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 shutdown_connections 2024-09-21T00:57:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:18.883+0000 7fdfaf28a640 1 -- 172.21.15.47:0/1772037186 wait complete. 2024-09-21T00:57:19.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:18 smithi134 ceph-mon[34785]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-21T00:57:19.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:18 smithi114 ceph-mon[34309]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-21T00:57:19.531 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":18,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2364161608},{"type":"v1","addr":"172.21.15.47:6801","nonce":2364161608}]},"active_addr":"172.21.15.47:6801/2364161608","active_change":"2024-09-21T00:49:25.158032+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24124,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24134,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.47:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3055298638}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2955153405}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":494016281}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":159171098}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":429255073}]}]} 2024-09-21T00:57:19.536 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T00:57:19.536 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T00:57:19.537 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:57:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:19.915 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:19 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1772037186' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:57:20.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:19 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1772037186' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:57:20.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:19 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1772037186' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 -- 172.21.15.47:0/2160290486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac103210 msgr2=0x7fb3ac103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/2160290486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac103210 0x7fb3ac103620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009900 tx=0x7fb39c02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 -- 172.21.15.47:0/2160290486 shutdown_connections 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/2160290486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac105b70 0x7fb3ac10f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/2160290486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac105220 0x7fb3ac105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/2160290486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac103210 0x7fb3ac103620 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 -- 172.21.15.47:0/2160290486 >> 172.21.15.47:0/2160290486 conn(0x7fb3ac079ec0 msgr2=0x7fb3ac07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 -- 172.21.15.47:0/2160290486 shutdown_connections 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.255+0000 7fb3b0aab640 1 -- 172.21.15.47:0/2160290486 wait complete. 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.256+0000 7fb3b0aab640 1 Processor -- start 2024-09-21T00:57:20.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.256+0000 7fb3b0aab640 1 -- start start 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3b0aab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac103210 0x7fb3ac1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3b0aab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac105220 0x7fb3ac199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3b0aab640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac105b70 0x7fb3ac19ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3b0aab640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac112a70 con 0x7fb3ac105b70 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3b0aab640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1128f0 con 0x7fb3ac105220 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3b0aab640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac112bf0 con 0x7fb3ac103210 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac105b70 0x7fb3ac19ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac105b70 0x7fb3ac19ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46424/0 (socket says 172.21.15.47:46424) 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 -- 172.21.15.47:0/3512662016 learned_addr learned my addr 172.21.15.47:0/3512662016 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aa59c640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac103210 0x7fb3ac1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3a9d9b640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac105220 0x7fb3ac199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 -- 172.21.15.47:0/3512662016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac103210 msgr2=0x7fb3ac1995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac103210 0x7fb3ac1995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 -- 172.21.15.47:0/3512662016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac105220 msgr2=0x7fb3ac199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac105220 0x7fb3ac199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 -- 172.21.15.47:0/3512662016 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac19f530 con 0x7fb3ac105b70 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb3aad9d640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac105b70 0x7fb3ac19ee00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400eaa0 tx=0x7fb3a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.257+0000 7fb39b7fe640 1 -- 172.21.15.47:0/3512662016 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a400cdb0 con 0x7fb3ac105b70 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.258+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac19f820 con 0x7fb3ac105b70 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.258+0000 7fb39b7fe640 1 -- 172.21.15.47:0/3512662016 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3a4005020 con 0x7fb3ac105b70 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.258+0000 7fb39b7fe640 1 -- 172.21.15.47:0/3512662016 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40116d0 con 0x7fb3ac105b70 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.258+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac1a5f80 con 0x7fb3ac105b70 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.259+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ac103620 con 0x7fb3ac105b70 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.260+0000 7fb39b7fe640 1 -- 172.21.15.47:0/3512662016 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fb3a40051d0 con 0x7fb3ac105b70 2024-09-21T00:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.261+0000 7fb39b7fe640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3940b65a0 0x7fb3940b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:20.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.261+0000 7fb3aa59c640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3940b65a0 0x7fb3940b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:20.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.261+0000 7fb39b7fe640 1 -- 172.21.15.47:0/3512662016 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fb3a40e7770 con 0x7fb3ac105b70 2024-09-21T00:57:20.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.261+0000 7fb3aa59c640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3940b65a0 0x7fb3940b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb39c031440 tx=0x7fb39c009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:20.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.264+0000 7fb39b7fe640 1 -- 172.21.15.47:0/3512662016 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3a4016030 con 0x7fb3ac105b70 2024-09-21T00:57:20.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.454+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3ac19a6f0 con 0x7fb3ac105b70 2024-09-21T00:57:20.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.455+0000 7fb39b7fe640 1 -- 172.21.15.47:0/3512662016 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22293 (secure 0 0 0) 0x7fb3a40b2430 con 0x7fb3ac105b70 2024-09-21T00:57:20.456 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:20.456 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:56:49.242027+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:57:20.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3940b65a0 msgr2=0x7fb3940b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:20.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3940b65a0 0x7fb3940b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb39c031440 tx=0x7fb39c009560 comp rx=0 tx=0).stop 2024-09-21T00:57:20.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac105b70 msgr2=0x7fb3ac19ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:20.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac105b70 0x7fb3ac19ee00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400eaa0 tx=0x7fb3a400ef60 comp rx=0 tx=0).stop 2024-09-21T00:57:20.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 shutdown_connections 2024-09-21T00:57:20.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3940b65a0 0x7fb3940b8ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3ac105b70 0x7fb3ac19ee00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac105220 0x7fb3ac199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 --2- 172.21.15.47:0/3512662016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ac103210 0x7fb3ac1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:20.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 >> 172.21.15.47:0/3512662016 conn(0x7fb3ac079ec0 msgr2=0x7fb3ac1074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:20.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 shutdown_connections 2024-09-21T00:57:20.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:20.458+0000 7fb3b0aab640 1 -- 172.21.15.47:0/3512662016 wait complete. 2024-09-21T00:57:21.068 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:20 smithi047 ceph-mon[30960]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T00:57:21.068 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:20 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3512662016' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:21.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:20 smithi134 ceph-mon[34785]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T00:57:21.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:20 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3512662016' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:21.097 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T00:57:21.097 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:57:21.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:20 smithi114 ceph-mon[34309]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T00:57:21.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:20 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3512662016' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:21.356 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.795+0000 7fd456f7b640 1 -- 172.21.15.47:0/2943789564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4501083d0 msgr2=0x7fd4501087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.795+0000 7fd456f7b640 1 --2- 172.21.15.47:0/2943789564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4501083d0 0x7fd4501087e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009900 tx=0x7fd43c02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.795+0000 7fd456f7b640 1 -- 172.21.15.47:0/2943789564 shutdown_connections 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.795+0000 7fd456f7b640 1 --2- 172.21.15.47:0/2943789564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd450108d20 0x7fd45010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.795+0000 7fd456f7b640 1 --2- 172.21.15.47:0/2943789564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4501083d0 0x7fd4501087e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.795+0000 7fd456f7b640 1 --2- 172.21.15.47:0/2943789564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd450102ae0 0x7fd450102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.795+0000 7fd456f7b640 1 -- 172.21.15.47:0/2943789564 >> 172.21.15.47:0/2943789564 conn(0x7fd450079760 msgr2=0x7fd450079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.796+0000 7fd456f7b640 1 -- 172.21.15.47:0/2943789564 shutdown_connections 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.796+0000 7fd456f7b640 1 -- 172.21.15.47:0/2943789564 wait complete. 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.796+0000 7fd456f7b640 1 Processor -- start 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd456f7b640 1 -- start start 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd456f7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd450102ae0 0x7fd45010ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd456f7b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4501083d0 0x7fd450110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd456f7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd450108d20 0x7fd450110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd456f7b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd450113ad0 con 0x7fd450108d20 2024-09-21T00:57:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd456f7b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd450113950 con 0x7fd450102ae0 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd456f7b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd450113c50 con 0x7fd4501083d0 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd454d17640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd450102ae0 0x7fd45010ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd455518640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd450108d20 0x7fd450110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd454d17640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd450102ae0 0x7fd45010ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56632/0 (socket says 172.21.15.47:56632) 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd454d17640 1 -- 172.21.15.47:0/959848862 learned_addr learned my addr 172.21.15.47:0/959848862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd44ffff640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4501083d0 0x7fd450110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd455518640 1 -- 172.21.15.47:0/959848862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4501083d0 msgr2=0x7fd450110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd455518640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4501083d0 0x7fd450110520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd455518640 1 -- 172.21.15.47:0/959848862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd450102ae0 msgr2=0x7fd45010ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd455518640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd450102ae0 0x7fd45010ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd455518640 1 -- 172.21.15.47:0/959848862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4501a87e0 con 0x7fd450108d20 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.797+0000 7fd454d17640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd450102ae0 0x7fd45010ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.798+0000 7fd455518640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd450108d20 0x7fd450110a60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd44800be20 tx=0x7fd44800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.798+0000 7fd44dffb640 1 -- 172.21.15.47:0/959848862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448019070 con 0x7fd450108d20 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.798+0000 7fd44dffb640 1 -- 172.21.15.47:0/959848862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4480148f0 con 0x7fd450108d20 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.798+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4501a8ad0 con 0x7fd450108d20 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.798+0000 7fd44dffb640 1 -- 172.21.15.47:0/959848862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448012840 con 0x7fd450108d20 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.798+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4501a9060 con 0x7fd450108d20 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.799+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd450103d10 con 0x7fd450108d20 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.801+0000 7fd44dffb640 1 -- 172.21.15.47:0/959848862 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fd44801c070 con 0x7fd450108d20 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.802+0000 7fd44dffb640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd4400b6620 0x7fd4400b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.802+0000 7fd454d17640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd4400b6620 0x7fd4400b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.802+0000 7fd44dffb640 1 -- 172.21.15.47:0/959848862 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7fd4480e6df0 con 0x7fd450108d20 2024-09-21T00:57:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.802+0000 7fd454d17640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd4400b6620 0x7fd4400b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd444005fd0 tx=0x7fd44400b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.806+0000 7fd44dffb640 1 -- 172.21.15.47:0/959848862 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4480b1ab0 con 0x7fd450108d20 2024-09-21T00:57:21.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.994+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd450102ef0 con 0x7fd450108d20 2024-09-21T00:57:21.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.996+0000 7fd44dffb640 1 -- 172.21.15.47:0/959848862 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22293 (secure 0 0 0) 0x7fd450102ef0 con 0x7fd450108d20 2024-09-21T00:57:21.997 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:21.997 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":75,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:56:49.242027+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd4400b6620 msgr2=0x7fd4400b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd4400b6620 0x7fd4400b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd444005fd0 tx=0x7fd44400b480 comp rx=0 tx=0).stop 2024-09-21T00:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd450108d20 msgr2=0x7fd450110a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd450108d20 0x7fd450110a60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd44800be20 tx=0x7fd44800bf10 comp rx=0 tx=0).stop 2024-09-21T00:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 shutdown_connections 2024-09-21T00:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd4400b6620 0x7fd4400b8b30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd450108d20 0x7fd450110a60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4501083d0 0x7fd450110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:22.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 --2- 172.21.15.47:0/959848862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd450102ae0 0x7fd45010ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:22.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 >> 172.21.15.47:0/959848862 conn(0x7fd450079760 msgr2=0x7fd450104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:22.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 shutdown_connections 2024-09-21T00:57:22.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:21.998+0000 7fd456f7b640 1 -- 172.21.15.47:0/959848862 wait complete. 2024-09-21T00:57:22.715 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T00:57:22.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T00:57:22.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T00:57:22.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T00:57:22.717 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T00:57:22.717 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T00:57:22.718 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T00:57:22.718 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T00:57:22.719 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T00:57:22.719 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T00:57:22.719 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T00:57:22.720 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T00:57:22.756 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:22 smithi047 ceph-mon[30960]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T00:57:22.756 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:22 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/959848862' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:23.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:22 smithi134 ceph-mon[34785]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T00:57:23.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:22 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/959848862' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:23.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:22 smithi114 ceph-mon[34309]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T00:57:23.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:22 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/959848862' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:57:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:23.431 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:23.788 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:23.789 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 -- 172.21.15.47:0/2949423801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d010de70 msgr2=0x7f00d0110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 --2- 172.21.15.47:0/2949423801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d010de70 0x7f00d0110340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009ca0 tx=0x7f00c802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 -- 172.21.15.47:0/2949423801 shutdown_connections 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 --2- 172.21.15.47:0/2949423801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d010de70 0x7f00d0110340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 --2- 172.21.15.47:0/2949423801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d01052a0 0x7f00d010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 --2- 172.21.15.47:0/2949423801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d01048c0 0x7f00d0104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 -- 172.21.15.47:0/2949423801 >> 172.21.15.47:0/2949423801 conn(0x7f00d0079760 msgr2=0x7f00d0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 -- 172.21.15.47:0/2949423801 shutdown_connections 2024-09-21T00:57:24.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.300+0000 7f00d487b640 1 -- 172.21.15.47:0/2949423801 wait complete. 2024-09-21T00:57:24.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00d487b640 1 Processor -- start 2024-09-21T00:57:24.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00d487b640 1 -- start start 2024-09-21T00:57:24.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00d487b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d01048c0 0x7f00d019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00d487b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01052a0 0x7f00d019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00d487b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d010de70 0x7f00d019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00d487b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0113ab0 con 0x7f00d01052a0 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00d487b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0113930 con 0x7f00d010de70 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00d487b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0113c30 con 0x7f00d01048c0 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00cdd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01052a0 0x7f00d019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00cdd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01052a0 0x7f00d019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40068/0 (socket says 172.21.15.47:40068) 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00cdd9b640 1 -- 172.21.15.47:0/2480488172 learned_addr learned my addr 172.21.15.47:0/2480488172 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.301+0000 7f00ced9d640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d010de70 0x7f00d019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00cdd9b640 1 -- 172.21.15.47:0/2480488172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d01048c0 msgr2=0x7f00d019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00cdd9b640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00d01048c0 0x7f00d019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00cdd9b640 1 -- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d010de70 msgr2=0x7f00d019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00cdd9b640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d010de70 0x7f00d019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00cdd9b640 1 -- 172.21.15.47:0/2480488172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d01a0270 con 0x7f00d01052a0 2024-09-21T00:57:24.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00ced9d640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00d010de70 0x7f00d019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:24.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00cdd9b640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01052a0 0x7f00d019a960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c8c0 tx=0x7f00c400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:24.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4007bb0 con 0x7f00d01052a0 2024-09-21T00:57:24.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d01a0560 con 0x7f00d01052a0 2024-09-21T00:57:24.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00c4007d50 con 0x7f00d01052a0 2024-09-21T00:57:24.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c40187c0 con 0x7f00d01052a0 2024-09-21T00:57:24.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.302+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d01a6d80 con 0x7f00d01052a0 2024-09-21T00:57:24.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.303+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00d0108310 con 0x7f00d01052a0 2024-09-21T00:57:24.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.305+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f00c400fa20 con 0x7f00d01052a0 2024-09-21T00:57:24.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.306+0000 7f00bf7fe640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00b80b65d0 0x7f00b80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.306+0000 7f00ce59c640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00b80b65d0 0x7f00b80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.306+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f00c40e78b0 con 0x7f00d01052a0 2024-09-21T00:57:24.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.306+0000 7f00bf7fe640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] conn(0x7f00b80bfd60 0x7f00b80c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.306+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 --> [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00c4011ec0 con 0x7f00b80bfd60 2024-09-21T00:57:24.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.306+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f00c40e7d90 con 0x7f00d01052a0 2024-09-21T00:57:24.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.307+0000 7f00ce59c640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00b80b65d0 0x7f00b80b8ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f00d006c890 tx=0x7f00c0005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:24.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.307+0000 7f00ced9d640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] conn(0x7f00b80bfd60 0x7f00b80c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.307+0000 7f00ced9d640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] conn(0x7f00b80bfd60 0x7f00b80c21b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:24.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.308+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 <== osd.4 v2:172.21.15.114:6808/3945171658 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00c4011ec0 con 0x7f00b80bfd60 2024-09-21T00:57:24.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 --> [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00d006b350 con 0x7f00b80bfd60 2024-09-21T00:57:24.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00bf7fe640 1 -- 172.21.15.47:0/2480488172 <== osd.4 v2:172.21.15.114:6808/3945171658 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f00d006b350 con 0x7f00b80bfd60 2024-09-21T00:57:24.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] conn(0x7f00b80bfd60 msgr2=0x7f00b80c21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] conn(0x7f00b80bfd60 0x7f00b80c21b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00b80b65d0 msgr2=0x7f00b80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f00b80b65d0 0x7f00b80b8ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f00d006c890 tx=0x7f00c0005c90 comp rx=0 tx=0).stop 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01052a0 msgr2=0x7f00d019a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 --2- 172.21.15.47:0/2480488172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01052a0 0x7f00d019a960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c8c0 tx=0x7f00c400cd80 comp rx=0 tx=0).stop 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00ced9d640 1 -- 172.21.15.47:0/2480488172 reap_dead start 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 shutdown_connections 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.322+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 >> 172.21.15.47:0/2480488172 conn(0x7f00d0079760 msgr2=0x7f00d0107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.323+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 shutdown_connections 2024-09-21T00:57:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.323+0000 7f00d487b640 1 -- 172.21.15.47:0/2480488172 wait complete. 2024-09-21T00:57:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 -- 172.21.15.47:0/2017028958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 msgr2=0x7f7e98110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 --2- 172.21.15.47:0/2017028958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 0x7f7e98110620 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009ca0 tx=0x7f7e9002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 -- 172.21.15.47:0/2017028958 shutdown_connections 2024-09-21T00:57:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 --2- 172.21.15.47:0/2017028958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 0x7f7e98110620 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 --2- 172.21.15.47:0/2017028958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e981094a0 0x7f7e981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 --2- 172.21.15.47:0/2017028958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e98103b60 0x7f7e98103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 -- 172.21.15.47:0/2017028958 >> 172.21.15.47:0/2017028958 conn(0x7f7e9807b850 msgr2=0x7f7e9807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 -- 172.21.15.47:0/2017028958 shutdown_connections 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.803+0000 7f7e9e03a640 1 -- 172.21.15.47:0/2017028958 wait complete. 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.804+0000 7f7e9e03a640 1 Processor -- start 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.804+0000 7f7e9e03a640 1 -- start start 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e9e03a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e98103b60 0x7f7e9819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e9e03a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e981094a0 0x7f7e9819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e9e03a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 0x7f7e9819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e9e03a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98113ab0 con 0x7f7e98109df0 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e9e03a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98113930 con 0x7f7e981094a0 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e9e03a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98113c30 con 0x7f7e98103b60 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 0x7f7e9819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 0x7f7e9819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40084/0 (socket says 172.21.15.47:40084) 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 -- 172.21.15.47:0/231558087 learned_addr learned my addr 172.21.15.47:0/231558087 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:24.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e96ffd640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e981094a0 0x7f7e9819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e977fe640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e98103b60 0x7f7e9819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 -- 172.21.15.47:0/231558087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e98103b60 msgr2=0x7f7e9819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e98103b60 0x7f7e9819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 -- 172.21.15.47:0/231558087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e981094a0 msgr2=0x7f7e9819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e981094a0 0x7f7e9819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 -- 172.21.15.47:0/231558087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e981a03b0 con 0x7f7e98109df0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.805+0000 7f7e97fff640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 0x7f7e9819fc80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7e90005cc0 tx=0x7f7e9002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.806+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90003bf0 con 0x7f7e98109df0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.806+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e981a0640 con 0x7f7e98109df0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.806+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e90003d90 con 0x7f7e98109df0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.806+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9002fbc0 con 0x7f7e98109df0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.806+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e981a6e00 con 0x7f7e98109df0 2024-09-21T00:57:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.807+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e98063b50 con 0x7f7e98109df0 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.808+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f7e9002fd60 con 0x7f7e98109df0 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.809+0000 7f7e94ff9640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7e800b65a0 0x7f7e800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.809+0000 7f7e977fe640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7e800b65a0 0x7f7e800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.809+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f7e901088e0 con 0x7f7e98109df0 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.809+0000 7f7e94ff9640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] conn(0x7f7e800bfd30 0x7f7e800c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.809+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 --> [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e800c2850 con 0x7f7e800bfd30 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.809+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f7e90108dc0 con 0x7f7e98109df0 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.810+0000 7f7e977fe640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7e800b65a0 0x7f7e800b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800bbe0 tx=0x7f7e8800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.810+0000 7f7e96ffd640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] conn(0x7f7e800bfd30 0x7f7e800c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.810+0000 7f7e96ffd640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] conn(0x7f7e800bfd30 0x7f7e800c2180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.811+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 <== osd.1 v2:172.21.15.114:6800/2077637956 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e800c2850 con 0x7f7e800bfd30 2024-09-21T00:57:24.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.825+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 --> [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e98063f50 con 0x7f7e800bfd30 2024-09-21T00:57:24.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.825+0000 7f7e94ff9640 1 -- 172.21.15.47:0/231558087 <== osd.1 v2:172.21.15.114:6800/2077637956 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7e98063f50 con 0x7f7e800bfd30 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 >> [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] conn(0x7f7e800bfd30 msgr2=0x7f7e800c2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] conn(0x7f7e800bfd30 0x7f7e800c2180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7e800b65a0 msgr2=0x7f7e800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7e800b65a0 0x7f7e800b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800bbe0 tx=0x7f7e8800b390 comp rx=0 tx=0).stop 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 msgr2=0x7f7e9819fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 --2- 172.21.15.47:0/231558087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e98109df0 0x7f7e9819fc80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7e90005cc0 tx=0x7f7e9002f380 comp rx=0 tx=0).stop 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e97fff640 1 -- 172.21.15.47:0/231558087 reap_dead start 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 shutdown_connections 2024-09-21T00:57:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 >> 172.21.15.47:0/231558087 conn(0x7f7e9807b850 msgr2=0x7f7e981074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:24.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 shutdown_connections 2024-09-21T00:57:24.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:24.826+0000 7f7e9e03a640 1 -- 172.21.15.47:0/231558087 wait complete. 2024-09-21T00:57:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:24 smithi134 ceph-mon[34785]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-09-21T00:57:25.145 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:24 smithi047 ceph-mon[30960]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-09-21T00:57:25.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:24 smithi114 ceph-mon[34309]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-09-21T00:57:25.345 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:25.348 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:25.349 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:25.349 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:25.350 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:25.351 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:25.355 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 -- 172.21.15.47:0/963868635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b81094d0 msgr2=0x7f13b81098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 --2- 172.21.15.47:0/963868635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b81094d0 0x7f13b81098e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009900 tx=0x7f13ac02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 -- 172.21.15.47:0/963868635 shutdown_connections 2024-09-21T00:57:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 --2- 172.21.15.47:0/963868635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b8109e20 0x7f13b8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 --2- 172.21.15.47:0/963868635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b81094d0 0x7f13b81098e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 --2- 172.21.15.47:0/963868635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13b8103b90 0x7f13b8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 -- 172.21.15.47:0/963868635 >> 172.21.15.47:0/963868635 conn(0x7f13b80ff600 msgr2=0x7f13b8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:25.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 -- 172.21.15.47:0/963868635 shutdown_connections 2024-09-21T00:57:25.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.570+0000 7f13bdb63640 1 -- 172.21.15.47:0/963868635 wait complete. 2024-09-21T00:57:25.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13bdb63640 1 Processor -- start 2024-09-21T00:57:25.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13bdb63640 1 -- start start 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13bdb63640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b8103b90 0x7f13b819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13bdb63640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13b81094d0 0x7f13b819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13bdb63640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b8109e20 0x7f13b81a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13bdb63640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f13b8077250 con 0x7f13b8103b90 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13bdb63640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f13b80770d0 con 0x7f13b8109e20 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13bdb63640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13b80773d0 con 0x7f13b81094d0 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13b77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b8103b90 0x7f13b819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13b77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b8103b90 0x7f13b819c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40104/0 (socket says 172.21.15.47:40104) 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13b77fe640 1 -- 172.21.15.47:0/2129554820 learned_addr learned my addr 172.21.15.47:0/2129554820 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.571+0000 7f13b7fff640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b8109e20 0x7f13b81a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b6ffd640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13b81094d0 0x7f13b819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b77fe640 1 -- 172.21.15.47:0/2129554820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13b81094d0 msgr2=0x7f13b819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b77fe640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13b81094d0 0x7f13b819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b77fe640 1 -- 172.21.15.47:0/2129554820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b8109e20 msgr2=0x7f13b81a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b77fe640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b8109e20 0x7f13b81a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b77fe640 1 -- 172.21.15.47:0/2129554820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b81a25d0 con 0x7f13b8103b90 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b7fff640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13b8109e20 0x7f13b81a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b77fe640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b8103b90 0x7f13b819c660 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13a800e9f0 tx=0x7f13a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a800cd80 con 0x7f13b8103b90 2024-09-21T00:57:25.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13a80108e0 con 0x7f13b8103b90 2024-09-21T00:57:25.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b81a28c0 con 0x7f13b8103b90 2024-09-21T00:57:25.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.572+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8018980 con 0x7f13b8103b90 2024-09-21T00:57:25.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.573+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b81a9020 con 0x7f13b8103b90 2024-09-21T00:57:25.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.573+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13b8063b10 con 0x7f13b8103b90 2024-09-21T00:57:25.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.576+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f13a8010430 con 0x7f13b8103b90 2024-09-21T00:57:25.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.577+0000 7f13b4ff9640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f13a00b65a0 0x7f13a00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.577+0000 7f13b6ffd640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f13a00b65a0 0x7f13a00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.577+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7979+0+0 (secure 0 0 0) 0x7f13a80e82a0 con 0x7f13b8103b90 2024-09-21T00:57:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.577+0000 7f13b4ff9640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] conn(0x7f13a00bfd30 0x7f13a00c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.577+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 --> [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13a8019ec0 con 0x7f13a00bfd30 2024-09-21T00:57:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.577+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f13a80e8650 con 0x7f13b8103b90 2024-09-21T00:57:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.577+0000 7f13b6ffd640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f13a00b65a0 0x7f13a00b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13ac02aa00 tx=0x7f13ac005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:25.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.577+0000 7f13b7fff640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] conn(0x7f13a00bfd30 0x7f13a00c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.578+0000 7f13b7fff640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] conn(0x7f13a00bfd30 0x7f13a00c2180 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:25.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.579+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 <== osd.11 v2:172.21.15.134:6824/1422408215 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f13a8019ec0 con 0x7f13a00bfd30 2024-09-21T00:57:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.593+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 --> [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f13b8063f10 con 0x7f13a00bfd30 2024-09-21T00:57:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.593+0000 7f13b4ff9640 1 -- 172.21.15.47:0/2129554820 <== osd.11 v2:172.21.15.134:6824/1422408215 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f13b8063f10 con 0x7f13a00bfd30 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.593+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 >> [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] conn(0x7f13a00bfd30 msgr2=0x7f13a00c2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] conn(0x7f13a00bfd30 0x7f13a00c2180 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f13a00b65a0 msgr2=0x7f13a00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f13a00b65a0 0x7f13a00b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13ac02aa00 tx=0x7f13ac005a20 comp rx=0 tx=0).stop 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b8103b90 msgr2=0x7f13b819c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 --2- 172.21.15.47:0/2129554820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13b8103b90 0x7f13b819c660 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13a800e9f0 tx=0x7f13a800eeb0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13b7fff640 1 -- 172.21.15.47:0/2129554820 reap_dead start 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 shutdown_connections 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 >> 172.21.15.47:0/2129554820 conn(0x7f13b80ff600 msgr2=0x7f13b8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 shutdown_connections 2024-09-21T00:57:25.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.594+0000 7f13bdb63640 1 -- 172.21.15.47:0/2129554820 wait complete. 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 -- 172.21.15.47:0/3075933164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa701094c0 msgr2=0x7faa701098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 --2- 172.21.15.47:0/3075933164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa701094c0 0x7faa701098d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faa58009900 tx=0x7faa5802a410 comp rx=0 tx=0).stop 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 -- 172.21.15.47:0/3075933164 shutdown_connections 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 --2- 172.21.15.47:0/3075933164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa70109e10 0x7faa70110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 --2- 172.21.15.47:0/3075933164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa701094c0 0x7faa701098d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 --2- 172.21.15.47:0/3075933164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa70103b80 0x7faa70103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 -- 172.21.15.47:0/3075933164 >> 172.21.15.47:0/3075933164 conn(0x7faa700ff5d0 msgr2=0x7faa70101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 -- 172.21.15.47:0/3075933164 shutdown_connections 2024-09-21T00:57:25.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 -- 172.21.15.47:0/3075933164 wait complete. 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.870+0000 7faa758c9640 1 Processor -- start 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa758c9640 1 -- start start 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa758c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa70103b80 0x7faa70075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa758c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa701094c0 0x7faa70075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa758c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa70109e10 0x7faa70076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa758c9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa70113ad0 con 0x7faa70103b80 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa758c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa70113950 con 0x7faa701094c0 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa758c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa70113c50 con 0x7faa70109e10 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa70103b80 0x7faa70075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa70103b80 0x7faa70075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40124/0 (socket says 172.21.15.47:40124) 2024-09-21T00:57:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6effd640 1 -- 172.21.15.47:0/215882560 learned_addr learned my addr 172.21.15.47:0/215882560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6e7fc640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa701094c0 0x7faa70075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6f7fe640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa70109e10 0x7faa70076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6effd640 1 -- 172.21.15.47:0/215882560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa70109e10 msgr2=0x7faa70076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6effd640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa70109e10 0x7faa70076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6effd640 1 -- 172.21.15.47:0/215882560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa701094c0 msgr2=0x7faa70075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6effd640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa701094c0 0x7faa70075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.871+0000 7faa6effd640 1 -- 172.21.15.47:0/215882560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa701a8780 con 0x7faa70103b80 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.872+0000 7faa6effd640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa70103b80 0x7faa70075710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faa6000d950 tx=0x7faa6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.872+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60017030 con 0x7faa70103b80 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.872+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa60004020 con 0x7faa70103b80 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.872+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa701a8a70 con 0x7faa70103b80 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.872+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600047a0 con 0x7faa70103b80 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.872+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa701a8fd0 con 0x7faa70103b80 2024-09-21T00:57:25.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.873+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa70063b50 con 0x7faa70103b80 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.875+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7faa60009a30 con 0x7faa70103b80 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.875+0000 7faa748c7640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa5c0b6620 0x7faa5c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.876+0000 7faa6e7fc640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa5c0b6620 0x7faa5c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.876+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8153+0+0 (secure 0 0 0) 0x7faa600e7780 con 0x7faa70103b80 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.876+0000 7faa748c7640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] conn(0x7faa5c0c0010 0x7faa5c0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.876+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 --> [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa600056a0 con 0x7faa5c0c0010 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.876+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7faa600e7c60 con 0x7faa70103b80 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.876+0000 7faa6e7fc640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa5c0b6620 0x7faa5c0b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa58009230 tx=0x7faa58031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:25.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.876+0000 7faa6f7fe640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] conn(0x7faa5c0c0010 0x7faa5c0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:25.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.877+0000 7faa6f7fe640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] conn(0x7faa5c0c0010 0x7faa5c0c2500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:25.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.878+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 <== osd.8 v2:172.21.15.134:6816/690122230 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa600056a0 con 0x7faa5c0c0010 2024-09-21T00:57:25.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.893+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 --> [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa70063f50 con 0x7faa5c0c0010 2024-09-21T00:57:25.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.894+0000 7faa748c7640 1 -- 172.21.15.47:0/215882560 <== osd.8 v2:172.21.15.134:6816/690122230 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faa70063f50 con 0x7faa5c0c0010 2024-09-21T00:57:25.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.894+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 >> [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] conn(0x7faa5c0c0010 msgr2=0x7faa5c0c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.894+0000 7faa758c9640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] conn(0x7faa5c0c0010 0x7faa5c0c2500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:25.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.894+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa5c0b6620 msgr2=0x7faa5c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.894+0000 7faa758c9640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa5c0b6620 0x7faa5c0b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa58009230 tx=0x7faa58031400 comp rx=0 tx=0).stop 2024-09-21T00:57:25.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.894+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa70103b80 msgr2=0x7faa70075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:25.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.894+0000 7faa758c9640 1 --2- 172.21.15.47:0/215882560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa70103b80 0x7faa70075710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faa6000d950 tx=0x7faa6000de10 comp rx=0 tx=0).stop 2024-09-21T00:57:25.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.895+0000 7faa6f7fe640 1 -- 172.21.15.47:0/215882560 reap_dead start 2024-09-21T00:57:25.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.895+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 shutdown_connections 2024-09-21T00:57:25.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.895+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 >> 172.21.15.47:0/215882560 conn(0x7faa700ff5d0 msgr2=0x7faa701019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:25.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.895+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 shutdown_connections 2024-09-21T00:57:25.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:25.895+0000 7faa758c9640 1 -- 172.21.15.47:0/215882560 wait complete. 2024-09-21T00:57:26.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T00:57:26.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T00:57:26.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T00:57:26.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T00:57:26.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T00:57:26.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:25 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T00:57:26.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T00:57:26.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T00:57:26.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T00:57:26.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T00:57:26.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T00:57:26.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:25 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T00:57:26.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T00:57:26.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T00:57:26.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T00:57:26.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T00:57:26.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T00:57:26.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:25 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T00:57:26.447 INFO:teuthology.orchestra.run.smithi047.stdout:55834574919 2024-09-21T00:57:26.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T00:57:26.970 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:26 smithi047 ceph-mon[30960]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:57:26.970 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T00:57:26.970 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T00:57:26.970 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T00:57:26.970 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T00:57:26.970 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T00:57:26.970 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:26 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T00:57:26.970 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:26 smithi047 ceph-mon[30960]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T00:57:27.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:26 smithi134 ceph-mon[34785]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:57:27.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T00:57:27.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T00:57:27.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T00:57:27.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T00:57:27.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T00:57:27.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:26 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T00:57:27.095 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:26 smithi134 ceph-mon[34785]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T00:57:27.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:26 smithi114 ceph-mon[34309]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:57:27.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T00:57:27.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T00:57:27.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T00:57:27.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T00:57:27.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T00:57:27.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:26 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T00:57:27.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:26 smithi114 ceph-mon[34309]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T00:57:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 -- 172.21.15.47:0/1543641406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 msgr2=0x7febc410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 --2- 172.21.15.47:0/1543641406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 0x7febc410f540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7febbc009ca0 tx=0x7febbc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 -- 172.21.15.47:0/1543641406 shutdown_connections 2024-09-21T00:57:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 --2- 172.21.15.47:0/1543641406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 0x7febc410f540 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 --2- 172.21.15.47:0/1543641406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4105180 0x7febc4105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 --2- 172.21.15.47:0/1543641406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4103090 0x7febc41034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 -- 172.21.15.47:0/1543641406 >> 172.21.15.47:0/1543641406 conn(0x7febc4077cf0 msgr2=0x7febc4078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 -- 172.21.15.47:0/1543641406 shutdown_connections 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.484+0000 7febca2f4640 1 -- 172.21.15.47:0/1543641406 wait complete. 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.485+0000 7febca2f4640 1 Processor -- start 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.485+0000 7febca2f4640 1 -- start start 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.485+0000 7febca2f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4103090 0x7febc419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.485+0000 7febca2f4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4105180 0x7febc419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febca2f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 0x7febc41a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febca2f4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febc41129d0 con 0x7febc4105ad0 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febca2f4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7febc4112850 con 0x7febc4105180 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febca2f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7febc4112b50 con 0x7febc4103090 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 0x7febc41a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 0x7febc41a1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40146/0 (socket says 172.21.15.47:40146) 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 -- 172.21.15.47:0/812115781 learned_addr learned my addr 172.21.15.47:0/812115781 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc3fff640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4103090 0x7febc419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc37fe640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4105180 0x7febc419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 -- 172.21.15.47:0/812115781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4103090 msgr2=0x7febc419c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4103090 0x7febc419c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 -- 172.21.15.47:0/812115781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4105180 msgr2=0x7febc419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4105180 0x7febc419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 -- 172.21.15.47:0/812115781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc41a2580 con 0x7febc4105ad0 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc8891640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 0x7febc41a1f10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7febbc005cc0 tx=0x7febbc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.486+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc003bf0 con 0x7febc4105ad0 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.487+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc41a2810 con 0x7febc4105ad0 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.487+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febbc003d90 con 0x7febc4105ad0 2024-09-21T00:57:27.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.487+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc02fbc0 con 0x7febc4105ad0 2024-09-21T00:57:27.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.487+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc41a2d50 con 0x7febc4105ad0 2024-09-21T00:57:27.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.488+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febc4108db0 con 0x7febc4105ad0 2024-09-21T00:57:27.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.489+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7febbc02fd60 con 0x7febc4105ad0 2024-09-21T00:57:27.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.490+0000 7febc17fa640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7febac0b65d0 0x7febac0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.490+0000 7febc3fff640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7febac0b65d0 0x7febac0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.490+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7febbc108a60 con 0x7febc4105ad0 2024-09-21T00:57:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.491+0000 7febc17fa640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] conn(0x7febac0bffc0 0x7febac0c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.491+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 --> [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febbc009030 con 0x7febac0bffc0 2024-09-21T00:57:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.491+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7febbc108e10 con 0x7febc4105ad0 2024-09-21T00:57:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.491+0000 7febc3fff640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7febac0b65d0 0x7febac0b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7febb4005fd0 tx=0x7febb400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.491+0000 7febc37fe640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] conn(0x7febac0bffc0 0x7febac0c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.491+0000 7febc37fe640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] conn(0x7febac0bffc0 0x7febac0c24b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.492+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 <== osd.7 v2:172.21.15.114:6816/4057336411 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febbc009030 con 0x7febac0bffc0 2024-09-21T00:57:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.506+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 --> [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febc4103e10 con 0x7febac0bffc0 2024-09-21T00:57:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.507+0000 7febc17fa640 1 -- 172.21.15.47:0/812115781 <== osd.7 v2:172.21.15.114:6816/4057336411 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7febc4103e10 con 0x7febac0bffc0 2024-09-21T00:57:27.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.507+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 >> [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] conn(0x7febac0bffc0 msgr2=0x7febac0c24b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.507+0000 7febca2f4640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] conn(0x7febac0bffc0 0x7febac0c24b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.507+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7febac0b65d0 msgr2=0x7febac0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.507+0000 7febca2f4640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7febac0b65d0 0x7febac0b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7febb4005fd0 tx=0x7febb400b390 comp rx=0 tx=0).stop 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.507+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 msgr2=0x7febc41a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.507+0000 7febca2f4640 1 --2- 172.21.15.47:0/812115781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc4105ad0 0x7febc41a1f10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7febbc005cc0 tx=0x7febbc02f380 comp rx=0 tx=0).stop 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.507+0000 7febc8891640 1 -- 172.21.15.47:0/812115781 reap_dead start 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.508+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 shutdown_connections 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.508+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 >> 172.21.15.47:0/812115781 conn(0x7febc4077cf0 msgr2=0x7febc4108350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.508+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 shutdown_connections 2024-09-21T00:57:27.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.508+0000 7febca2f4640 1 -- 172.21.15.47:0/812115781 wait complete. 2024-09-21T00:57:27.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 -- 172.21.15.47:0/2978696521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc102a60 msgr2=0x7f82bc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 --2- 172.21.15.47:0/2978696521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc102a60 0x7f82bc102e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009900 tx=0x7f82a402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:27.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 -- 172.21.15.47:0/2978696521 shutdown_connections 2024-09-21T00:57:27.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 --2- 172.21.15.47:0/2978696521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc108cf0 0x7f82bc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 --2- 172.21.15.47:0/2978696521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82bc1083a0 0x7f82bc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 --2- 172.21.15.47:0/2978696521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc102a60 0x7f82bc102e70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 -- 172.21.15.47:0/2978696521 >> 172.21.15.47:0/2978696521 conn(0x7f82bc079730 msgr2=0x7f82bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 -- 172.21.15.47:0/2978696521 shutdown_connections 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.700+0000 7f82c0aef640 1 -- 172.21.15.47:0/2978696521 wait complete. 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82c0aef640 1 Processor -- start 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82c0aef640 1 -- start start 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82c0aef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc102a60 0x7f82bc19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82c0aef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc1083a0 0x7f82bc19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82c0aef640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82bc108cf0 0x7f82bc19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82c0aef640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc112960 con 0x7f82bc1083a0 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82c0aef640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1127e0 con 0x7f82bc108cf0 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82c0aef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc112ae0 con 0x7f82bc102a60 2024-09-21T00:57:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82b9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc1083a0 0x7f82bc19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82b9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc1083a0 0x7f82bc19b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40176/0 (socket says 172.21.15.47:40176) 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.701+0000 7f82b9d9b640 1 -- 172.21.15.47:0/343105640 learned_addr learned my addr 172.21.15.47:0/343105640 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82ba59c640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc102a60 0x7f82bc19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82bad9d640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82bc108cf0 0x7f82bc19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b9d9b640 1 -- 172.21.15.47:0/343105640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc102a60 msgr2=0x7f82bc19b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b9d9b640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc102a60 0x7f82bc19b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b9d9b640 1 -- 172.21.15.47:0/343105640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82bc108cf0 msgr2=0x7f82bc19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b9d9b640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82bc108cf0 0x7f82bc19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b9d9b640 1 -- 172.21.15.47:0/343105640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc1a64e0 con 0x7f82bc1083a0 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82ba59c640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82bc102a60 0x7f82bc19b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b9d9b640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc1083a0 0x7f82bc19b790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f82ac005fd0 tx=0x7f82ac00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac017070 con 0x7f82bc1083a0 2024-09-21T00:57:27.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82ac009c30 con 0x7f82bc1083a0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc1a67d0 con 0x7f82bc1083a0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac003d30 con 0x7f82bc1083a0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.702+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc1a6d10 con 0x7f82bc1083a0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.703+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82bc063b50 con 0x7f82bc1083a0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.705+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f82ac003ed0 con 0x7f82bc1083a0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.706+0000 7f82b37fe640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f82a80b65d0 0x7f82a80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.706+0000 7f82ba59c640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f82a80b65d0 0x7f82a80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.706+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f82ac0e7740 con 0x7f82bc1083a0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.706+0000 7f82b37fe640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] conn(0x7f82a80bffc0 0x7f82a80c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.706+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 --> [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82ac026ea0 con 0x7f82a80bffc0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.706+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f82ac0e7af0 con 0x7f82bc1083a0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.706+0000 7f82bad9d640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] conn(0x7f82a80bffc0 0x7f82a80c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:27.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.707+0000 7f82ba59c640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f82a80b65d0 0x7f82a80b8ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f82a4000c00 tx=0x7f82a4009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.707+0000 7f82bad9d640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] conn(0x7f82a80bffc0 0x7f82a80c24b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:27.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.708+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 <== osd.0 v2:172.21.15.47:6802/629047334 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82ac026ea0 con 0x7f82a80bffc0 2024-09-21T00:57:27.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.722+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 --> [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82bc063f50 con 0x7f82a80bffc0 2024-09-21T00:57:27.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.722+0000 7f82b37fe640 1 -- 172.21.15.47:0/343105640 <== osd.0 v2:172.21.15.47:6802/629047334 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f82bc063f50 con 0x7f82a80bffc0 2024-09-21T00:57:27.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] conn(0x7f82a80bffc0 msgr2=0x7f82a80c24b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] conn(0x7f82a80bffc0 0x7f82a80c24b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f82a80b65d0 msgr2=0x7f82a80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f82a80b65d0 0x7f82a80b8ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f82a4000c00 tx=0x7f82a4009680 comp rx=0 tx=0).stop 2024-09-21T00:57:27.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc1083a0 msgr2=0x7f82bc19b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 --2- 172.21.15.47:0/343105640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82bc1083a0 0x7f82bc19b790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f82ac005fd0 tx=0x7f82ac00dde0 comp rx=0 tx=0).stop 2024-09-21T00:57:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82bad9d640 1 -- 172.21.15.47:0/343105640 reap_dead start 2024-09-21T00:57:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 shutdown_connections 2024-09-21T00:57:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 >> 172.21.15.47:0/343105640 conn(0x7f82bc079730 msgr2=0x7f82bc101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 shutdown_connections 2024-09-21T00:57:27.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:27.723+0000 7f82c0aef640 1 -- 172.21.15.47:0/343105640 wait complete. 2024-09-21T00:57:27.909 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:27 smithi047 ceph-mon[30960]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T00:57:28.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:27 smithi134 ceph-mon[34785]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T00:57:28.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:27 smithi114 ceph-mon[34309]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T00:57:28.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 -- 172.21.15.47:0/296722248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f8103b60 msgr2=0x7f52f8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:28.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 --2- 172.21.15.47:0/296722248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f8103b60 0x7f52f8103f70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009900 tx=0x7f52e802a410 comp rx=0 tx=0).stop 2024-09-21T00:57:28.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 -- 172.21.15.47:0/296722248 shutdown_connections 2024-09-21T00:57:28.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 --2- 172.21.15.47:0/296722248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52f8109df0 0x7f52f8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:28.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 --2- 172.21.15.47:0/296722248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f81094a0 0x7f52f81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:28.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 --2- 172.21.15.47:0/296722248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f8103b60 0x7f52f8103f70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:28.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 -- 172.21.15.47:0/296722248 >> 172.21.15.47:0/296722248 conn(0x7f52f807b850 msgr2=0x7f52f807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:28.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 -- 172.21.15.47:0/296722248 shutdown_connections 2024-09-21T00:57:28.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 -- 172.21.15.47:0/296722248 wait complete. 2024-09-21T00:57:28.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.367+0000 7f52fe733640 1 Processor -- start 2024-09-21T00:57:28.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52fe733640 1 -- start start 2024-09-21T00:57:28.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52fe733640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52f8103b60 0x7f52f819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:28.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52fe733640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f81094a0 0x7f52f819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:28.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52fe733640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8109df0 0x7f52f819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:28.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52fe733640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f52f8113ab0 con 0x7f52f81094a0 2024-09-21T00:57:28.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52fe733640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f52f8113930 con 0x7f52f8103b60 2024-09-21T00:57:28.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52fe733640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52f8113c30 con 0x7f52f8109df0 2024-09-21T00:57:28.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52f77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f81094a0 0x7f52f819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:28.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52f77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f81094a0 0x7f52f819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40192/0 (socket says 172.21.15.47:40192) 2024-09-21T00:57:28.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52f77fe640 1 -- 172.21.15.47:0/481036435 learned_addr learned my addr 172.21.15.47:0/481036435 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:28.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52f7fff640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52f8103b60 0x7f52f819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:28.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52fccd0640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8109df0 0x7f52f819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.368+0000 7f52f77fe640 1 -- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8109df0 msgr2=0x7f52f819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f77fe640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8109df0 0x7f52f819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f77fe640 1 -- 172.21.15.47:0/481036435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52f8103b60 msgr2=0x7f52f819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f77fe640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52f8103b60 0x7f52f819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f77fe640 1 -- 172.21.15.47:0/481036435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f81a03d0 con 0x7f52f81094a0 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f7fff640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52f8103b60 0x7f52f819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52fccd0640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f8109df0 0x7f52f819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f77fe640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f81094a0 0x7f52f819aa00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c970 tx=0x7f52ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:28.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec007bb0 con 0x7f52f81094a0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ec007d50 con 0x7f52f81094a0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f81a06c0 con 0x7f52f81094a0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00f450 con 0x7f52f81094a0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.369+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f81a6e20 con 0x7f52f81094a0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.370+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52f8063b50 con 0x7f52f81094a0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.372+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f52ec004eb0 con 0x7f52f81094a0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.372+0000 7f52f57fa640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f52e00b6620 0x7f52e00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.373+0000 7f52f7fff640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f52e00b6620 0x7f52e00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.373+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f52ec0e7670 con 0x7f52f81094a0 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.373+0000 7f52f57fa640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] conn(0x7f52e00c0010 0x7f52e00c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.373+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 --> [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52ec005600 con 0x7f52e00c0010 2024-09-21T00:57:28.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.373+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f52ec0e7b50 con 0x7f52f81094a0 2024-09-21T00:57:28.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.373+0000 7f52f7fff640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f52e00b6620 0x7f52e00b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f52e80096c0 tx=0x7f52e8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:28.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.373+0000 7f52fccd0640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] conn(0x7f52e00c0010 0x7f52e00c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:28.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.373+0000 7f52fccd0640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] conn(0x7f52e00c0010 0x7f52e00c2500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:28.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.374+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 <== osd.5 v2:172.21.15.134:6808/1310952352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52ec005600 con 0x7f52e00c0010 2024-09-21T00:57:28.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.388+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 --> [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f52f8063f80 con 0x7f52e00c0010 2024-09-21T00:57:28.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.389+0000 7f52f57fa640 1 -- 172.21.15.47:0/481036435 <== osd.5 v2:172.21.15.134:6808/1310952352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f52f8063f80 con 0x7f52e00c0010 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.389+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] conn(0x7f52e00c0010 msgr2=0x7f52e00c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.389+0000 7f52fe733640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] conn(0x7f52e00c0010 0x7f52e00c2500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.389+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f52e00b6620 msgr2=0x7f52e00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.389+0000 7f52fe733640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f52e00b6620 0x7f52e00b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f52e80096c0 tx=0x7f52e8031400 comp rx=0 tx=0).stop 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.389+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f81094a0 msgr2=0x7f52f819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.389+0000 7f52fe733640 1 --2- 172.21.15.47:0/481036435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52f81094a0 0x7f52f819aa00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c970 tx=0x7f52ec00ce30 comp rx=0 tx=0).stop 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.389+0000 7f52fccd0640 1 -- 172.21.15.47:0/481036435 reap_dead start 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.390+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 shutdown_connections 2024-09-21T00:57:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.390+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 >> 172.21.15.47:0/481036435 conn(0x7f52f807b850 msgr2=0x7f52f8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:28.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.390+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 shutdown_connections 2024-09-21T00:57:28.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:28.390+0000 7f52fe733640 1 -- 172.21.15.47:0/481036435 wait complete. 2024-09-21T00:57:29.060 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:28 smithi047 ceph-mon[30960]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:29.091 INFO:teuthology.orchestra.run.smithi047.stdout:34359738444 2024-09-21T00:57:29.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T00:57:29.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:28 smithi134 ceph-mon[34785]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:29.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:28 smithi114 ceph-mon[34309]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:30.375 INFO:teuthology.orchestra.run.smithi047.stdout:133143986231 2024-09-21T00:57:30.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T00:57:30.974 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:30 smithi047 ceph-mon[30960]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:31.003 INFO:teuthology.orchestra.run.smithi047.stdout:197568495656 2024-09-21T00:57:31.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T00:57:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:30 smithi134 ceph-mon[34785]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:31.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:30 smithi114 ceph-mon[34309]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 -- 172.21.15.47:0/2176379369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8341049c0 msgr2=0x7fc834104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 --2- 172.21.15.47:0/2176379369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8341049c0 0x7fc834104dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc824009900 tx=0x7fc82402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 -- 172.21.15.47:0/2176379369 shutdown_connections 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 --2- 172.21.15.47:0/2176379369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83410de20 0x7fc834110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 --2- 172.21.15.47:0/2176379369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc834105310 0x7fc83410d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 --2- 172.21.15.47:0/2176379369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8341049c0 0x7fc834104dd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 -- 172.21.15.47:0/2176379369 >> 172.21.15.47:0/2176379369 conn(0x7fc834079730 msgr2=0x7fc834079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 -- 172.21.15.47:0/2176379369 shutdown_connections 2024-09-21T00:57:31.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.187+0000 7fc83913d640 1 -- 172.21.15.47:0/2176379369 wait complete. 2024-09-21T00:57:31.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.188+0000 7fc83913d640 1 Processor -- start 2024-09-21T00:57:31.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.188+0000 7fc83913d640 1 -- start start 2024-09-21T00:57:31.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83913d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8341049c0 0x7fc834102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83913d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc834105310 0x7fc834102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83913d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83410de20 0x7fc834103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83913d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc834113aa0 con 0x7fc83410de20 2024-09-21T00:57:31.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83913d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc834113920 con 0x7fc834105310 2024-09-21T00:57:31.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83913d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc834113c20 con 0x7fc8341049c0 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83410de20 0x7fc834103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83410de20 0x7fc834103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40214/0 (socket says 172.21.15.47:40214) 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 -- 172.21.15.47:0/3861682797 learned_addr learned my addr 172.21.15.47:0/3861682797 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc82a59c640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc834105310 0x7fc834102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc832d9d640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8341049c0 0x7fc834102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 -- 172.21.15.47:0/3861682797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8341049c0 msgr2=0x7fc834102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8341049c0 0x7fc834102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 -- 172.21.15.47:0/3861682797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc834105310 msgr2=0x7fc834102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc834105310 0x7fc834102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 -- 172.21.15.47:0/3861682797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8341a8790 con 0x7fc83410de20 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc82a59c640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc834105310 0x7fc834102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:31.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.189+0000 7fc83359e640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83410de20 0x7fc834103180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00cad0 tx=0x7fc82c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.190+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00ae20 con 0x7fc83410de20 2024-09-21T00:57:31.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.190+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8341a8a80 con 0x7fc83410de20 2024-09-21T00:57:31.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.190+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc82c005020 con 0x7fc83410de20 2024-09-21T00:57:31.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.190+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00f6b0 con 0x7fc83410de20 2024-09-21T00:57:31.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.190+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8341a8fc0 con 0x7fc83410de20 2024-09-21T00:57:31.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.191+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8341083a0 con 0x7fc83410de20 2024-09-21T00:57:31.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.192+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fc82c0051d0 con 0x7fc83410de20 2024-09-21T00:57:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.193+0000 7fc830d99640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc8200b65a0 0x7fc8200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.193+0000 7fc832d9d640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc8200b65a0 0x7fc8200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.193+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fc82c0e7820 con 0x7fc83410de20 2024-09-21T00:57:31.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.194+0000 7fc830d99640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] conn(0x7fc8200bff90 0x7fc8200c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.194+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 --> [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8200c2b50 con 0x7fc8200bff90 2024-09-21T00:57:31.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.194+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc82c0e7d00 con 0x7fc83410de20 2024-09-21T00:57:31.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.194+0000 7fc82a59c640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] conn(0x7fc8200bff90 0x7fc8200c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.194+0000 7fc832d9d640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc8200b65a0 0x7fc8200b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc824009230 tx=0x7fc824031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.194+0000 7fc82a59c640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] conn(0x7fc8200bff90 0x7fc8200c2480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.195+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 <== osd.3 v2:172.21.15.47:6810/1095561403 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8200c2b50 con 0x7fc8200bff90 2024-09-21T00:57:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.212+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 --> [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc83406b390 con 0x7fc8200bff90 2024-09-21T00:57:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.212+0000 7fc830d99640 1 -- 172.21.15.47:0/3861682797 <== osd.3 v2:172.21.15.47:6810/1095561403 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc83406b390 con 0x7fc8200bff90 2024-09-21T00:57:31.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.212+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] conn(0x7fc8200bff90 msgr2=0x7fc8200c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.212+0000 7fc83913d640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] conn(0x7fc8200bff90 0x7fc8200c2480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc8200b65a0 msgr2=0x7fc8200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83913d640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc8200b65a0 0x7fc8200b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc824009230 tx=0x7fc824031400 comp rx=0 tx=0).stop 2024-09-21T00:57:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83410de20 msgr2=0x7fc834103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83913d640 1 --2- 172.21.15.47:0/3861682797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc83410de20 0x7fc834103180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00cad0 tx=0x7fc82c00cf90 comp rx=0 tx=0).stop 2024-09-21T00:57:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83359e640 1 -- 172.21.15.47:0/3861682797 reap_dead start 2024-09-21T00:57:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 shutdown_connections 2024-09-21T00:57:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 >> 172.21.15.47:0/3861682797 conn(0x7fc834079730 msgr2=0x7fc834107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 shutdown_connections 2024-09-21T00:57:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.213+0000 7fc83913d640 1 -- 172.21.15.47:0/3861682797 wait complete. 2024-09-21T00:57:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 -- 172.21.15.47:0/581228647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 msgr2=0x7face01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 --2- 172.21.15.47:0/581228647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 0x7face01087e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faccc009900 tx=0x7faccc02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 -- 172.21.15.47:0/581228647 shutdown_connections 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 --2- 172.21.15.47:0/581228647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7face0108d20 0x7face010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 --2- 172.21.15.47:0/581228647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 0x7face01087e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 --2- 172.21.15.47:0/581228647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7face0102ae0 0x7face0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 -- 172.21.15.47:0/581228647 >> 172.21.15.47:0/581228647 conn(0x7face0079760 msgr2=0x7face0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 -- 172.21.15.47:0/581228647 shutdown_connections 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 -- 172.21.15.47:0/581228647 wait complete. 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.466+0000 7face6e23640 1 Processor -- start 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face6e23640 1 -- start start 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face6e23640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7face0102ae0 0x7face01990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face6e23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 0x7face01995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face6e23640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7face0108d20 0x7face0199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face6e23640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7face0112990 con 0x7face01083d0 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face6e23640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7face0112810 con 0x7face0102ae0 2024-09-21T00:57:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face6e23640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7face0112b10 con 0x7face0108d20 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7facdffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 0x7face01995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7facdffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 0x7face01995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40226/0 (socket says 172.21.15.47:40226) 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7facdffff640 1 -- 172.21.15.47:0/1136802706 learned_addr learned my addr 172.21.15.47:0/1136802706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face4bbf640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7face0102ae0 0x7face01990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face53c0640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7face0108d20 0x7face0199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7facdffff640 1 -- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7face0108d20 msgr2=0x7face0199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7facdffff640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7face0108d20 0x7face0199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7facdffff640 1 -- 172.21.15.47:0/1136802706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7face0102ae0 msgr2=0x7face01990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7facdffff640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7face0102ae0 0x7face01990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7facdffff640 1 -- 172.21.15.47:0/1136802706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face01a8730 con 0x7face01083d0 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.467+0000 7face53c0640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7face0108d20 0x7face0199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.468+0000 7facdffff640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 0x7face01995f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faccc032fd0 tx=0x7faccc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.468+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc03f030 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.468+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faccc004490 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.468+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face01a8960 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.468+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc035070 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.468+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face01a8e90 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.469+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7face0063b50 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.471+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7faccc042030 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.471+0000 7facddffb640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7facd00b6620 0x7facd00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.472+0000 7face4bbf640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7facd00b6620 0x7facd00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.472+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7faccc107df0 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.472+0000 7facddffb640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] conn(0x7facd00c0010 0x7facd00c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.472+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 --> [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faccc032970 con 0x7facd00c0010 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.472+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7faccc1081a0 con 0x7face01083d0 2024-09-21T00:57:31.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.472+0000 7face4bbf640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7facd00b6620 0x7facd00b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7face0079c40 tx=0x7facd400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.472+0000 7face53c0640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] conn(0x7facd00c0010 0x7facd00c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.473+0000 7face53c0640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] conn(0x7facd00c0010 0x7facd00c2500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.474+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 <== osd.2 v2:172.21.15.134:6800/2759710953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faccc032970 con 0x7facd00c0010 2024-09-21T00:57:31.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.487+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 --> [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7face0063f50 con 0x7facd00c0010 2024-09-21T00:57:31.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.488+0000 7facddffb640 1 -- 172.21.15.47:0/1136802706 <== osd.2 v2:172.21.15.134:6800/2759710953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7face0063f50 con 0x7facd00c0010 2024-09-21T00:57:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.488+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] conn(0x7facd00c0010 msgr2=0x7facd00c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.488+0000 7face6e23640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] conn(0x7facd00c0010 0x7facd00c2500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.488+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7facd00b6620 msgr2=0x7facd00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.488+0000 7face6e23640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7facd00b6620 0x7facd00b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7face0079c40 tx=0x7facd400b390 comp rx=0 tx=0).stop 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.488+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 msgr2=0x7face01995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.488+0000 7face6e23640 1 --2- 172.21.15.47:0/1136802706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7face01083d0 0x7face01995f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faccc032fd0 tx=0x7faccc004270 comp rx=0 tx=0).stop 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.489+0000 7face53c0640 1 -- 172.21.15.47:0/1136802706 reap_dead start 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.489+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 shutdown_connections 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.489+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 >> 172.21.15.47:0/1136802706 conn(0x7face0079760 msgr2=0x7face0104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.489+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 shutdown_connections 2024-09-21T00:57:31.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.489+0000 7face6e23640 1 -- 172.21.15.47:0/1136802706 wait complete. 2024-09-21T00:57:31.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 -- 172.21.15.47:0/818754428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 msgr2=0x7f30581098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 --2- 172.21.15.47:0/818754428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 0x7f30581098c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f304c009ca0 tx=0x7f304c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 -- 172.21.15.47:0/818754428 shutdown_connections 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 --2- 172.21.15.47:0/818754428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3058109e00 0x7f3058110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 --2- 172.21.15.47:0/818754428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 0x7f30581098c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 --2- 172.21.15.47:0/818754428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3058101f70 0x7f3058102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 -- 172.21.15.47:0/818754428 >> 172.21.15.47:0/818754428 conn(0x7f3058077c60 msgr2=0x7f30580780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 -- 172.21.15.47:0/818754428 shutdown_connections 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.896+0000 7f305cf78640 1 -- 172.21.15.47:0/818754428 wait complete. 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f305cf78640 1 Processor -- start 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f305cf78640 1 -- start start 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f305cf78640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3058101f70 0x7f305819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f305cf78640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 0x7f305819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f305cf78640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3058109e00 0x7f30581a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f305cf78640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3058113ae0 con 0x7f30581094b0 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f305cf78640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3058113960 con 0x7f3058101f70 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f305cf78640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3058113c60 con 0x7f3058109e00 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f3055d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 0x7f305819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.897+0000 7f3055d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 0x7f305819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45532/0 (socket says 172.21.15.47:45532) 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3055d9b640 1 -- 172.21.15.47:0/1790825703 learned_addr learned my addr 172.21.15.47:0/1790825703 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f305659c640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3058101f70 0x7f305819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3056d9d640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3058109e00 0x7f30581a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3055d9b640 1 -- 172.21.15.47:0/1790825703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3058109e00 msgr2=0x7f30581a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3055d9b640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3058109e00 0x7f30581a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3055d9b640 1 -- 172.21.15.47:0/1790825703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3058101f70 msgr2=0x7f305819c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3055d9b640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3058101f70 0x7f305819c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3055d9b640 1 -- 172.21.15.47:0/1790825703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30581a2680 con 0x7f30581094b0 2024-09-21T00:57:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3056d9d640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3058109e00 0x7f30581a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f3055d9b640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 0x7f305819ccb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f304c02ade0 tx=0x7f304c031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c003d20 con 0x7f30581094b0 2024-09-21T00:57:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30581a2910 con 0x7f30581094b0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f304c0044f0 con 0x7f30581094b0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c02fd40 con 0x7f30581094b0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.898+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30581a90d0 con 0x7f30581094b0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.899+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3058107d20 con 0x7f30581094b0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.901+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f304c004040 con 0x7f30581094b0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.902+0000 7f30477fe640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30400b65a0 0x7f30400b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.902+0000 7f305659c640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30400b65a0 0x7f30400b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.902+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f304c108a70 con 0x7f30581094b0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.902+0000 7f30477fe640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] conn(0x7f30400bff90 0x7f30400c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.902+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 --> [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f304c045e50 con 0x7f30400bff90 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.902+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f304c108f50 con 0x7f30581094b0 2024-09-21T00:57:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.902+0000 7f305659c640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30400b65a0 0x7f30400b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f30480058c0 tx=0x7f304800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.902+0000 7f3056d9d640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] conn(0x7f30400bff90 0x7f30400c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.903+0000 7f3056d9d640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] conn(0x7f30400bff90 0x7f30400c2480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.904+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 <== osd.10 v2:172.21.15.114:6824/1056730214 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f304c045e50 con 0x7f30400bff90 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.917+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 --> [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f305806ac50 con 0x7f30400bff90 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f30477fe640 1 -- 172.21.15.47:0/1790825703 <== osd.10 v2:172.21.15.114:6824/1056730214 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f305806ac50 con 0x7f30400bff90 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 >> [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] conn(0x7f30400bff90 msgr2=0x7f30400c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] conn(0x7f30400bff90 0x7f30400c2480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30400b65a0 msgr2=0x7f30400b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30400b65a0 0x7f30400b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f30480058c0 tx=0x7f304800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 msgr2=0x7f305819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 --2- 172.21.15.47:0/1790825703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30581094b0 0x7f305819ccb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f304c02ade0 tx=0x7f304c031a10 comp rx=0 tx=0).stop 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f3056d9d640 1 -- 172.21.15.47:0/1790825703 reap_dead start 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 shutdown_connections 2024-09-21T00:57:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 >> 172.21.15.47:0/1790825703 conn(0x7f3058077c60 msgr2=0x7f30581072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:31.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 shutdown_connections 2024-09-21T00:57:31.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:31.918+0000 7f305cf78640 1 -- 172.21.15.47:0/1790825703 wait complete. 2024-09-21T00:57:32.877 INFO:teuthology.orchestra.run.smithi047.stdout:111669149757 2024-09-21T00:57:32.878 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T00:57:33.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:32 smithi134 ceph-mon[34785]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 0 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:33.136 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:32 smithi047 ceph-mon[30960]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 0 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:33.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:32 smithi114 ceph-mon[34309]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 0 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 -- 172.21.15.47:0/1458041852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c10ded0 msgr2=0x7f7a6c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 --2- 172.21.15.47:0/1458041852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c10ded0 0x7f7a6c110330 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009ca0 tx=0x7f7a6402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 -- 172.21.15.47:0/1458041852 shutdown_connections 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 --2- 172.21.15.47:0/1458041852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c10ded0 0x7f7a6c110330 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 --2- 172.21.15.47:0/1458041852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a6c105270 0x7f7a6c10d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 --2- 172.21.15.47:0/1458041852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a6c104920 0x7f7a6c104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 -- 172.21.15.47:0/1458041852 >> 172.21.15.47:0/1458041852 conn(0x7f7a6c079760 msgr2=0x7f7a6c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 -- 172.21.15.47:0/1458041852 shutdown_connections 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.429+0000 7f7a71232640 1 -- 172.21.15.47:0/1458041852 wait complete. 2024-09-21T00:57:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.430+0000 7f7a71232640 1 Processor -- start 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a71232640 1 -- start start 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a71232640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a6c104920 0x7f7a6c102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a71232640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c105270 0x7f7a6c102d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a71232640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a6c10ded0 0x7f7a6c1032b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a71232640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c113aa0 con 0x7f7a6c105270 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a71232640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c113920 con 0x7f7a6c10ded0 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a71232640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c113c20 con 0x7f7a6c104920 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c105270 0x7f7a6c102d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c105270 0x7f7a6c102d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45546/0 (socket says 172.21.15.47:45546) 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6a59c640 1 -- 172.21.15.47:0/3126367745 learned_addr learned my addr 172.21.15.47:0/3126367745 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6ad9d640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a6c104920 0x7f7a6c102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6b59e640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a6c10ded0 0x7f7a6c1032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6a59c640 1 -- 172.21.15.47:0/3126367745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a6c104920 msgr2=0x7f7a6c102830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6a59c640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a6c104920 0x7f7a6c102830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6a59c640 1 -- 172.21.15.47:0/3126367745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a6c10ded0 msgr2=0x7f7a6c1032b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6a59c640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a6c10ded0 0x7f7a6c1032b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6a59c640 1 -- 172.21.15.47:0/3126367745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c1a86f0 con 0x7f7a6c105270 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.431+0000 7f7a6b59e640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a6c10ded0 0x7f7a6c1032b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.432+0000 7f7a6a59c640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c105270 0x7f7a6c102d70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000d770 tx=0x7f7a6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.432+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60017070 con 0x7f7a6c105270 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.432+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c1a89e0 con 0x7f7a6c105270 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.432+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a60009c30 con 0x7f7a6c105270 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.432+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6000f620 con 0x7f7a6c105270 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.432+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c1a8f20 con 0x7f7a6c105270 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.433+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a6c102180 con 0x7f7a6c105270 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.434+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f7a6001a070 con 0x7f7a6c105270 2024-09-21T00:57:33.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.435+0000 7f7a53fff640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7a540b65a0 0x7f7a540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.435+0000 7f7a6ad9d640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7a540b65a0 0x7f7a540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.435+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f7a600e7550 con 0x7f7a6c105270 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.435+0000 7f7a53fff640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] conn(0x7f7a540bff90 0x7f7a540c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.435+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 --> [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a540c2b50 con 0x7f7a540bff90 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.435+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f7a600e7900 con 0x7f7a6c105270 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.436+0000 7f7a6b59e640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] conn(0x7f7a540bff90 0x7f7a540c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.436+0000 7f7a6ad9d640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7a540b65a0 0x7f7a540b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c104280 tx=0x7f7a5c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.436+0000 7f7a6b59e640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] conn(0x7f7a540bff90 0x7f7a540c2480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:33.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.437+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 <== osd.6 v2:172.21.15.47:6818/4174188807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a540c2b50 con 0x7f7a540bff90 2024-09-21T00:57:33.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.450+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 --> [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7a6c06b350 con 0x7f7a540bff90 2024-09-21T00:57:33.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a53fff640 1 -- 172.21.15.47:0/3126367745 <== osd.6 v2:172.21.15.47:6818/4174188807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7a6c06b350 con 0x7f7a540bff90 2024-09-21T00:57:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] conn(0x7f7a540bff90 msgr2=0x7f7a540c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] conn(0x7f7a540bff90 0x7f7a540c2480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7a540b65a0 msgr2=0x7f7a540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7a540b65a0 0x7f7a540b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c104280 tx=0x7f7a5c00b390 comp rx=0 tx=0).stop 2024-09-21T00:57:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c105270 msgr2=0x7f7a6c102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 --2- 172.21.15.47:0/3126367745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c105270 0x7f7a6c102d70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a6000d770 tx=0x7f7a6000dc30 comp rx=0 tx=0).stop 2024-09-21T00:57:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a6b59e640 1 -- 172.21.15.47:0/3126367745 reap_dead start 2024-09-21T00:57:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 shutdown_connections 2024-09-21T00:57:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 >> 172.21.15.47:0/3126367745 conn(0x7f7a6c079760 msgr2=0x7f7a6c100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 shutdown_connections 2024-09-21T00:57:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.451+0000 7f7a71232640 1 -- 172.21.15.47:0/3126367745 wait complete. 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.648+0000 7f97b1cb1640 1 -- 172.21.15.47:0/3024844809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 msgr2=0x7f97ac103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.648+0000 7f97b1cb1640 1 --2- 172.21.15.47:0/3024844809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 0x7f97ac103f70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f979c009900 tx=0x7f979c02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.649+0000 7f97b1cb1640 1 -- 172.21.15.47:0/3024844809 shutdown_connections 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.649+0000 7f97b1cb1640 1 --2- 172.21.15.47:0/3024844809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97ac109df0 0x7f97ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.649+0000 7f97b1cb1640 1 --2- 172.21.15.47:0/3024844809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ac1094a0 0x7f97ac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.649+0000 7f97b1cb1640 1 --2- 172.21.15.47:0/3024844809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 0x7f97ac103f70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.649+0000 7f97b1cb1640 1 -- 172.21.15.47:0/3024844809 >> 172.21.15.47:0/3024844809 conn(0x7f97ac07b850 msgr2=0x7f97ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.649+0000 7f97b1cb1640 1 -- 172.21.15.47:0/3024844809 shutdown_connections 2024-09-21T00:57:33.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.649+0000 7f97b1cb1640 1 -- 172.21.15.47:0/3024844809 wait complete. 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.649+0000 7f97b1cb1640 1 Processor -- start 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97b1cb1640 1 -- start start 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97b1cb1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 0x7f97ac19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97b1cb1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97ac1094a0 0x7f97ac19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97b1cb1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ac109df0 0x7f97ac19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97b1cb1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac113ab0 con 0x7f97ac103b60 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97b1cb1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac113930 con 0x7f97ac109df0 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97b1cb1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac113c30 con 0x7f97ac1094a0 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 0x7f97ac19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97ab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 0x7f97ac19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45562/0 (socket says 172.21.15.47:45562) 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97ab7fe640 1 -- 172.21.15.47:0/4224518812 learned_addr learned my addr 172.21.15.47:0/4224518812 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97aaffd640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97ac1094a0 0x7f97ac19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97abfff640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ac109df0 0x7f97ac19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97ab7fe640 1 -- 172.21.15.47:0/4224518812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97ac1094a0 msgr2=0x7f97ac19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97ab7fe640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97ac1094a0 0x7f97ac19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97ab7fe640 1 -- 172.21.15.47:0/4224518812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ac109df0 msgr2=0x7f97ac19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97ab7fe640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ac109df0 0x7f97ac19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97ab7fe640 1 -- 172.21.15.47:0/4224518812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac1a03d0 con 0x7f97ac103b60 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.650+0000 7f97abfff640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97ac109df0 0x7f97ac19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.651+0000 7f97ab7fe640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 0x7f97ac19a460 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f979c005940 tx=0x7f979c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.651+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c03f030 con 0x7f97ac103b60 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.651+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c003cb0 con 0x7f97ac103b60 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.651+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac1a0660 con 0x7f97ac103b60 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.651+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c035070 con 0x7f97ac103b60 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.651+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac1a6e20 con 0x7f97ac103b60 2024-09-21T00:57:33.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.652+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97ac063b50 con 0x7f97ac103b60 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.653+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f979c042030 con 0x7f97ac103b60 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.654+0000 7f97a8ff9640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97980b65a0 0x7f97980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.654+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f979c107ed0 con 0x7f97ac103b60 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.654+0000 7f97aaffd640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97980b65a0 0x7f97980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.654+0000 7f97a8ff9640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] conn(0x7f97980bff90 0x7f97980c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.654+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 --> [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97980c2b50 con 0x7f97980bff90 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.654+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f979c1083b0 con 0x7f97ac103b60 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.655+0000 7f97abfff640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] conn(0x7f97980bff90 0x7f97980c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.655+0000 7f97aaffd640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97980b65a0 0x7f97980b8ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f97ac1064c0 tx=0x7f979400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.655+0000 7f97abfff640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] conn(0x7f97980bff90 0x7f97980c2480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:33.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.656+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 <== osd.9 v2:172.21.15.47:6826/525420370 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97980c2b50 con 0x7f97980bff90 2024-09-21T00:57:33.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.670+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 --> [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f97ac063fd0 con 0x7f97980bff90 2024-09-21T00:57:33.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.670+0000 7f97a8ff9640 1 -- 172.21.15.47:0/4224518812 <== osd.9 v2:172.21.15.47:6826/525420370 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f97ac063fd0 con 0x7f97980bff90 2024-09-21T00:57:33.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] conn(0x7f97980bff90 msgr2=0x7f97980c2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] conn(0x7f97980bff90 0x7f97980c2480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97980b65a0 msgr2=0x7f97980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f97980b65a0 0x7f97980b8ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f97ac1064c0 tx=0x7f979400b390 comp rx=0 tx=0).stop 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 msgr2=0x7f97ac19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 --2- 172.21.15.47:0/4224518812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97ac103b60 0x7f97ac19a460 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f979c005940 tx=0x7f979c0042f0 comp rx=0 tx=0).stop 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97abfff640 1 -- 172.21.15.47:0/4224518812 reap_dead start 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 shutdown_connections 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 >> 172.21.15.47:0/4224518812 conn(0x7f97ac07b850 msgr2=0x7f97ac107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 shutdown_connections 2024-09-21T00:57:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:33.671+0000 7f97b1cb1640 1 -- 172.21.15.47:0/4224518812 wait complete. 2024-09-21T00:57:34.382 INFO:teuthology.orchestra.run.smithi047.stdout:77309411394 2024-09-21T00:57:34.382 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T00:57:34.837 INFO:teuthology.orchestra.run.smithi047.stdout:270582939673 2024-09-21T00:57:34.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T00:57:35.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:34 smithi134 ceph-mon[34785]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:35.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:34 smithi114 ceph-mon[34309]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:35.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:34 smithi047 ceph-mon[30960]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T00:57:35.403 INFO:teuthology.orchestra.run.smithi047.stdout:227633266723 2024-09-21T00:57:35.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T00:57:36.043 INFO:teuthology.orchestra.run.smithi047.stdout:180388626479 2024-09-21T00:57:36.043 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T00:57:36.702 INFO:teuthology.orchestra.run.smithi047.stdout:154618822706 2024-09-21T00:57:36.702 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T00:57:36.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:36 smithi047 ceph-mon[30960]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 861 B/s rd, 1 op/s; 12 B/s, 0 objects/s recovering 2024-09-21T00:57:37.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:36 smithi134 ceph-mon[34785]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 861 B/s rd, 1 op/s; 12 B/s, 0 objects/s recovering 2024-09-21T00:57:37.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:36 smithi114 ceph-mon[34309]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 861 B/s rd, 1 op/s; 12 B/s, 0 objects/s recovering 2024-09-21T00:57:37.417 INFO:teuthology.orchestra.run.smithi047.stdout:296352743442 2024-09-21T00:57:37.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T00:57:37.905 INFO:teuthology.orchestra.run.smithi047.stdout:249108103200 2024-09-21T00:57:37.905 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T00:57:38.002 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.012 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.015 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.025 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.033 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.073 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.331 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:38.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:38 smithi047 ceph-mon[30960]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T00:57:39.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:38 smithi134 ceph-mon[34785]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T00:57:39.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:38 smithi114 ceph-mon[34309]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T00:57:39.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2674958433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 msgr2=0x7fa6a810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:39.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2674958433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 0x7fa6a810f520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009ca0 tx=0x7fa6a002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:39.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2674958433 shutdown_connections 2024-09-21T00:57:39.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2674958433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 0x7fa6a810f520 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:39.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2674958433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6a81083a0 0x7fa6a81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:39.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2674958433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a8102a60 0x7fa6a8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2674958433 >> 172.21.15.47:0/2674958433 conn(0x7fa6a8079730 msgr2=0x7fa6a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2674958433 shutdown_connections 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.818+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2674958433 wait complete. 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6ad7a0640 1 Processor -- start 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6ad7a0640 1 -- start start 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6ad7a0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6a8102a60 0x7fa6a80ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6ad7a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81083a0 0x7fa6a80ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6ad7a0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 0x7fa6a81000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6ad7a0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8112960 con 0x7fa6a8108cf0 2024-09-21T00:57:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6ad7a0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a81127e0 con 0x7fa6a8102a60 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6ad7a0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8112ae0 con 0x7fa6a81083a0 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6a77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 0x7fa6a81000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6a77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 0x7fa6a81000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45588/0 (socket says 172.21.15.47:45588) 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6a77fe640 1 -- 172.21.15.47:0/2026136743 learned_addr learned my addr 172.21.15.47:0/2026136743 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6a6ffd640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6a8102a60 0x7fa6a80ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.819+0000 7fa6a67fc640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81083a0 0x7fa6a80ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa6a77fe640 1 -- 172.21.15.47:0/2026136743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81083a0 msgr2=0x7fa6a80ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa6a77fe640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81083a0 0x7fa6a80ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa6a77fe640 1 -- 172.21.15.47:0/2026136743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6a8102a60 msgr2=0x7fa6a80ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa6a77fe640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6a8102a60 0x7fa6a80ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa6a77fe640 1 -- 172.21.15.47:0/2026136743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a81a86c0 con 0x7fa6a8108cf0 2024-09-21T00:57:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa6a77fe640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 0x7fa6a81000f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0005cc0 tx=0x7fa6a002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa68ffff640 1 -- 172.21.15.47:0/2026136743 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0003bf0 con 0x7fa6a8108cf0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a81a8950 con 0x7fa6a8108cf0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa68ffff640 1 -- 172.21.15.47:0/2026136743 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6a0003d90 con 0x7fa6a8108cf0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa68ffff640 1 -- 172.21.15.47:0/2026136743 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a002fbc0 con 0x7fa6a8108cf0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.820+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a81a8e90 con 0x7fa6a8108cf0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.821+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a8102e70 con 0x7fa6a8108cf0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.823+0000 7fa68ffff640 1 -- 172.21.15.47:0/2026136743 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa6a002fd60 con 0x7fa6a8108cf0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.824+0000 7fa68ffff640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa6900b65a0 0x7fa6900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.824+0000 7fa6a6ffd640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa6900b65a0 0x7fa6900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.825+0000 7fa68ffff640 1 -- 172.21.15.47:0/2026136743 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa6a0108980 con 0x7fa6a8108cf0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.825+0000 7fa6a6ffd640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa6900b65a0 0x7fa6900b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa6a81010c0 tx=0x7fa69800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:39.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.828+0000 7fa68ffff640 1 -- 172.21.15.47:0/2026136743 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6a00cf1b0 con 0x7fa6a8108cf0 2024-09-21T00:57:40.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.016+0000 7efd4beb9640 1 -- 172.21.15.47:0/1514487392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd441083a0 msgr2=0x7efd441087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.016+0000 7efd4beb9640 1 --2- 172.21.15.47:0/1514487392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd441083a0 0x7efd441087b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efd38009900 tx=0x7efd3802a410 comp rx=0 tx=0).stop 2024-09-21T00:57:40.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.016+0000 7efd4beb9640 1 -- 172.21.15.47:0/1514487392 shutdown_connections 2024-09-21T00:57:40.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.016+0000 7efd4beb9640 1 --2- 172.21.15.47:0/1514487392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd44108cf0 0x7efd4410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.016+0000 7efd4beb9640 1 --2- 172.21.15.47:0/1514487392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd441083a0 0x7efd441087b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.016+0000 7efd4beb9640 1 --2- 172.21.15.47:0/1514487392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd44102a60 0x7efd44102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.016+0000 7efd4beb9640 1 -- 172.21.15.47:0/1514487392 >> 172.21.15.47:0/1514487392 conn(0x7efd44079730 msgr2=0x7efd44079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.017+0000 7efd4beb9640 1 -- 172.21.15.47:0/1514487392 shutdown_connections 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.017+0000 7efd4beb9640 1 -- 172.21.15.47:0/1514487392 wait complete. 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.017+0000 7efd4beb9640 1 Processor -- start 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.017+0000 7efd4beb9640 1 -- start start 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd4beb9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102a60 0x7efd4419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd4beb9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd441083a0 0x7efd4419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd4beb9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd44108cf0 0x7efd4419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd4beb9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efd44112960 con 0x7efd44102a60 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd4beb9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efd441127e0 con 0x7efd441083a0 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd4beb9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd44112ae0 con 0x7efd44108cf0 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102a60 0x7efd4419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102a60 0x7efd4419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45602/0 (socket says 172.21.15.47:45602) 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 -- 172.21.15.47:0/2751495516 learned_addr learned my addr 172.21.15.47:0/2751495516 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49454640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd441083a0 0x7efd4419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd4a456640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd44108cf0 0x7efd4419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 -- 172.21.15.47:0/2751495516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd44108cf0 msgr2=0x7efd4419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd44108cf0 0x7efd4419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 -- 172.21.15.47:0/2751495516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd441083a0 msgr2=0x7efd4419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd441083a0 0x7efd4419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 -- 172.21.15.47:0/2751495516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd441a0490 con 0x7efd44102a60 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49454640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd441083a0 0x7efd4419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd49c55640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102a60 0x7efd4419a520 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efd3400ea80 tx=0x7efd3400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd42ffd640 1 -- 172.21.15.47:0/2751495516 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3400ce40 con 0x7efd44102a60 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd441a0780 con 0x7efd44102a60 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.018+0000 7efd42ffd640 1 -- 172.21.15.47:0/2751495516 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd34005020 con 0x7efd44102a60 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.019+0000 7efd42ffd640 1 -- 172.21.15.47:0/2751495516 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd340116d0 con 0x7efd44102a60 2024-09-21T00:57:40.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.019+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd441a6ee0 con 0x7efd44102a60 2024-09-21T00:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.020+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd44102e70 con 0x7efd44102a60 2024-09-21T00:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.021+0000 7efd42ffd640 1 -- 172.21.15.47:0/2751495516 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7efd340054d0 con 0x7efd44102a60 2024-09-21T00:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.022+0000 7efd42ffd640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7efd2c0b65a0 0x7efd2c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.023+0000 7efd49454640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7efd2c0b65a0 0x7efd2c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.023+0000 7efd42ffd640 1 -- 172.21.15.47:0/2751495516 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7efd340e7c30 con 0x7efd44102a60 2024-09-21T00:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.023+0000 7efd49454640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7efd2c0b65a0 0x7efd2c0b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efd380096c0 tx=0x7efd38031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.025+0000 7efd42ffd640 1 -- 172.21.15.47:0/2751495516 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd34016030 con 0x7efd44102a60 2024-09-21T00:57:40.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.057+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa6a802e640 con 0x7fa6a8108cf0 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.057+0000 7fa68ffff640 1 -- 172.21.15.47:0/2026136743 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa6a00ca070 con 0x7fa6a8108cf0 2024-09-21T00:57:40.058 INFO:teuthology.orchestra.run.smithi047.stdout:154618822708 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.059+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa6900b65a0 msgr2=0x7fa6900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.059+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa6900b65a0 0x7fa6900b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa6a81010c0 tx=0x7fa69800b390 comp rx=0 tx=0).stop 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.059+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 msgr2=0x7fa6a81000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.059+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 0x7fa6a81000f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0005cc0 tx=0x7fa6a002f380 comp rx=0 tx=0).stop 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.059+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 shutdown_connections 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.060+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa6900b65a0 0x7fa6900b8ab0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.060+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6a8108cf0 0x7fa6a81000f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.060+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81083a0 0x7fa6a80ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.060+0000 7fa6ad7a0640 1 --2- 172.21.15.47:0/2026136743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6a8102a60 0x7fa6a80ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.060+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 >> 172.21.15.47:0/2026136743 conn(0x7fa6a8079730 msgr2=0x7fa6a806b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.060+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 shutdown_connections 2024-09-21T00:57:40.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.060+0000 7fa6ad7a0640 1 -- 172.21.15.47:0/2026136743 wait complete. 2024-09-21T00:57:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.233+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efd4419b650 con 0x7efd44102a60 2024-09-21T00:57:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.233+0000 7efd42ffd640 1 -- 172.21.15.47:0/2751495516 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efd340ae360 con 0x7efd44102a60 2024-09-21T00:57:40.234 INFO:teuthology.orchestra.run.smithi047.stdout:111669149759 2024-09-21T00:57:40.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7efd2c0b65a0 msgr2=0x7efd2c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7efd2c0b65a0 0x7efd2c0b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efd380096c0 tx=0x7efd38031400 comp rx=0 tx=0).stop 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102a60 msgr2=0x7efd4419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102a60 0x7efd4419a520 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efd3400ea80 tx=0x7efd3400ef40 comp rx=0 tx=0).stop 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 shutdown_connections 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7efd2c0b65a0 0x7efd2c0b8ab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd44108cf0 0x7efd4419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd441083a0 0x7efd4419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 --2- 172.21.15.47:0/2751495516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102a60 0x7efd4419a520 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 >> 172.21.15.47:0/2751495516 conn(0x7efd44079730 msgr2=0x7efd4406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 shutdown_connections 2024-09-21T00:57:40.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:40.236+0000 7efd4beb9640 1 -- 172.21.15.47:0/2751495516 wait complete. 2024-09-21T00:57:40.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 -- 172.21.15.47:0/14916897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 msgr2=0x7f79ec110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 --2- 172.21.15.47:0/14916897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 0x7f79ec110620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009ca0 tx=0x7f79e402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 -- 172.21.15.47:0/14916897 shutdown_connections 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 --2- 172.21.15.47:0/14916897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 0x7f79ec110620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 --2- 172.21.15.47:0/14916897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79ec1094a0 0x7f79ec1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 --2- 172.21.15.47:0/14916897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec103b60 0x7f79ec103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 -- 172.21.15.47:0/14916897 >> 172.21.15.47:0/14916897 conn(0x7f79ec07b850 msgr2=0x7f79ec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 -- 172.21.15.47:0/14916897 shutdown_connections 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.676+0000 7f79f3f38640 1 -- 172.21.15.47:0/14916897 wait complete. 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f3f38640 1 Processor -- start 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f3f38640 1 -- start start 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f3f38640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79ec103b60 0x7f79ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f3f38640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec1094a0 0x7f79ec075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f3f38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 0x7f79ec076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f3f38640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec113ab0 con 0x7f79ec109df0 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f3f38640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec113930 con 0x7f79ec1094a0 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f3f38640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec113c30 con 0x7f79ec103b60 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f24d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 0x7f79ec076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f24d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 0x7f79ec076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45572/0 (socket says 172.21.15.47:45572) 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f24d5640 1 -- 172.21.15.47:0/2593691888 learned_addr learned my addr 172.21.15.47:0/2593691888 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f1cd4640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79ec103b60 0x7f79ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.677+0000 7f79f14d3640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec1094a0 0x7f79ec075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79f24d5640 1 -- 172.21.15.47:0/2593691888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79ec103b60 msgr2=0x7f79ec075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79f24d5640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79ec103b60 0x7f79ec075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.622 INFO:teuthology.orchestra.run.smithi047.stdout:270582939675 2024-09-21T00:57:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79f24d5640 1 -- 172.21.15.47:0/2593691888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec1094a0 msgr2=0x7f79ec075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79f24d5640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec1094a0 0x7f79ec075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79f24d5640 1 -- 172.21.15.47:0/2593691888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec1a8820 con 0x7f79ec109df0 2024-09-21T00:57:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79f24d5640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 0x7f79ec076190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f79e40098d0 tx=0x7f79e40317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79e2ffd640 1 -- 172.21.15.47:0/2593691888 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4003b70 con 0x7f79ec109df0 2024-09-21T00:57:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec1a8ab0 con 0x7f79ec109df0 2024-09-21T00:57:40.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79e2ffd640 1 -- 172.21.15.47:0/2593691888 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79e4003d10 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79e2ffd640 1 -- 172.21.15.47:0/2593691888 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e402fa20 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.678+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec1a9040 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.679+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ec103f70 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.681+0000 7f79e2ffd640 1 -- 172.21.15.47:0/2593691888 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f79e402fc20 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.681+0000 7f79e2ffd640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79d80b65a0 0x7f79d80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.682+0000 7f79f1cd4640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79d80b65a0 0x7f79d80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.682+0000 7f79e2ffd640 1 -- 172.21.15.47:0/2593691888 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f79e4108860 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.682+0000 7f79f1cd4640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79d80b65a0 0x7f79d80b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79ec077160 tx=0x7f79e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.685+0000 7f79e2ffd640 1 -- 172.21.15.47:0/2593691888 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79e40cf090 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.877+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f79ec076a10 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.878+0000 7f79e2ffd640 1 -- 172.21.15.47:0/2593691888 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f79e40d3470 con 0x7f79ec109df0 2024-09-21T00:57:40.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79d80b65a0 msgr2=0x7f79d80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79d80b65a0 0x7f79d80b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79ec077160 tx=0x7f79e8005f90 comp rx=0 tx=0).stop 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 msgr2=0x7f79ec076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 0x7f79ec076190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f79e40098d0 tx=0x7f79e40317b0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 shutdown_connections 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79d80b65a0 0x7f79d80b8ab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79ec109df0 0x7f79ec076190 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec1094a0 0x7f79ec075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 --2- 172.21.15.47:0/2593691888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79ec103b60 0x7f79ec075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 >> 172.21.15.47:0/2593691888 conn(0x7f79ec07b850 msgr2=0x7f79ec1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 shutdown_connections 2024-09-21T00:57:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:39.881+0000 7f79f3f38640 1 -- 172.21.15.47:0/2593691888 wait complete. 2024-09-21T00:57:40.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:40 smithi047 ceph-mon[30960]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:57:40.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:40 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2593691888' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:57:40.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:40 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2026136743' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:57:40.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:40 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2751495516' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:57:41.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:40 smithi134 ceph-mon[34785]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:57:41.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:40 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2593691888' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:57:41.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:40 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2026136743' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:57:41.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:40 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2751495516' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:57:41.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:40 smithi114 ceph-mon[34309]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:57:41.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:40 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2593691888' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T00:57:41.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:40 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2026136743' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T00:57:41.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:40 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2751495516' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T00:57:41.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.322+0000 7fad9e030640 1 -- 172.21.15.47:0/3027602215 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 msgr2=0x7fad981087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.322+0000 7fad9e030640 1 --2- 172.21.15.47:0/3027602215 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 0x7fad981087b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009900 tx=0x7fad8c02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.322+0000 7fad9e030640 1 -- 172.21.15.47:0/3027602215 shutdown_connections 2024-09-21T00:57:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.322+0000 7fad9e030640 1 --2- 172.21.15.47:0/3027602215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad98108cf0 0x7fad9810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.322+0000 7fad9e030640 1 --2- 172.21.15.47:0/3027602215 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 0x7fad981087b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.323+0000 7fad9e030640 1 --2- 172.21.15.47:0/3027602215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad98102a60 0x7fad98102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.323+0000 7fad9e030640 1 -- 172.21.15.47:0/3027602215 >> 172.21.15.47:0/3027602215 conn(0x7fad98079730 msgr2=0x7fad98079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.323+0000 7fad9e030640 1 -- 172.21.15.47:0/3027602215 shutdown_connections 2024-09-21T00:57:41.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.323+0000 7fad9e030640 1 -- 172.21.15.47:0/3027602215 wait complete. 2024-09-21T00:57:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.323+0000 7fad9e030640 1 Processor -- start 2024-09-21T00:57:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad9e030640 1 -- start start 2024-09-21T00:57:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad9e030640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad98102a60 0x7fad980ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad9e030640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 0x7fad980ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad9e030640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad98108cf0 0x7fad981000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad9e030640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fad98112960 con 0x7fad981083a0 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad9e030640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fad981127e0 con 0x7fad98108cf0 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad9e030640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad98112ae0 con 0x7fad98102a60 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 0x7fad980ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 0x7fad980ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45624/0 (socket says 172.21.15.47:45624) 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad96ffd640 1 -- 172.21.15.47:0/4030086566 learned_addr learned my addr 172.21.15.47:0/4030086566 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.324+0000 7fad977fe640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad98102a60 0x7fad980ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad97fff640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad98108cf0 0x7fad981000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad96ffd640 1 -- 172.21.15.47:0/4030086566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad98102a60 msgr2=0x7fad980ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad96ffd640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad98102a60 0x7fad980ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad96ffd640 1 -- 172.21.15.47:0/4030086566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad98108cf0 msgr2=0x7fad981000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad96ffd640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad98108cf0 0x7fad981000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad96ffd640 1 -- 172.21.15.47:0/4030086566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad981a8820 con 0x7fad981083a0 2024-09-21T00:57:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad97fff640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad98108cf0 0x7fad981000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad96ffd640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 0x7fad980ffbb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006010 tx=0x7fad8c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad94ff9640 1 -- 172.21.15.47:0/4030086566 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c03f030 con 0x7fad981083a0 2024-09-21T00:57:41.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad981a8ab0 con 0x7fad981083a0 2024-09-21T00:57:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad94ff9640 1 -- 172.21.15.47:0/4030086566 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad8c003aa0 con 0x7fad981083a0 2024-09-21T00:57:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad981a8fe0 con 0x7fad981083a0 2024-09-21T00:57:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.325+0000 7fad94ff9640 1 -- 172.21.15.47:0/4030086566 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c035070 con 0x7fad981083a0 2024-09-21T00:57:41.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.326+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad98102e70 con 0x7fad981083a0 2024-09-21T00:57:41.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.328+0000 7fad94ff9640 1 -- 172.21.15.47:0/4030086566 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fad8c042030 con 0x7fad981083a0 2024-09-21T00:57:41.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.329+0000 7fad94ff9640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fad800b6620 0x7fad800b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:41.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.329+0000 7fad977fe640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fad800b6620 0x7fad800b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:41.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.329+0000 7fad94ff9640 1 -- 172.21.15.47:0/4030086566 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fad8c107d20 con 0x7fad981083a0 2024-09-21T00:57:41.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.330+0000 7fad977fe640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fad800b6620 0x7fad800b8b30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fad981010c0 tx=0x7fad88005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:41.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.336+0000 7fad94ff9640 1 -- 172.21.15.47:0/4030086566 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad8c0ce450 con 0x7fad981083a0 2024-09-21T00:57:41.440 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939673 got 270582939675 for osd.10 2024-09-21T00:57:41.440 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:41.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.531+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fad9810baf0 con 0x7fad981083a0 2024-09-21T00:57:41.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.532+0000 7fad94ff9640 1 -- 172.21.15.47:0/4030086566 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad8c0d2830 con 0x7fad981083a0 2024-09-21T00:57:41.533 INFO:teuthology.orchestra.run.smithi047.stdout:34359738447 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fad800b6620 msgr2=0x7fad800b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fad800b6620 0x7fad800b8b30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fad981010c0 tx=0x7fad88005f90 comp rx=0 tx=0).stop 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 msgr2=0x7fad980ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 0x7fad980ffbb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006010 tx=0x7fad8c004060 comp rx=0 tx=0).stop 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 shutdown_connections 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fad800b6620 0x7fad800b8b30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad98108cf0 0x7fad981000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad981083a0 0x7fad980ffbb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 --2- 172.21.15.47:0/4030086566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad98102a60 0x7fad980ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:41.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 >> 172.21.15.47:0/4030086566 conn(0x7fad98079730 msgr2=0x7fad9806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:41.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 shutdown_connections 2024-09-21T00:57:41.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:41.535+0000 7fad9e030640 1 -- 172.21.15.47:0/4030086566 wait complete. 2024-09-21T00:57:42.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:41 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4030086566' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:57:42.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:41 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4030086566' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 -- 172.21.15.47:0/2122367642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 msgr2=0x7fed9c112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 --2- 172.21.15.47:0/2122367642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 0x7fed9c112500 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fed94009ca0 tx=0x7fed9402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 -- 172.21.15.47:0/2122367642 shutdown_connections 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 --2- 172.21.15.47:0/2122367642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 0x7fed9c112500 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 --2- 172.21.15.47:0/2122367642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9c076100 0x7fed9c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 --2- 172.21.15.47:0/2122367642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c0757b0 0x7fed9c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 -- 172.21.15.47:0/2122367642 >> 172.21.15.47:0/2122367642 conn(0x7fed9c07b850 msgr2=0x7fed9c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 -- 172.21.15.47:0/2122367642 shutdown_connections 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.100+0000 7feda4185640 1 -- 172.21.15.47:0/2122367642 wait complete. 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda4185640 1 Processor -- start 2024-09-21T00:57:42.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda4185640 1 -- start start 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda4185640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9c0757b0 0x7fed9c19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda4185640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c076100 0x7fed9c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda4185640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 0x7fed9c1a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda4185640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c115c70 con 0x7fed9c1100c0 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda4185640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c115af0 con 0x7fed9c0757b0 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda4185640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c115df0 con 0x7fed9c076100 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda2722640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 0x7fed9c1a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda2722640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 0x7fed9c1a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37918/0 (socket says 172.21.15.47:37918) 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda2722640 1 -- 172.21.15.47:0/1466531552 learned_addr learned my addr 172.21.15.47:0/1466531552 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.101+0000 7feda1720640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c076100 0x7fed9c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda1f21640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9c0757b0 0x7fed9c19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:42.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda2722640 1 -- 172.21.15.47:0/1466531552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c076100 msgr2=0x7fed9c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda2722640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c076100 0x7fed9c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda2722640 1 -- 172.21.15.47:0/1466531552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9c0757b0 msgr2=0x7fed9c19c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda2722640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9c0757b0 0x7fed9c19c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda2722640 1 -- 172.21.15.47:0/1466531552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c1a25f0 con 0x7fed9c1100c0 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda1f21640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9c0757b0 0x7fed9c19c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda2722640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 0x7fed9c1a1ec0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed940098d0 tx=0x7fed940317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7fed92ffd640 1 -- 172.21.15.47:0/1466531552 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94003b70 con 0x7fed9c1100c0 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7fed92ffd640 1 -- 172.21.15.47:0/1466531552 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed94003d10 con 0x7fed9c1100c0 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c1a2880 con 0x7fed9c1100c0 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7fed92ffd640 1 -- 172.21.15.47:0/1466531552 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9402fa20 con 0x7fed9c1100c0 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.102+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c1a9040 con 0x7fed9c1100c0 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.103+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9c075bc0 con 0x7fed9c1100c0 2024-09-21T00:57:42.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.105+0000 7fed92ffd640 1 -- 172.21.15.47:0/1466531552 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fed9402fbe0 con 0x7fed9c1100c0 2024-09-21T00:57:42.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.106+0000 7fed92ffd640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fed880b65a0 0x7fed880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:42.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.106+0000 7feda1f21640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fed880b65a0 0x7fed880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:42.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.106+0000 7fed92ffd640 1 -- 172.21.15.47:0/1466531552 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fed94108870 con 0x7fed9c1100c0 2024-09-21T00:57:42.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.106+0000 7feda1f21640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fed880b65a0 0x7fed880b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fed98009c20 tx=0x7fed98005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:42.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.109+0000 7fed92ffd640 1 -- 172.21.15.47:0/1466531552 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed940cf0a0 con 0x7fed9c1100c0 2024-09-21T00:57:42.161 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:41 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4030086566' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T00:57:42.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.302+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fed9c1a9240 con 0x7fed9c1100c0 2024-09-21T00:57:42.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.302+0000 7fed92ffd640 1 -- 172.21.15.47:0/1466531552 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fed940d3480 con 0x7fed9c1100c0 2024-09-21T00:57:42.303 INFO:teuthology.orchestra.run.smithi047.stdout:133143986234 2024-09-21T00:57:42.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.304+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fed880b65a0 msgr2=0x7fed880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.304+0000 7feda4185640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fed880b65a0 0x7fed880b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fed98009c20 tx=0x7fed98005f90 comp rx=0 tx=0).stop 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 msgr2=0x7fed9c1a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 0x7fed9c1a1ec0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed940098d0 tx=0x7fed940317b0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 shutdown_connections 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fed880b65a0 0x7fed880b8ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed9c1100c0 0x7fed9c1a1ec0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c076100 0x7fed9c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 --2- 172.21.15.47:0/1466531552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9c0757b0 0x7fed9c19c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 >> 172.21.15.47:0/1466531552 conn(0x7fed9c07b850 msgr2=0x7fed9c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 shutdown_connections 2024-09-21T00:57:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.305+0000 7feda4185640 1 -- 172.21.15.47:0/1466531552 wait complete. 2024-09-21T00:57:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.361+0000 7f4675848640 1 -- 172.21.15.47:0/3387772509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4670108d20 msgr2=0x7f467010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.361+0000 7f4675848640 1 --2- 172.21.15.47:0/3387772509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4670108d20 0x7f467010f550 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4668009900 tx=0x7f466802a410 comp rx=0 tx=0).stop 2024-09-21T00:57:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.361+0000 7f4675848640 1 -- 172.21.15.47:0/3387772509 shutdown_connections 2024-09-21T00:57:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.361+0000 7f4675848640 1 --2- 172.21.15.47:0/3387772509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4670108d20 0x7f467010f550 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.361+0000 7f4675848640 1 --2- 172.21.15.47:0/3387772509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46701083d0 0x7f46701087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.361+0000 7f4675848640 1 --2- 172.21.15.47:0/3387772509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4670102ae0 0x7f4670102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.362+0000 7f4675848640 1 -- 172.21.15.47:0/3387772509 >> 172.21.15.47:0/3387772509 conn(0x7f4670079760 msgr2=0x7f4670079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.362+0000 7f4675848640 1 -- 172.21.15.47:0/3387772509 shutdown_connections 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.362+0000 7f4675848640 1 -- 172.21.15.47:0/3387772509 wait complete. 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f4675848640 1 Processor -- start 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f4675848640 1 -- start start 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f4675848640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4670102ae0 0x7f4670199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f4675848640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46701083d0 0x7f46701998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f4675848640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4670108d20 0x7f467019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f4675848640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4670112990 con 0x7f46701083d0 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f4675848640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4670112810 con 0x7f4670102ae0 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f4675848640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4670112b10 con 0x7f4670108d20 2024-09-21T00:57:42.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f466e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46701083d0 0x7f46701998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f466e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46701083d0 0x7f46701998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37936/0 (socket says 172.21.15.47:37936) 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f466f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4670108d20 0x7f467019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.363+0000 7f466e7fc640 1 -- 172.21.15.47:0/3501188375 learned_addr learned my addr 172.21.15.47:0/3501188375 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f466effd640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4670102ae0 0x7f4670199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f466e7fc640 1 -- 172.21.15.47:0/3501188375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4670108d20 msgr2=0x7f467019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f466e7fc640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4670108d20 0x7f467019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f466e7fc640 1 -- 172.21.15.47:0/3501188375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4670102ae0 msgr2=0x7f4670199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f466e7fc640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4670102ae0 0x7f4670199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f466e7fc640 1 -- 172.21.15.47:0/3501188375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467019f290 con 0x7f46701083d0 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f466f7fe640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4670108d20 0x7f467019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f466e7fc640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46701083d0 0x7f46701998c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f466400ebc0 tx=0x7f466400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f4674846640 1 -- 172.21.15.47:0/3501188375 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664004d20 con 0x7f46701083d0 2024-09-21T00:57:42.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f4674846640 1 -- 172.21.15.47:0/3501188375 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46640054d0 con 0x7f46701083d0 2024-09-21T00:57:42.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467019f580 con 0x7f46701083d0 2024-09-21T00:57:42.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f4674846640 1 -- 172.21.15.47:0/3501188375 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664010720 con 0x7f46701083d0 2024-09-21T00:57:42.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.364+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46701a5ce0 con 0x7f46701083d0 2024-09-21T00:57:42.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.365+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4670102ef0 con 0x7f46701083d0 2024-09-21T00:57:42.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.367+0000 7f4674846640 1 -- 172.21.15.47:0/3501188375 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f4664005020 con 0x7f46701083d0 2024-09-21T00:57:42.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.368+0000 7f4674846640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46580b6620 0x7f46580b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:42.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.368+0000 7f466effd640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46580b6620 0x7f46580b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:42.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.368+0000 7f4674846640 1 -- 172.21.15.47:0/3501188375 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f46640e7db0 con 0x7f46701083d0 2024-09-21T00:57:42.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.369+0000 7f466effd640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46580b6620 0x7f46580b8b30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4660009b60 tx=0x7f4660005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:42.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.372+0000 7f4674846640 1 -- 172.21.15.47:0/3501188375 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46640ae4e0 con 0x7f46701083d0 2024-09-21T00:57:42.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.562+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f467002e640 con 0x7f46701083d0 2024-09-21T00:57:42.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.563+0000 7f4674846640 1 -- 172.21.15.47:0/3501188375 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f46640b28c0 con 0x7f46701083d0 2024-09-21T00:57:42.564 INFO:teuthology.orchestra.run.smithi047.stdout:227633266726 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46580b6620 msgr2=0x7f46580b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46580b6620 0x7f46580b8b30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4660009b60 tx=0x7f4660005f90 comp rx=0 tx=0).stop 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46701083d0 msgr2=0x7f46701998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46701083d0 0x7f46701998c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f466400ebc0 tx=0x7f466400c6a0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 shutdown_connections 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46580b6620 0x7f46580b8b30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4670108d20 0x7f467019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46701083d0 0x7f46701998c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 --2- 172.21.15.47:0/3501188375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4670102ae0 0x7f4670199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 >> 172.21.15.47:0/3501188375 conn(0x7f4670079760 msgr2=0x7f46701043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:42.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 shutdown_connections 2024-09-21T00:57:42.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:42.565+0000 7f4675848640 1 -- 172.21.15.47:0/3501188375 wait complete. 2024-09-21T00:57:43.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:42 smithi134 ceph-mon[34785]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:57:43.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:42 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1466531552' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:57:43.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:42 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3501188375' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:57:43.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:42 smithi114 ceph-mon[34309]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:57:43.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:42 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1466531552' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:57:43.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:42 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3501188375' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:57:43.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:42 smithi047 ceph-mon[30960]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T00:57:43.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:42 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1466531552' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T00:57:43.172 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:42 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3501188375' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T00:57:43.203 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149757 got 111669149759 for osd.3 2024-09-21T00:57:43.203 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 -- 172.21.15.47:0/1954788211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84109e40 msgr2=0x7f8f84110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 --2- 172.21.15.47:0/1954788211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84109e40 0x7f8f84110670 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009ca0 tx=0x7f8f7c02a8e0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 -- 172.21.15.47:0/1954788211 shutdown_connections 2024-09-21T00:57:43.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 --2- 172.21.15.47:0/1954788211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84109e40 0x7f8f84110670 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 --2- 172.21.15.47:0/1954788211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f841094f0 0x7f8f84109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 --2- 172.21.15.47:0/1954788211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f84103bb0 0x7f8f84103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 -- 172.21.15.47:0/1954788211 >> 172.21.15.47:0/1954788211 conn(0x7f8f840ff600 msgr2=0x7f8f84101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:43.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 -- 172.21.15.47:0/1954788211 shutdown_connections 2024-09-21T00:57:43.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.352+0000 7f8f8b025640 1 -- 172.21.15.47:0/1954788211 wait complete. 2024-09-21T00:57:43.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f8b025640 1 Processor -- start 2024-09-21T00:57:43.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f8b025640 1 -- start start 2024-09-21T00:57:43.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f8b025640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84103bb0 0x7f8f8419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f8b025640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841094f0 0x7f8f8419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f8b025640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f84109e40 0x7f8f8419fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f8b025640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f84113bc0 con 0x7f8f84103bb0 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f8b025640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8f84113a40 con 0x7f8f841094f0 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f8b025640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f84113d40 con 0x7f8f84109e40 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f88dc1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84103bb0 0x7f8f8419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f88dc1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84103bb0 0x7f8f8419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37944/0 (socket says 172.21.15.47:37944) 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.353+0000 7f8f88dc1640 1 -- 172.21.15.47:0/3664617163 learned_addr learned my addr 172.21.15.47:0/3664617163 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f895c2640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f84109e40 0x7f8f8419fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f83fff640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841094f0 0x7f8f8419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f88dc1640 1 -- 172.21.15.47:0/3664617163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f84109e40 msgr2=0x7f8f8419fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f88dc1640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f84109e40 0x7f8f8419fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f88dc1640 1 -- 172.21.15.47:0/3664617163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841094f0 msgr2=0x7f8f8419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f88dc1640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841094f0 0x7f8f8419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f88dc1640 1 -- 172.21.15.47:0/3664617163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f841a05a0 con 0x7f8f84103bb0 2024-09-21T00:57:43.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f83fff640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841094f0 0x7f8f8419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f88dc1640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84103bb0 0x7f8f8419a630 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400b4a0 tx=0x7f8f7400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f81ffb640 1 -- 172.21.15.47:0/3664617163 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74014070 con 0x7f8f84103bb0 2024-09-21T00:57:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f81ffb640 1 -- 172.21.15.47:0/3664617163 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f74010ac0 con 0x7f8f84103bb0 2024-09-21T00:57:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f841a0890 con 0x7f8f84103bb0 2024-09-21T00:57:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.354+0000 7f8f81ffb640 1 -- 172.21.15.47:0/3664617163 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74017c30 con 0x7f8f84103bb0 2024-09-21T00:57:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.355+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f841a6ff0 con 0x7f8f84103bb0 2024-09-21T00:57:43.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.355+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f84104040 con 0x7f8f84103bb0 2024-09-21T00:57:43.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.357+0000 7f8f81ffb640 1 -- 172.21.15.47:0/3664617163 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8f74017070 con 0x7f8f84103bb0 2024-09-21T00:57:43.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.358+0000 7f8f81ffb640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8f700b6620 0x7f8f700b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:43.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.358+0000 7f8f83fff640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8f700b6620 0x7f8f700b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:43.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.358+0000 7f8f81ffb640 1 -- 172.21.15.47:0/3664617163 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8f740e68b0 con 0x7f8f84103bb0 2024-09-21T00:57:43.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.358+0000 7f8f83fff640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8f700b6620 0x7f8f700b8b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c006fd0 tx=0x7f8f6c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:43.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.361+0000 7f8f81ffb640 1 -- 172.21.15.47:0/3664617163 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f740ad0e0 con 0x7f8f84103bb0 2024-09-21T00:57:43.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.554+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8f8419b760 con 0x7f8f84103bb0 2024-09-21T00:57:43.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.554+0000 7f8f81ffb640 1 -- 172.21.15.47:0/3664617163 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f8419b760 con 0x7f8f84103bb0 2024-09-21T00:57:43.556 INFO:teuthology.orchestra.run.smithi047.stdout:77309411396 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.556+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8f700b6620 msgr2=0x7f8f700b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.556+0000 7f8f8b025640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8f700b6620 0x7f8f700b8b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c006fd0 tx=0x7f8f6c008040 comp rx=0 tx=0).stop 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.556+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84103bb0 msgr2=0x7f8f8419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.556+0000 7f8f8b025640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84103bb0 0x7f8f8419a630 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400b4a0 tx=0x7f8f7400b960 comp rx=0 tx=0).stop 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.557+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 shutdown_connections 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.557+0000 7f8f8b025640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8f700b6620 0x7f8f700b8b30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.557+0000 7f8f8b025640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f84109e40 0x7f8f8419fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.557+0000 7f8f8b025640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841094f0 0x7f8f8419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.557+0000 7f8f8b025640 1 --2- 172.21.15.47:0/3664617163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f84103bb0 0x7f8f8419a630 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.557+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 >> 172.21.15.47:0/3664617163 conn(0x7f8f840ff600 msgr2=0x7f8f84101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.557+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 shutdown_connections 2024-09-21T00:57:43.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:43.557+0000 7f8f8b025640 1 -- 172.21.15.47:0/3664617163 wait complete. 2024-09-21T00:57:44.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:43 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3664617163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:57:44.095 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:43 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3664617163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:57:44.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:43 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3664617163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T00:57:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 -- 172.21.15.47:0/1637864954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 msgr2=0x7fa1441087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 --2- 172.21.15.47:0/1637864954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 0x7fa1441087e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa134009900 tx=0x7fa13402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 -- 172.21.15.47:0/1637864954 shutdown_connections 2024-09-21T00:57:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 --2- 172.21.15.47:0/1637864954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa144108d20 0x7fa14410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 --2- 172.21.15.47:0/1637864954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 0x7fa1441087e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 --2- 172.21.15.47:0/1637864954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144102ae0 0x7fa144102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 -- 172.21.15.47:0/1637864954 >> 172.21.15.47:0/1637864954 conn(0x7fa1440797b0 msgr2=0x7fa144079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 -- 172.21.15.47:0/1637864954 shutdown_connections 2024-09-21T00:57:44.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.187+0000 7fa14c319640 1 -- 172.21.15.47:0/1637864954 wait complete. 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.188+0000 7fa14c319640 1 Processor -- start 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.188+0000 7fa14c319640 1 -- start start 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.188+0000 7fa14c319640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144102ae0 0x7fa1440ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.188+0000 7fa14c319640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 0x7fa1440ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.188+0000 7fa14c319640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa144108d20 0x7fa1441000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.188+0000 7fa14c319640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1441129e0 con 0x7fa1441083d0 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.188+0000 7fa14c319640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa144112860 con 0x7fa144108d20 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.188+0000 7fa14c319640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa144112b60 con 0x7fa144102ae0 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 0x7fa1440ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 0x7fa1440ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37972/0 (socket says 172.21.15.47:37972) 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 -- 172.21.15.47:0/3175431196 learned_addr learned my addr 172.21.15.47:0/3175431196 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa14a8b6640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa144108d20 0x7fa1441000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa14a0b5640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144102ae0 0x7fa1440ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 -- 172.21.15.47:0/3175431196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144102ae0 msgr2=0x7fa1440ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144102ae0 0x7fa1440ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 -- 172.21.15.47:0/3175431196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa144108d20 msgr2=0x7fa1441000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa144108d20 0x7fa1441000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 -- 172.21.15.47:0/3175431196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1441a87a0 con 0x7fa1441083d0 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa14a0b5640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144102ae0 0x7fa1440ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa1498b4640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 0x7fa1440ffbb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa13402a930 tx=0x7fa134004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa13b7fe640 1 -- 172.21.15.47:0/3175431196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13403f030 con 0x7fa1441083d0 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa13b7fe640 1 -- 172.21.15.47:0/3175431196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa134003aa0 con 0x7fa1441083d0 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1441a8a30 con 0x7fa1441083d0 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa13b7fe640 1 -- 172.21.15.47:0/3175431196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134035070 con 0x7fa1441083d0 2024-09-21T00:57:44.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.189+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1441a8f10 con 0x7fa1441083d0 2024-09-21T00:57:44.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.190+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa144102ef0 con 0x7fa1441083d0 2024-09-21T00:57:44.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.192+0000 7fa13b7fe640 1 -- 172.21.15.47:0/3175431196 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa134042030 con 0x7fa1441083d0 2024-09-21T00:57:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.193+0000 7fa13b7fe640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa1300b65a0 0x7fa1300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.193+0000 7fa14a0b5640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa1300b65a0 0x7fa1300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.193+0000 7fa13b7fe640 1 -- 172.21.15.47:0/3175431196 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa134107f60 con 0x7fa1441083d0 2024-09-21T00:57:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.193+0000 7fa14a0b5640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa1300b65a0 0x7fa1300b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa1441010c0 tx=0x7fa140005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:44.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.196+0000 7fa13b7fe640 1 -- 172.21.15.47:0/3175431196 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa1340ce790 con 0x7fa1441083d0 2024-09-21T00:57:44.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.390+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa144100970 con 0x7fa1441083d0 2024-09-21T00:57:44.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.391+0000 7fa13b7fe640 1 -- 172.21.15.47:0/3175431196 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa1340d2b70 con 0x7fa1441083d0 2024-09-21T00:57:44.393 INFO:teuthology.orchestra.run.smithi047.stdout:55834574922 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa1300b65a0 msgr2=0x7fa1300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa1300b65a0 0x7fa1300b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa1441010c0 tx=0x7fa140005e70 comp rx=0 tx=0).stop 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 msgr2=0x7fa1440ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 0x7fa1440ffbb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa13402a930 tx=0x7fa134004270 comp rx=0 tx=0).stop 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 shutdown_connections 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa1300b65a0 0x7fa1300b8ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa144108d20 0x7fa1441000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1441083d0 0x7fa1440ffbb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 --2- 172.21.15.47:0/3175431196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa144102ae0 0x7fa1440ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 >> 172.21.15.47:0/3175431196 conn(0x7fa1440797b0 msgr2=0x7fa144101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 shutdown_connections 2024-09-21T00:57:44.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:44.393+0000 7fa14c319640 1 -- 172.21.15.47:0/3175431196 wait complete. 2024-09-21T00:57:44.645 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738447 for osd.0 2024-09-21T00:57:44.645 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:44.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:44 smithi047 ceph-mon[30960]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:44.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:44 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3175431196' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:57:44.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:44 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:57:45.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:44 smithi134 ceph-mon[34785]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:45.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:44 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3175431196' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:57:45.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:44 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:57:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:44 smithi114 ceph-mon[34309]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:44 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3175431196' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T00:57:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:44 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:57:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 -- 172.21.15.47:0/946066527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c1094d0 msgr2=0x7f8e3c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 --2- 172.21.15.47:0/946066527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c1094d0 0x7f8e3c1098e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009900 tx=0x7f8e3002a410 comp rx=0 tx=0).stop 2024-09-21T00:57:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 -- 172.21.15.47:0/946066527 shutdown_connections 2024-09-21T00:57:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 --2- 172.21.15.47:0/946066527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e3c109e20 0x7f8e3c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 --2- 172.21.15.47:0/946066527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c1094d0 0x7f8e3c1098e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 --2- 172.21.15.47:0/946066527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3c103b90 0x7f8e3c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 -- 172.21.15.47:0/946066527 >> 172.21.15.47:0/946066527 conn(0x7f8e3c0ff600 msgr2=0x7f8e3c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 -- 172.21.15.47:0/946066527 shutdown_connections 2024-09-21T00:57:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.228+0000 7f8e415b4640 1 -- 172.21.15.47:0/946066527 wait complete. 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.229+0000 7f8e415b4640 1 Processor -- start 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.229+0000 7f8e415b4640 1 -- start start 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e415b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c103b90 0x7f8e3c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e415b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e3c1094d0 0x7f8e3c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e415b4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3c109e20 0x7f8e3c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e415b4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c113ae0 con 0x7f8e3c103b90 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e415b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c113960 con 0x7f8e3c1094d0 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e415b4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c113c60 con 0x7f8e3c109e20 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c103b90 0x7f8e3c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c103b90 0x7f8e3c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37994/0 (socket says 172.21.15.47:37994) 2024-09-21T00:57:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e3c1094d0 0x7f8e3c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3affd640 1 -- 172.21.15.47:0/2472447759 learned_addr learned my addr 172.21.15.47:0/2472447759 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3b7fe640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3c109e20 0x7f8e3c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3affd640 1 -- 172.21.15.47:0/2472447759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3c109e20 msgr2=0x7f8e3c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3affd640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3c109e20 0x7f8e3c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3affd640 1 -- 172.21.15.47:0/2472447759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e3c1094d0 msgr2=0x7f8e3c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.230+0000 7f8e3affd640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e3c1094d0 0x7f8e3c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.231+0000 7f8e3affd640 1 -- 172.21.15.47:0/2472447759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c1a87b0 con 0x7f8e3c103b90 2024-09-21T00:57:45.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.231+0000 7f8e3a7fc640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e3c1094d0 0x7f8e3c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:57:45.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.231+0000 7f8e3affd640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c103b90 0x7f8e3c075710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00d950 tx=0x7f8e2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:45.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.231+0000 7f8e23fff640 1 -- 172.21.15.47:0/2472447759 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c017030 con 0x7f8e3c103b90 2024-09-21T00:57:45.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.231+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3c1a8aa0 con 0x7f8e3c103b90 2024-09-21T00:57:45.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.231+0000 7f8e23fff640 1 -- 172.21.15.47:0/2472447759 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e2c004020 con 0x7f8e3c103b90 2024-09-21T00:57:45.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.231+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3c1a9000 con 0x7f8e3c103b90 2024-09-21T00:57:45.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.232+0000 7f8e23fff640 1 -- 172.21.15.47:0/2472447759 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0047a0 con 0x7f8e3c103b90 2024-09-21T00:57:45.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.233+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3c103fa0 con 0x7f8e3c103b90 2024-09-21T00:57:45.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.234+0000 7f8e23fff640 1 -- 172.21.15.47:0/2472447759 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8e2c009a30 con 0x7f8e3c103b90 2024-09-21T00:57:45.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.236+0000 7f8e23fff640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8e240b6620 0x7f8e240b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.236+0000 7f8e3a7fc640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8e240b6620 0x7f8e240b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.236+0000 7f8e23fff640 1 -- 172.21.15.47:0/2472447759 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8e2c0e72e0 con 0x7f8e3c103b90 2024-09-21T00:57:45.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.236+0000 7f8e3a7fc640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8e240b6620 0x7f8e240b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009230 tx=0x7f8e30031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:45.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.239+0000 7f8e23fff640 1 -- 172.21.15.47:0/2472447759 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e2c0adb90 con 0x7f8e3c103b90 2024-09-21T00:57:45.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.440+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8e3c02e640 con 0x7f8e3c103b90 2024-09-21T00:57:45.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.440+0000 7f8e23fff640 1 -- 172.21.15.47:0/2472447759 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8e2c0b1f70 con 0x7f8e3c103b90 2024-09-21T00:57:45.442 INFO:teuthology.orchestra.run.smithi047.stdout:197568495659 2024-09-21T00:57:45.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.442+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8e240b6620 msgr2=0x7f8e240b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.442+0000 7f8e415b4640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8e240b6620 0x7f8e240b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009230 tx=0x7f8e30031400 comp rx=0 tx=0).stop 2024-09-21T00:57:45.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.442+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c103b90 msgr2=0x7f8e3c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.442+0000 7f8e415b4640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c103b90 0x7f8e3c075710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00d950 tx=0x7f8e2c00de10 comp rx=0 tx=0).stop 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.443+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 shutdown_connections 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.443+0000 7f8e415b4640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8e240b6620 0x7f8e240b8b30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.443+0000 7f8e415b4640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e3c109e20 0x7f8e3c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.443+0000 7f8e415b4640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e3c1094d0 0x7f8e3c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.443+0000 7f8e415b4640 1 --2- 172.21.15.47:0/2472447759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e3c103b90 0x7f8e3c075710 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.443+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 >> 172.21.15.47:0/2472447759 conn(0x7f8e3c0ff600 msgr2=0x7f8e3c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.443+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 shutdown_connections 2024-09-21T00:57:45.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.443+0000 7f8e415b4640 1 -- 172.21.15.47:0/2472447759 wait complete. 2024-09-21T00:57:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 -- 172.21.15.47:0/1411009404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 msgr2=0x7fc650104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 --2- 172.21.15.47:0/1411009404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 0x7fc650104df0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009900 tx=0x7fc64c02a410 comp rx=0 tx=0).stop 2024-09-21T00:57:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 -- 172.21.15.47:0/1411009404 shutdown_connections 2024-09-21T00:57:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 --2- 172.21.15.47:0/1411009404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc65010de40 0x7fc650110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 --2- 172.21.15.47:0/1411009404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc650105330 0x7fc65010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 --2- 172.21.15.47:0/1411009404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 0x7fc650104df0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 -- 172.21.15.47:0/1411009404 >> 172.21.15.47:0/1411009404 conn(0x7fc650079750 msgr2=0x7fc650079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:45.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 -- 172.21.15.47:0/1411009404 shutdown_connections 2024-09-21T00:57:45.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.570+0000 7fc657eea640 1 -- 172.21.15.47:0/1411009404 wait complete. 2024-09-21T00:57:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc657eea640 1 Processor -- start 2024-09-21T00:57:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc657eea640 1 -- start start 2024-09-21T00:57:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc657eea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 0x7fc650102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc657eea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc650105330 0x7fc650102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc657eea640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc65010de40 0x7fc6501031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc657eea640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc650113b20 con 0x7fc6501049e0 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc657eea640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6501139a0 con 0x7fc65010de40 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc657eea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc650113ca0 con 0x7fc650105330 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc655c86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 0x7fc650102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc655c86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 0x7fc650102720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38018/0 (socket says 172.21.15.47:38018) 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.571+0000 7fc655c86640 1 -- 172.21.15.47:0/2282401113 learned_addr learned my addr 172.21.15.47:0/2282401113 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc655485640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc650105330 0x7fc650102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc656487640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc65010de40 0x7fc6501031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc655c86640 1 -- 172.21.15.47:0/2282401113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc650105330 msgr2=0x7fc650102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc655c86640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc650105330 0x7fc650102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc655c86640 1 -- 172.21.15.47:0/2282401113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc65010de40 msgr2=0x7fc6501031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc655c86640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc65010de40 0x7fc6501031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc655c86640 1 -- 172.21.15.47:0/2282401113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6501a8890 con 0x7fc6501049e0 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc655c86640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 0x7fc650102720 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc64c032fd0 tx=0x7fc64c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:45.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc646ffd640 1 -- 172.21.15.47:0/2282401113 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c03f030 con 0x7fc6501049e0 2024-09-21T00:57:45.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6501a8b20 con 0x7fc6501049e0 2024-09-21T00:57:45.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc646ffd640 1 -- 172.21.15.47:0/2282401113 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc64c004490 con 0x7fc6501049e0 2024-09-21T00:57:45.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc646ffd640 1 -- 172.21.15.47:0/2282401113 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c035070 con 0x7fc6501049e0 2024-09-21T00:57:45.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.572+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6501a9050 con 0x7fc6501049e0 2024-09-21T00:57:45.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.573+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc65006c280 con 0x7fc6501049e0 2024-09-21T00:57:45.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.576+0000 7fc646ffd640 1 -- 172.21.15.47:0/2282401113 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fc64c042030 con 0x7fc6501049e0 2024-09-21T00:57:45.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.577+0000 7fc646ffd640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc63c0b65a0 0x7fc63c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:45.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.577+0000 7fc655485640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc63c0b65a0 0x7fc63c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:45.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.577+0000 7fc646ffd640 1 -- 172.21.15.47:0/2282401113 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fc64c107db0 con 0x7fc6501049e0 2024-09-21T00:57:45.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.577+0000 7fc655485640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc63c0b65a0 0x7fc63c0b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc640005fd0 tx=0x7fc640005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:45.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.580+0000 7fc646ffd640 1 -- 172.21.15.47:0/2282401113 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc64c0ce5e0 con 0x7fc6501049e0 2024-09-21T00:57:45.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.771+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fc650104df0 con 0x7fc6501049e0 2024-09-21T00:57:45.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.772+0000 7fc646ffd640 1 -- 172.21.15.47:0/2282401113 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc650104df0 con 0x7fc6501049e0 2024-09-21T00:57:45.774 INFO:teuthology.orchestra.run.smithi047.stdout:296352743446 2024-09-21T00:57:45.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc63c0b65a0 msgr2=0x7fc63c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc63c0b65a0 0x7fc63c0b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc640005fd0 tx=0x7fc640005850 comp rx=0 tx=0).stop 2024-09-21T00:57:45.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 msgr2=0x7fc650102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 0x7fc650102720 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc64c032fd0 tx=0x7fc64c004270 comp rx=0 tx=0).stop 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 shutdown_connections 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc63c0b65a0 0x7fc63c0b8ab0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc65010de40 0x7fc6501031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc650105330 0x7fc650102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 --2- 172.21.15.47:0/2282401113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6501049e0 0x7fc650102720 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.774+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 >> 172.21.15.47:0/2282401113 conn(0x7fc650079750 msgr2=0x7fc6501008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.775+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 shutdown_connections 2024-09-21T00:57:45.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:45.775+0000 7fc657eea640 1 -- 172.21.15.47:0/2282401113 wait complete. 2024-09-21T00:57:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:45 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2472447759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:57:46.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:45 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2282401113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:57:46.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:45 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2472447759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:57:46.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:45 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2282401113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:57:46.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:45 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2472447759' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T00:57:46.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:45 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2282401113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T00:57:46.630 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495656 got 197568495659 for osd.7 2024-09-21T00:57:46.630 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:47 smithi047 ceph-mon[30960]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:47 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.267 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266723 got 227633266726 for osd.8 2024-09-21T00:57:47.267 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:47 smithi134 ceph-mon[34785]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:47 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:47 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:47 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:47 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:47 smithi114 ceph-mon[34309]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:47.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:47 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:47 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:47 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:47 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:47.675 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743442 got 296352743446 for osd.11 2024-09-21T00:57:47.676 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:47.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822706 got 154618822708 for osd.5 2024-09-21T00:57:47.800 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:48.249 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411396 for osd.2 2024-09-21T00:57:48.249 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:48.687 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:48.723 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574922 for osd.1 2024-09-21T00:57:48.723 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:49.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:49 smithi047 ceph-mon[30960]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:49.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:49 smithi134 ceph-mon[34785]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:49.346 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:49.377 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986231 got 133143986234 for osd.4 2024-09-21T00:57:49.378 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:49.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:49 smithi114 ceph-mon[34309]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 -- 172.21.15.47:0/4292887637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 msgr2=0x7f3df01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/4292887637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 0x7f3df01098c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009900 tx=0x7f3de002a410 comp rx=0 tx=0).stop 2024-09-21T00:57:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 -- 172.21.15.47:0/4292887637 shutdown_connections 2024-09-21T00:57:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/4292887637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df0109e00 0x7f3df0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/4292887637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 0x7f3df01098c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/4292887637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3df0103bc0 0x7f3df0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 -- 172.21.15.47:0/4292887637 >> 172.21.15.47:0/4292887637 conn(0x7f3df007b910 msgr2=0x7f3df007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 -- 172.21.15.47:0/4292887637 shutdown_connections 2024-09-21T00:57:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.928+0000 7f3df7cfa640 1 -- 172.21.15.47:0/4292887637 wait complete. 2024-09-21T00:57:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df7cfa640 1 Processor -- start 2024-09-21T00:57:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df7cfa640 1 -- start start 2024-09-21T00:57:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df7cfa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3df0103bc0 0x7f3df0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df7cfa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 0x7f3df0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df7cfa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df0109e00 0x7f3df0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df7cfa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3df0113ac0 con 0x7f3df01094b0 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df7cfa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3df0113940 con 0x7f3df0103bc0 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df7cfa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3df0113c40 con 0x7f3df0109e00 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5295640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 0x7f3df0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5295640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 0x7f3df0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38062/0 (socket says 172.21.15.47:38062) 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5295640 1 -- 172.21.15.47:0/3485810979 learned_addr learned my addr 172.21.15.47:0/3485810979 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df6297640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df0109e00 0x7f3df0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5a96640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3df0103bc0 0x7f3df0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5295640 1 -- 172.21.15.47:0/3485810979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df0109e00 msgr2=0x7f3df0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5295640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df0109e00 0x7f3df0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5295640 1 -- 172.21.15.47:0/3485810979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3df0103bc0 msgr2=0x7f3df0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5295640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3df0103bc0 0x7f3df0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:49.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5295640 1 -- 172.21.15.47:0/3485810979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df01a8700 con 0x7f3df01094b0 2024-09-21T00:57:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.929+0000 7f3df5a96640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3df0103bc0 0x7f3df0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.930+0000 7f3df5295640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 0x7f3df0075c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3de002a930 tx=0x7f3de0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.930+0000 7f3de6ffd640 1 -- 172.21.15.47:0/3485810979 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de003f030 con 0x7f3df01094b0 2024-09-21T00:57:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.930+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df01a8990 con 0x7f3df01094b0 2024-09-21T00:57:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.930+0000 7f3de6ffd640 1 -- 172.21.15.47:0/3485810979 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3de0003aa0 con 0x7f3df01094b0 2024-09-21T00:57:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.930+0000 7f3de6ffd640 1 -- 172.21.15.47:0/3485810979 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0035070 con 0x7f3df01094b0 2024-09-21T00:57:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.930+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df01a8e70 con 0x7f3df01094b0 2024-09-21T00:57:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.931+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df0103fd0 con 0x7f3df01094b0 2024-09-21T00:57:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.933+0000 7f3de6ffd640 1 -- 172.21.15.47:0/3485810979 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f3de0042030 con 0x7f3df01094b0 2024-09-21T00:57:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.933+0000 7f3de6ffd640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3ddc0b65a0 0x7f3ddc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.934+0000 7f3de6ffd640 1 -- 172.21.15.47:0/3485810979 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f3de0107ac0 con 0x7f3df01094b0 2024-09-21T00:57:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.934+0000 7f3df5a96640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3ddc0b65a0 0x7f3ddc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.934+0000 7f3df5a96640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3ddc0b65a0 0x7f3ddc0b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005fd0 tx=0x7f3dec005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:49.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.938+0000 7f3de6ffd640 1 -- 172.21.15.47:0/3485810979 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3de00ce2f0 con 0x7f3df01094b0 2024-09-21T00:57:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 -- 172.21.15.47:0/69450201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3738103bc0 msgr2=0x7f3738103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 --2- 172.21.15.47:0/69450201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3738103bc0 0x7f3738103fd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3734009900 tx=0x7f373402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 -- 172.21.15.47:0/69450201 shutdown_connections 2024-09-21T00:57:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 --2- 172.21.15.47:0/69450201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3738109e00 0x7f3738110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 --2- 172.21.15.47:0/69450201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37381094b0 0x7f37381098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 --2- 172.21.15.47:0/69450201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3738103bc0 0x7f3738103fd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 -- 172.21.15.47:0/69450201 >> 172.21.15.47:0/69450201 conn(0x7f373807b910 msgr2=0x7f373807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:50.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 -- 172.21.15.47:0/69450201 shutdown_connections 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.817+0000 7f373fbc8640 1 -- 172.21.15.47:0/69450201 wait complete. 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.818+0000 7f373fbc8640 1 Processor -- start 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.818+0000 7f373fbc8640 1 -- start start 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.818+0000 7f373fbc8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3738103bc0 0x7f3738075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.818+0000 7f373fbc8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37381094b0 0x7f3738075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.818+0000 7f373fbc8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3738109e00 0x7f3738076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.818+0000 7f373fbc8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3738113ac0 con 0x7f37381094b0 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.818+0000 7f373fbc8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3738113940 con 0x7f3738103bc0 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.818+0000 7f373fbc8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3738113c40 con 0x7f3738109e00 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37381094b0 0x7f3738075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37381094b0 0x7f3738075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38034/0 (socket says 172.21.15.47:38034) 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 -- 172.21.15.47:0/2033799295 learned_addr learned my addr 172.21.15.47:0/2033799295 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d964640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3738103bc0 0x7f3738075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:50.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373e165640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3738109e00 0x7f3738076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 -- 172.21.15.47:0/2033799295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3738109e00 msgr2=0x7f3738076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3738109e00 0x7f3738076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 -- 172.21.15.47:0/2033799295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3738103bc0 msgr2=0x7f3738075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3738103bc0 0x7f3738075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 -- 172.21.15.47:0/2033799295 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37381a8730 con 0x7f37381094b0 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373d163640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37381094b0 0x7f3738075c50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f372800d950 tx=0x7f372800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f372effd640 1 -- 172.21.15.47:0/2033799295 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728017070 con 0x7f37381094b0 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f372effd640 1 -- 172.21.15.47:0/2033799295 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3728009c30 con 0x7f37381094b0 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37381a8a20 con 0x7f37381094b0 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f372effd640 1 -- 172.21.15.47:0/2033799295 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37280047a0 con 0x7f37381094b0 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.819+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37381a8f60 con 0x7f37381094b0 2024-09-21T00:57:50.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.820+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3738103fd0 con 0x7f37381094b0 2024-09-21T00:57:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.822+0000 7f372effd640 1 -- 172.21.15.47:0/2033799295 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f3728004020 con 0x7f37381094b0 2024-09-21T00:57:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.823+0000 7f372effd640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37240b65a0 0x7f37240b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.823+0000 7f373d964640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37240b65a0 0x7f37240b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.823+0000 7f372effd640 1 -- 172.21.15.47:0/2033799295 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f37280e7580 con 0x7f37381094b0 2024-09-21T00:57:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.823+0000 7f373d964640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37240b65a0 0x7f37240b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3734000c00 tx=0x7f3734031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:50.048 INFO:teuthology.orchestra.run.smithi047.stdout:180388626481 2024-09-21T00:57:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:49.826+0000 7f372effd640 1 -- 172.21.15.47:0/2033799295 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3728020020 con 0x7f37381094b0 2024-09-21T00:57:50.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.020+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3738076a10 con 0x7f37381094b0 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.021+0000 7f372effd640 1 -- 172.21.15.47:0/2033799295 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3738076a10 con 0x7f37381094b0 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37240b65a0 msgr2=0x7f37240b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37240b65a0 0x7f37240b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3734000c00 tx=0x7f3734031400 comp rx=0 tx=0).stop 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37381094b0 msgr2=0x7f3738075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37381094b0 0x7f3738075c50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f372800d950 tx=0x7f372800de10 comp rx=0 tx=0).stop 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 shutdown_connections 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37240b65a0 0x7f37240b8ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3738109e00 0x7f3738076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37381094b0 0x7f3738075c50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 --2- 172.21.15.47:0/2033799295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3738103bc0 0x7f3738075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 >> 172.21.15.47:0/2033799295 conn(0x7f373807b910 msgr2=0x7f3738107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 shutdown_connections 2024-09-21T00:57:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.023+0000 7f373fbc8640 1 -- 172.21.15.47:0/2033799295 wait complete. 2024-09-21T00:57:50.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.133+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f3df002e640 con 0x7f3df01094b0 2024-09-21T00:57:50.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.133+0000 7f3de6ffd640 1 -- 172.21.15.47:0/3485810979 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3de00d26d0 con 0x7f3df01094b0 2024-09-21T00:57:50.135 INFO:teuthology.orchestra.run.smithi047.stdout:249108103203 2024-09-21T00:57:50.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3ddc0b65a0 msgr2=0x7f3ddc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3ddc0b65a0 0x7f3ddc0b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005fd0 tx=0x7f3dec005850 comp rx=0 tx=0).stop 2024-09-21T00:57:50.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 msgr2=0x7f3df0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:50.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 0x7f3df0075c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3de002a930 tx=0x7f3de0004270 comp rx=0 tx=0).stop 2024-09-21T00:57:50.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 shutdown_connections 2024-09-21T00:57:50.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3ddc0b65a0 0x7f3ddc0b8ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df0109e00 0x7f3df0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df01094b0 0x7f3df0075c50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 --2- 172.21.15.47:0/3485810979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3df0103bc0 0x7f3df0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:50.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.135+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 >> 172.21.15.47:0/3485810979 conn(0x7f3df007b910 msgr2=0x7f3df01055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:50.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.136+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 shutdown_connections 2024-09-21T00:57:50.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:50.136+0000 7f3df7cfa640 1 -- 172.21.15.47:0/3485810979 wait complete. 2024-09-21T00:57:50.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:50 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2033799295' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:57:50.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:50 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2033799295' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:57:50.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:50 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2033799295' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T00:57:50.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626481 for osd.6 2024-09-21T00:57:50.688 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:51.304 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:51 smithi047 ceph-mon[30960]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:51.305 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:51 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3485810979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:57:51.338 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103200 got 249108103203 for osd.9 2024-09-21T00:57:51.338 DEBUG:teuthology.parallel:result is None 2024-09-21T00:57:51.339 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T00:57:51.339 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:57:51.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:51 smithi134 ceph-mon[34785]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:51.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:51 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3485810979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:57:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:51 smithi114 ceph-mon[34309]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:51 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3485810979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T00:57:52.125 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.594+0000 7f2cd2b27640 1 -- 172.21.15.47:0/392194563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 msgr2=0x7f2ccc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.594+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/392194563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 0x7f2ccc10f540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009ca0 tx=0x7f2cc402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.594+0000 7f2cd2b27640 1 -- 172.21.15.47:0/392194563 shutdown_connections 2024-09-21T00:57:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.594+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/392194563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 0x7f2ccc10f540 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.594+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/392194563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ccc1083c0 0x7f2ccc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.594+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/392194563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ccc102a80 0x7f2ccc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.594+0000 7f2cd2b27640 1 -- 172.21.15.47:0/392194563 >> 172.21.15.47:0/392194563 conn(0x7f2ccc079740 msgr2=0x7f2ccc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.595+0000 7f2cd2b27640 1 -- 172.21.15.47:0/392194563 shutdown_connections 2024-09-21T00:57:52.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.595+0000 7f2cd2b27640 1 -- 172.21.15.47:0/392194563 wait complete. 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.595+0000 7f2cd2b27640 1 Processor -- start 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.595+0000 7f2cd2b27640 1 -- start start 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd2b27640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ccc102a80 0x7f2ccc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd2b27640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ccc1083c0 0x7f2ccc19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd2b27640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 0x7f2ccc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd2b27640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc113b00 con 0x7f2ccc108d10 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd2b27640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc113980 con 0x7f2ccc102a80 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd2b27640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc113c80 con 0x7f2ccc1083c0 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 0x7f2ccc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 0x7f2ccc19fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57134/0 (socket says 172.21.15.47:57134) 2024-09-21T00:57:52.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 -- 172.21.15.47:0/726509520 learned_addr learned my addr 172.21.15.47:0/726509520 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2ccbfff640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ccc1083c0 0x7f2ccc19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd08c3640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ccc102a80 0x7f2ccc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 -- 172.21.15.47:0/726509520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ccc1083c0 msgr2=0x7f2ccc19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ccc1083c0 0x7f2ccc19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 -- 172.21.15.47:0/726509520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ccc102a80 msgr2=0x7f2ccc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ccc102a80 0x7f2ccc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 -- 172.21.15.47:0/726509520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc1a0420 con 0x7f2ccc108d10 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cd10c4640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 0x7f2ccc19fcf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4005cc0 tx=0x7f2cc402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.596+0000 7f2cc9ffb640 1 -- 172.21.15.47:0/726509520 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4003bf0 con 0x7f2ccc108d10 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.597+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ccc1a06b0 con 0x7f2ccc108d10 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.597+0000 7f2cc9ffb640 1 -- 172.21.15.47:0/726509520 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cc4003d90 con 0x7f2ccc108d10 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.597+0000 7f2cc9ffb640 1 -- 172.21.15.47:0/726509520 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc402fb20 con 0x7f2ccc108d10 2024-09-21T00:57:52.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.597+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ccc1a6e70 con 0x7f2ccc108d10 2024-09-21T00:57:52.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.598+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ccc103d00 con 0x7f2ccc108d10 2024-09-21T00:57:52.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.599+0000 7f2cc9ffb640 1 -- 172.21.15.47:0/726509520 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2cc4004580 con 0x7f2ccc108d10 2024-09-21T00:57:52.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.600+0000 7f2cc9ffb640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2cbc0b65a0 0x7f2cbc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:52.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.601+0000 7f2cd08c3640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2cbc0b65a0 0x7f2cbc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:52.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.601+0000 7f2cc9ffb640 1 -- 172.21.15.47:0/726509520 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f2cc4108940 con 0x7f2ccc108d10 2024-09-21T00:57:52.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.601+0000 7f2cd08c3640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2cbc0b65a0 0x7f2cbc0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009990 tx=0x7f2cc0009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:52.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.605+0000 7f2cc9ffb640 1 -- 172.21.15.47:0/726509520 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2cc40cf070 con 0x7f2ccc108d10 2024-09-21T00:57:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.796+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ccc10ab70 con 0x7f2cbc0b65a0 2024-09-21T00:57:52.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.800+0000 7f2cc9ffb640 1 -- 172.21.15.47:0/726509520 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258634 (secure 0 0 0) 0x7f2cc000e850 con 0x7f2cbc0b65a0 2024-09-21T00:57:52.804 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:52.805 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.804+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2cbc0b65a0 msgr2=0x7f2cbc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.804+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2cbc0b65a0 0x7f2cbc0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009990 tx=0x7f2cc0009110 comp rx=0 tx=0).stop 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.804+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 msgr2=0x7f2ccc19fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.804+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 0x7f2ccc19fcf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4005cc0 tx=0x7f2cc402f380 comp rx=0 tx=0).stop 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.805+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 shutdown_connections 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.805+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2cbc0b65a0 0x7f2cbc0b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.805+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ccc108d10 0x7f2ccc19fcf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.805+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ccc1083c0 0x7f2ccc19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.805+0000 7f2cd2b27640 1 --2- 172.21.15.47:0/726509520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ccc102a80 0x7f2ccc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:52.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.805+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 >> 172.21.15.47:0/726509520 conn(0x7f2ccc079740 msgr2=0x7f2ccc105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:52.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.805+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 shutdown_connections 2024-09-21T00:57:52.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:52.805+0000 7f2cd2b27640 1 -- 172.21.15.47:0/726509520 wait complete. 2024-09-21T00:57:53.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:53 smithi134 ceph-mon[34785]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:53.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:53 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:53.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:53 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:53.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:53 smithi114 ceph-mon[34309]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:53.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:53 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:53.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:53 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:53.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:53 smithi047 ceph-mon[30960]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:53.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:53 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:53.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:53 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:53.513 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-21T00:57:51.270408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658357,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":191,"num_read_kb":188,"num_write":208,"num_write_kb":2245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381816,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560008,"statfs":{"total":1151940427776,"available":1151549448192,"internally_reserved":0,"allocated":11980800,"data_stored":6800067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.763290+0000","last_change":"2024-09-21T00:56:48.655444+0000","last_active":"2024-09-21T00:57:26.763290+0000","last_peered":"2024-09-21T00:57:26.763290+0000","last_clean":"2024-09-21T00:57:26.763290+0000","last_became_active":"2024-09-21T00:56:48.655083+0000","last_became_peered":"2024-09-21T00:56:48.655083+0000","last_unstale":"2024-09-21T00:57:26.763290+0000","last_undegraded":"2024-09-21T00:57:26.763290+0000","last_fullsized":"2024-09-21T00:57:26.763290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:07.300682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858584+0000","last_change":"2024-09-21T00:56:48.655066+0000","last_active":"2024-09-21T00:57:26.858584+0000","last_peered":"2024-09-21T00:57:26.858584+0000","last_clean":"2024-09-21T00:57:26.858584+0000","last_became_active":"2024-09-21T00:56:48.654679+0000","last_became_peered":"2024-09-21T00:56:48.654679+0000","last_unstale":"2024-09-21T00:57:26.858584+0000","last_undegraded":"2024-09-21T00:57:26.858584+0000","last_fullsized":"2024-09-21T00:57:26.858584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859012+0000","last_change":"2024-09-21T00:56:48.648770+0000","last_active":"2024-09-21T00:57:26.859012+0000","last_peered":"2024-09-21T00:57:26.859012+0000","last_clean":"2024-09-21T00:57:26.859012+0000","last_became_active":"2024-09-21T00:56:48.648383+0000","last_became_peered":"2024-09-21T00:56:48.648383+0000","last_unstale":"2024-09-21T00:57:26.859012+0000","last_undegraded":"2024-09-21T00:57:26.859012+0000","last_fullsized":"2024-09-21T00:57:26.859012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.616648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.768638+0000","last_change":"2024-09-21T00:57:26.767724+0000","last_active":"2024-09-21T00:57:26.768638+0000","last_peered":"2024-09-21T00:57:26.768638+0000","last_clean":"2024-09-21T00:57:26.768638+0000","last_became_active":"2024-09-21T00:57:26.767233+0000","last_became_peered":"2024-09-21T00:57:26.767233+0000","last_unstale":"2024-09-21T00:57:26.768638+0000","last_undegraded":"2024-09-21T00:57:26.768638+0000","last_fullsized":"2024-09-21T00:57:26.768638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:41.905543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761011+0000","last_change":"2024-09-21T00:56:48.654307+0000","last_active":"2024-09-21T00:57:26.761011+0000","last_peered":"2024-09-21T00:57:26.761011+0000","last_clean":"2024-09-21T00:57:26.761011+0000","last_became_active":"2024-09-21T00:56:48.653898+0000","last_became_peered":"2024-09-21T00:56:48.653898+0000","last_unstale":"2024-09-21T00:57:26.761011+0000","last_undegraded":"2024-09-21T00:57:26.761011+0000","last_fullsized":"2024-09-21T00:57:26.761011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858766+0000","last_change":"2024-09-21T00:56:48.649950+0000","last_active":"2024-09-21T00:57:26.858766+0000","last_peered":"2024-09-21T00:57:26.858766+0000","last_clean":"2024-09-21T00:57:26.858766+0000","last_became_active":"2024-09-21T00:56:48.649305+0000","last_became_peered":"2024-09-21T00:56:48.649305+0000","last_unstale":"2024-09-21T00:57:26.858766+0000","last_undegraded":"2024-09-21T00:57:26.858766+0000","last_fullsized":"2024-09-21T00:57:26.858766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:56.456377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766670+0000","last_change":"2024-09-21T00:56:48.656109+0000","last_active":"2024-09-21T00:57:26.766670+0000","last_peered":"2024-09-21T00:57:26.766670+0000","last_clean":"2024-09-21T00:57:26.766670+0000","last_became_active":"2024-09-21T00:56:48.654465+0000","last_became_peered":"2024-09-21T00:56:48.654465+0000","last_unstale":"2024-09-21T00:57:26.766670+0000","last_undegraded":"2024-09-21T00:57:26.766670+0000","last_fullsized":"2024-09-21T00:57:26.766670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:05.779845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769201+0000","last_change":"2024-09-21T00:56:48.656351+0000","last_active":"2024-09-21T00:57:26.769201+0000","last_peered":"2024-09-21T00:57:26.769201+0000","last_clean":"2024-09-21T00:57:26.769201+0000","last_became_active":"2024-09-21T00:56:48.654388+0000","last_became_peered":"2024-09-21T00:56:48.654388+0000","last_unstale":"2024-09-21T00:57:26.769201+0000","last_undegraded":"2024-09-21T00:57:26.769201+0000","last_fullsized":"2024-09-21T00:57:26.769201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:39.441882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764916+0000","last_change":"2024-09-21T00:56:48.661083+0000","last_active":"2024-09-21T00:57:26.764916+0000","last_peered":"2024-09-21T00:57:26.764916+0000","last_clean":"2024-09-21T00:57:26.764916+0000","last_became_active":"2024-09-21T00:56:48.660418+0000","last_became_peered":"2024-09-21T00:56:48.660418+0000","last_unstale":"2024-09-21T00:57:26.764916+0000","last_undegraded":"2024-09-21T00:57:26.764916+0000","last_fullsized":"2024-09-21T00:57:26.764916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:02.494368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859192+0000","last_change":"2024-09-21T00:56:48.660257+0000","last_active":"2024-09-21T00:57:26.859192+0000","last_peered":"2024-09-21T00:57:26.859192+0000","last_clean":"2024-09-21T00:57:26.859192+0000","last_became_active":"2024-09-21T00:56:48.659894+0000","last_became_peered":"2024-09-21T00:56:48.659894+0000","last_unstale":"2024-09-21T00:57:26.859192+0000","last_undegraded":"2024-09-21T00:57:26.859192+0000","last_fullsized":"2024-09-21T00:57:26.859192+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.012107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767404+0000","last_change":"2024-09-21T00:56:48.653146+0000","last_active":"2024-09-21T00:57:26.767404+0000","last_peered":"2024-09-21T00:57:26.767404+0000","last_clean":"2024-09-21T00:57:26.767404+0000","last_became_active":"2024-09-21T00:56:48.652599+0000","last_became_peered":"2024-09-21T00:56:48.652599+0000","last_unstale":"2024-09-21T00:57:26.767404+0000","last_undegraded":"2024-09-21T00:57:26.767404+0000","last_fullsized":"2024-09-21T00:57:26.767404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:16.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766372+0000","last_change":"2024-09-21T00:56:48.659521+0000","last_active":"2024-09-21T00:57:26.766372+0000","last_peered":"2024-09-21T00:57:26.766372+0000","last_clean":"2024-09-21T00:57:26.766372+0000","last_became_active":"2024-09-21T00:56:48.658168+0000","last_became_peered":"2024-09-21T00:56:48.658168+0000","last_unstale":"2024-09-21T00:57:26.766372+0000","last_undegraded":"2024-09-21T00:57:26.766372+0000","last_fullsized":"2024-09-21T00:57:26.766372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:51.910450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859441+0000","last_change":"2024-09-21T00:56:48.652163+0000","last_active":"2024-09-21T00:57:26.859441+0000","last_peered":"2024-09-21T00:57:26.859441+0000","last_clean":"2024-09-21T00:57:26.859441+0000","last_became_active":"2024-09-21T00:56:48.651839+0000","last_became_peered":"2024-09-21T00:56:48.651839+0000","last_unstale":"2024-09-21T00:57:26.859441+0000","last_undegraded":"2024-09-21T00:57:26.859441+0000","last_fullsized":"2024-09-21T00:57:26.859441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:50.682747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858561+0000","last_change":"2024-09-21T00:56:48.655106+0000","last_active":"2024-09-21T00:57:26.858561+0000","last_peered":"2024-09-21T00:57:26.858561+0000","last_clean":"2024-09-21T00:57:26.858561+0000","last_became_active":"2024-09-21T00:56:48.654722+0000","last_became_peered":"2024-09-21T00:56:48.654722+0000","last_unstale":"2024-09-21T00:57:26.858561+0000","last_undegraded":"2024-09-21T00:57:26.858561+0000","last_fullsized":"2024-09-21T00:57:26.858561+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:36.023960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859259+0000","last_change":"2024-09-21T00:56:48.648935+0000","last_active":"2024-09-21T00:57:26.859259+0000","last_peered":"2024-09-21T00:57:26.859259+0000","last_clean":"2024-09-21T00:57:26.859259+0000","last_became_active":"2024-09-21T00:56:48.648557+0000","last_became_peered":"2024-09-21T00:56:48.648557+0000","last_unstale":"2024-09-21T00:57:26.859259+0000","last_undegraded":"2024-09-21T00:57:26.859259+0000","last_fullsized":"2024-09-21T00:57:26.859259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:17.791401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764496+0000","last_change":"2024-09-21T00:56:48.651338+0000","last_active":"2024-09-21T00:57:26.764496+0000","last_peered":"2024-09-21T00:57:26.764496+0000","last_clean":"2024-09-21T00:57:26.764496+0000","last_became_active":"2024-09-21T00:56:48.650940+0000","last_became_peered":"2024-09-21T00:56:48.650940+0000","last_unstale":"2024-09-21T00:57:26.764496+0000","last_undegraded":"2024-09-21T00:57:26.764496+0000","last_fullsized":"2024-09-21T00:57:26.764496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.763332+0000","last_change":"2024-09-21T00:56:48.655091+0000","last_active":"2024-09-21T00:57:26.763332+0000","last_peered":"2024-09-21T00:57:26.763332+0000","last_clean":"2024-09-21T00:57:26.763332+0000","last_became_active":"2024-09-21T00:56:48.654534+0000","last_became_peered":"2024-09-21T00:56:48.654534+0000","last_unstale":"2024-09-21T00:57:26.763332+0000","last_undegraded":"2024-09-21T00:57:26.763332+0000","last_fullsized":"2024-09-21T00:57:26.763332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:44.007171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760224+0000","last_change":"2024-09-21T00:56:48.654933+0000","last_active":"2024-09-21T00:57:26.760224+0000","last_peered":"2024-09-21T00:57:26.760224+0000","last_clean":"2024-09-21T00:57:26.760224+0000","last_became_active":"2024-09-21T00:56:48.654523+0000","last_became_peered":"2024-09-21T00:56:48.654523+0000","last_unstale":"2024-09-21T00:57:26.760224+0000","last_undegraded":"2024-09-21T00:57:26.760224+0000","last_fullsized":"2024-09-21T00:57:26.760224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:58.190118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766193+0000","last_change":"2024-09-21T00:56:48.645166+0000","last_active":"2024-09-21T00:57:26.766193+0000","last_peered":"2024-09-21T00:57:26.766193+0000","last_clean":"2024-09-21T00:57:26.766193+0000","last_became_active":"2024-09-21T00:56:48.644695+0000","last_became_peered":"2024-09-21T00:56:48.644695+0000","last_unstale":"2024-09-21T00:57:26.766193+0000","last_undegraded":"2024-09-21T00:57:26.766193+0000","last_fullsized":"2024-09-21T00:57:26.766193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:07.564405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.762869+0000","last_change":"2024-09-21T00:56:48.659215+0000","last_active":"2024-09-21T00:57:26.762869+0000","last_peered":"2024-09-21T00:57:26.762869+0000","last_clean":"2024-09-21T00:57:26.762869+0000","last_became_active":"2024-09-21T00:56:48.658783+0000","last_became_peered":"2024-09-21T00:56:48.658783+0000","last_unstale":"2024-09-21T00:57:26.762869+0000","last_undegraded":"2024-09-21T00:57:26.762869+0000","last_fullsized":"2024-09-21T00:57:26.762869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:08:58.663963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859549+0000","last_change":"2024-09-21T00:56:48.644461+0000","last_active":"2024-09-21T00:57:26.859549+0000","last_peered":"2024-09-21T00:57:26.859549+0000","last_clean":"2024-09-21T00:57:26.859549+0000","last_became_active":"2024-09-21T00:56:48.643842+0000","last_became_peered":"2024-09-21T00:56:48.643842+0000","last_unstale":"2024-09-21T00:57:26.859549+0000","last_undegraded":"2024-09-21T00:57:26.859549+0000","last_fullsized":"2024-09-21T00:57:26.859549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:12.673501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764701+0000","last_change":"2024-09-21T00:56:48.651212+0000","last_active":"2024-09-21T00:57:26.764701+0000","last_peered":"2024-09-21T00:57:26.764701+0000","last_clean":"2024-09-21T00:57:26.764701+0000","last_became_active":"2024-09-21T00:56:48.650802+0000","last_became_peered":"2024-09-21T00:56:48.650802+0000","last_unstale":"2024-09-21T00:57:26.764701+0000","last_undegraded":"2024-09-21T00:57:26.764701+0000","last_fullsized":"2024-09-21T00:57:26.764701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:06.310898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769255+0000","last_change":"2024-09-21T00:56:48.647772+0000","last_active":"2024-09-21T00:57:26.769255+0000","last_peered":"2024-09-21T00:57:26.769255+0000","last_clean":"2024-09-21T00:57:26.769255+0000","last_became_active":"2024-09-21T00:56:48.647379+0000","last_became_peered":"2024-09-21T00:56:48.647379+0000","last_unstale":"2024-09-21T00:57:26.769255+0000","last_undegraded":"2024-09-21T00:57:26.769255+0000","last_fullsized":"2024-09-21T00:57:26.769255+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:06.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769851+0000","last_change":"2024-09-21T00:56:48.655841+0000","last_active":"2024-09-21T00:57:26.769851+0000","last_peered":"2024-09-21T00:57:26.769851+0000","last_clean":"2024-09-21T00:57:26.769851+0000","last_became_active":"2024-09-21T00:56:48.655270+0000","last_became_peered":"2024-09-21T00:56:48.655270+0000","last_unstale":"2024-09-21T00:57:26.769851+0000","last_undegraded":"2024-09-21T00:57:26.769851+0000","last_fullsized":"2024-09-21T00:57:26.769851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:28.350627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770077+0000","last_change":"2024-09-21T00:56:48.659457+0000","last_active":"2024-09-21T00:57:26.770077+0000","last_peered":"2024-09-21T00:57:26.770077+0000","last_clean":"2024-09-21T00:57:26.770077+0000","last_became_active":"2024-09-21T00:56:48.658999+0000","last_became_peered":"2024-09-21T00:56:48.658999+0000","last_unstale":"2024-09-21T00:57:26.770077+0000","last_undegraded":"2024-09-21T00:57:26.770077+0000","last_fullsized":"2024-09-21T00:57:26.770077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:56.196167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765909+0000","last_change":"2024-09-21T00:56:48.656361+0000","last_active":"2024-09-21T00:57:26.765909+0000","last_peered":"2024-09-21T00:57:26.765909+0000","last_clean":"2024-09-21T00:57:26.765909+0000","last_became_active":"2024-09-21T00:56:48.655999+0000","last_became_peered":"2024-09-21T00:56:48.655999+0000","last_unstale":"2024-09-21T00:57:26.765909+0000","last_undegraded":"2024-09-21T00:57:26.765909+0000","last_fullsized":"2024-09-21T00:57:26.765909+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:46.533280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.763092+0000","last_change":"2024-09-21T00:56:48.656549+0000","last_active":"2024-09-21T00:57:26.763092+0000","last_peered":"2024-09-21T00:57:26.763092+0000","last_clean":"2024-09-21T00:57:26.763092+0000","last_became_active":"2024-09-21T00:56:48.656154+0000","last_became_peered":"2024-09-21T00:56:48.656154+0000","last_unstale":"2024-09-21T00:57:26.763092+0000","last_undegraded":"2024-09-21T00:57:26.763092+0000","last_fullsized":"2024-09-21T00:57:26.763092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:37.244726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859737+0000","last_change":"2024-09-21T00:56:48.645857+0000","last_active":"2024-09-21T00:57:26.859737+0000","last_peered":"2024-09-21T00:57:26.859737+0000","last_clean":"2024-09-21T00:57:26.859737+0000","last_became_active":"2024-09-21T00:56:48.644462+0000","last_became_peered":"2024-09-21T00:56:48.644462+0000","last_unstale":"2024-09-21T00:57:26.859737+0000","last_undegraded":"2024-09-21T00:57:26.859737+0000","last_fullsized":"2024-09-21T00:57:26.859737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:11.690074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858884+0000","last_change":"2024-09-21T00:56:48.649937+0000","last_active":"2024-09-21T00:57:26.858884+0000","last_peered":"2024-09-21T00:57:26.858884+0000","last_clean":"2024-09-21T00:57:26.858884+0000","last_became_active":"2024-09-21T00:56:48.649233+0000","last_became_peered":"2024-09-21T00:56:48.649233+0000","last_unstale":"2024-09-21T00:57:26.858884+0000","last_undegraded":"2024-09-21T00:57:26.858884+0000","last_fullsized":"2024-09-21T00:57:26.858884+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:00.529143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765344+0000","last_change":"2024-09-21T00:56:48.645824+0000","last_active":"2024-09-21T00:57:26.765344+0000","last_peered":"2024-09-21T00:57:26.765344+0000","last_clean":"2024-09-21T00:57:26.765344+0000","last_became_active":"2024-09-21T00:56:48.645452+0000","last_became_peered":"2024-09-21T00:56:48.645452+0000","last_unstale":"2024-09-21T00:57:26.765344+0000","last_undegraded":"2024-09-21T00:57:26.765344+0000","last_fullsized":"2024-09-21T00:57:26.765344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:40.228469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769245+0000","last_change":"2024-09-21T00:57:26.769121+0000","last_active":"2024-09-21T00:57:26.769245+0000","last_peered":"2024-09-21T00:57:26.769245+0000","last_clean":"2024-09-21T00:57:26.769245+0000","last_became_active":"2024-09-21T00:57:26.768532+0000","last_became_peered":"2024-09-21T00:57:26.768532+0000","last_unstale":"2024-09-21T00:57:26.769245+0000","last_undegraded":"2024-09-21T00:57:26.769245+0000","last_fullsized":"2024-09-21T00:57:26.769245+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:57.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.762879+0000","last_change":"2024-09-21T00:56:48.656431+0000","last_active":"2024-09-21T00:57:26.762879+0000","last_peered":"2024-09-21T00:57:26.762879+0000","last_clean":"2024-09-21T00:57:26.762879+0000","last_became_active":"2024-09-21T00:56:48.656080+0000","last_became_peered":"2024-09-21T00:56:48.656080+0000","last_unstale":"2024-09-21T00:57:26.762879+0000","last_undegraded":"2024-09-21T00:57:26.762879+0000","last_fullsized":"2024-09-21T00:57:26.762879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:00.068094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760939+0000","last_change":"2024-09-21T00:56:48.653355+0000","last_active":"2024-09-21T00:57:26.760939+0000","last_peered":"2024-09-21T00:57:26.760939+0000","last_clean":"2024-09-21T00:57:26.760939+0000","last_became_active":"2024-09-21T00:56:48.652959+0000","last_became_peered":"2024-09-21T00:56:48.652959+0000","last_unstale":"2024-09-21T00:57:26.760939+0000","last_undegraded":"2024-09-21T00:57:26.760939+0000","last_fullsized":"2024-09-21T00:57:26.760939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:16.462806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770600+0000","last_change":"2024-09-21T00:56:46.634744+0000","last_active":"2024-09-21T00:57:26.770600+0000","last_peered":"2024-09-21T00:57:26.770600+0000","last_clean":"2024-09-21T00:57:26.770600+0000","last_became_active":"2024-09-21T00:56:46.634367+0000","last_became_peered":"2024-09-21T00:56:46.634367+0000","last_unstale":"2024-09-21T00:57:26.770600+0000","last_undegraded":"2024-09-21T00:57:26.770600+0000","last_fullsized":"2024-09-21T00:57:26.770600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:40.923450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770374+0000","last_change":"2024-09-21T00:56:48.660277+0000","last_active":"2024-09-21T00:57:26.770374+0000","last_peered":"2024-09-21T00:57:26.770374+0000","last_clean":"2024-09-21T00:57:26.770374+0000","last_became_active":"2024-09-21T00:56:48.659491+0000","last_became_peered":"2024-09-21T00:56:48.659491+0000","last_unstale":"2024-09-21T00:57:26.770374+0000","last_undegraded":"2024-09-21T00:57:26.770374+0000","last_fullsized":"2024-09-21T00:57:26.770374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:39.032704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858813+0000","last_change":"2024-09-21T00:56:46.634466+0000","last_active":"2024-09-21T00:57:26.858813+0000","last_peered":"2024-09-21T00:57:26.858813+0000","last_clean":"2024-09-21T00:57:26.858813+0000","last_became_active":"2024-09-21T00:56:46.634031+0000","last_became_peered":"2024-09-21T00:56:46.634031+0000","last_unstale":"2024-09-21T00:57:26.858813+0000","last_undegraded":"2024-09-21T00:57:26.858813+0000","last_fullsized":"2024-09-21T00:57:26.858813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:49.691014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858552+0000","last_change":"2024-09-21T00:56:46.628156+0000","last_active":"2024-09-21T00:57:26.858552+0000","last_peered":"2024-09-21T00:57:26.858552+0000","last_clean":"2024-09-21T00:57:26.858552+0000","last_became_active":"2024-09-21T00:56:46.627735+0000","last_became_peered":"2024-09-21T00:56:46.627735+0000","last_unstale":"2024-09-21T00:57:26.858552+0000","last_undegraded":"2024-09-21T00:57:26.858552+0000","last_fullsized":"2024-09-21T00:57:26.858552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:55.188016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769303+0000","last_change":"2024-09-21T00:56:48.649571+0000","last_active":"2024-09-21T00:57:26.769303+0000","last_peered":"2024-09-21T00:57:26.769303+0000","last_clean":"2024-09-21T00:57:26.769303+0000","last_became_active":"2024-09-21T00:56:48.647345+0000","last_became_peered":"2024-09-21T00:56:48.647345+0000","last_unstale":"2024-09-21T00:57:26.769303+0000","last_undegraded":"2024-09-21T00:57:26.769303+0000","last_fullsized":"2024-09-21T00:57:26.769303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:43.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770076+0000","last_change":"2024-09-21T00:56:46.634886+0000","last_active":"2024-09-21T00:57:26.770076+0000","last_peered":"2024-09-21T00:57:26.770076+0000","last_clean":"2024-09-21T00:57:26.770076+0000","last_became_active":"2024-09-21T00:56:46.634481+0000","last_became_peered":"2024-09-21T00:56:46.634481+0000","last_unstale":"2024-09-21T00:57:26.770076+0000","last_undegraded":"2024-09-21T00:57:26.770076+0000","last_fullsized":"2024-09-21T00:57:26.770076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:15.062776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.759972+0000","last_change":"2024-09-21T00:56:48.655740+0000","last_active":"2024-09-21T00:57:26.759972+0000","last_peered":"2024-09-21T00:57:26.759972+0000","last_clean":"2024-09-21T00:57:26.759972+0000","last_became_active":"2024-09-21T00:56:48.655312+0000","last_became_peered":"2024-09-21T00:56:48.655312+0000","last_unstale":"2024-09-21T00:57:26.759972+0000","last_undegraded":"2024-09-21T00:57:26.759972+0000","last_fullsized":"2024-09-21T00:57:26.759972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.815954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859165+0000","last_change":"2024-09-21T00:56:46.636212+0000","last_active":"2024-09-21T00:57:26.859165+0000","last_peered":"2024-09-21T00:57:26.859165+0000","last_clean":"2024-09-21T00:57:26.859165+0000","last_became_active":"2024-09-21T00:56:46.635702+0000","last_became_peered":"2024-09-21T00:56:46.635702+0000","last_unstale":"2024-09-21T00:57:26.859165+0000","last_undegraded":"2024-09-21T00:57:26.859165+0000","last_fullsized":"2024-09-21T00:57:26.859165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:11.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765366+0000","last_change":"2024-09-21T00:56:48.646300+0000","last_active":"2024-09-21T00:57:26.765366+0000","last_peered":"2024-09-21T00:57:26.765366+0000","last_clean":"2024-09-21T00:57:26.765366+0000","last_became_active":"2024-09-21T00:56:48.645906+0000","last_became_peered":"2024-09-21T00:56:48.645906+0000","last_unstale":"2024-09-21T00:57:26.765366+0000","last_undegraded":"2024-09-21T00:57:26.765366+0000","last_fullsized":"2024-09-21T00:57:26.765366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:47.593609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766522+0000","last_change":"2024-09-21T00:56:46.639405+0000","last_active":"2024-09-21T00:57:26.766522+0000","last_peered":"2024-09-21T00:57:26.766522+0000","last_clean":"2024-09-21T00:57:26.766522+0000","last_became_active":"2024-09-21T00:56:46.638659+0000","last_became_peered":"2024-09-21T00:56:46.638659+0000","last_unstale":"2024-09-21T00:57:26.766522+0000","last_undegraded":"2024-09-21T00:57:26.766522+0000","last_fullsized":"2024-09-21T00:57:26.766522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:19.718585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859405+0000","last_change":"2024-09-21T00:56:48.657572+0000","last_active":"2024-09-21T00:57:26.859405+0000","last_peered":"2024-09-21T00:57:26.859405+0000","last_clean":"2024-09-21T00:57:26.859405+0000","last_became_active":"2024-09-21T00:56:48.657219+0000","last_became_peered":"2024-09-21T00:56:48.657219+0000","last_unstale":"2024-09-21T00:57:26.859405+0000","last_undegraded":"2024-09-21T00:57:26.859405+0000","last_fullsized":"2024-09-21T00:57:26.859405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:48.870835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770265+0000","last_change":"2024-09-21T00:56:46.642710+0000","last_active":"2024-09-21T00:57:26.770265+0000","last_peered":"2024-09-21T00:57:26.770265+0000","last_clean":"2024-09-21T00:57:26.770265+0000","last_became_active":"2024-09-21T00:56:46.642273+0000","last_became_peered":"2024-09-21T00:56:46.642273+0000","last_unstale":"2024-09-21T00:57:26.770265+0000","last_undegraded":"2024-09-21T00:57:26.770265+0000","last_fullsized":"2024-09-21T00:57:26.770265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.751651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.860956+0000","last_change":"2024-09-21T00:57:26.860826+0000","last_active":"2024-09-21T00:57:26.860956+0000","last_peered":"2024-09-21T00:57:26.860956+0000","last_clean":"2024-09-21T00:57:26.860956+0000","last_became_active":"2024-09-21T00:57:26.860389+0000","last_became_peered":"2024-09-21T00:57:26.860389+0000","last_unstale":"2024-09-21T00:57:26.860956+0000","last_undegraded":"2024-09-21T00:57:26.860956+0000","last_fullsized":"2024-09-21T00:57:26.860956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:52.229655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":161,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:46.603557+0000","last_change":"2024-09-21T00:56:46.639555+0000","last_active":"2024-09-21T00:57:46.603557+0000","last_peered":"2024-09-21T00:57:46.603557+0000","last_clean":"2024-09-21T00:57:46.603557+0000","last_became_active":"2024-09-21T00:56:46.639200+0000","last_became_peered":"2024-09-21T00:56:46.639200+0000","last_unstale":"2024-09-21T00:57:46.603557+0000","last_undegraded":"2024-09-21T00:57:46.603557+0000","last_fullsized":"2024-09-21T00:57:46.603557+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:49.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66957,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":120,"num_write":27,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761236+0000","last_change":"2024-09-21T00:56:48.653950+0000","last_active":"2024-09-21T00:57:26.761236+0000","last_peered":"2024-09-21T00:57:26.761236+0000","last_clean":"2024-09-21T00:57:26.761236+0000","last_became_active":"2024-09-21T00:56:48.653570+0000","last_became_peered":"2024-09-21T00:56:48.653570+0000","last_unstale":"2024-09-21T00:57:26.761236+0000","last_undegraded":"2024-09-21T00:57:26.761236+0000","last_fullsized":"2024-09-21T00:57:26.761236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:43.708982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766728+0000","last_change":"2024-09-21T00:56:46.635861+0000","last_active":"2024-09-21T00:57:26.766728+0000","last_peered":"2024-09-21T00:57:26.766728+0000","last_clean":"2024-09-21T00:57:26.766728+0000","last_became_active":"2024-09-21T00:56:46.635452+0000","last_became_peered":"2024-09-21T00:56:46.635452+0000","last_unstale":"2024-09-21T00:57:26.766728+0000","last_undegraded":"2024-09-21T00:57:26.766728+0000","last_fullsized":"2024-09-21T00:57:26.766728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:15.591100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858880+0000","last_change":"2024-09-21T00:56:48.645567+0000","last_active":"2024-09-21T00:57:26.858880+0000","last_peered":"2024-09-21T00:57:26.858880+0000","last_clean":"2024-09-21T00:57:26.858880+0000","last_became_active":"2024-09-21T00:56:48.644499+0000","last_became_peered":"2024-09-21T00:56:48.644499+0000","last_unstale":"2024-09-21T00:57:26.858880+0000","last_undegraded":"2024-09-21T00:57:26.858880+0000","last_fullsized":"2024-09-21T00:57:26.858880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:08.655065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770242+0000","last_change":"2024-09-21T00:56:46.633014+0000","last_active":"2024-09-21T00:57:26.770242+0000","last_peered":"2024-09-21T00:57:26.770242+0000","last_clean":"2024-09-21T00:57:26.770242+0000","last_became_active":"2024-09-21T00:56:46.632656+0000","last_became_peered":"2024-09-21T00:56:46.632656+0000","last_unstale":"2024-09-21T00:57:26.770242+0000","last_undegraded":"2024-09-21T00:57:26.770242+0000","last_fullsized":"2024-09-21T00:57:26.770242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:46.270469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767265+0000","last_change":"2024-09-21T00:56:48.659797+0000","last_active":"2024-09-21T00:57:26.767265+0000","last_peered":"2024-09-21T00:57:26.767265+0000","last_clean":"2024-09-21T00:57:26.767265+0000","last_became_active":"2024-09-21T00:56:48.659430+0000","last_became_peered":"2024-09-21T00:56:48.659430+0000","last_unstale":"2024-09-21T00:57:26.767265+0000","last_undegraded":"2024-09-21T00:57:26.767265+0000","last_fullsized":"2024-09-21T00:57:26.767265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:45.006414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766061+0000","last_change":"2024-09-21T00:56:46.636792+0000","last_active":"2024-09-21T00:57:26.766061+0000","last_peered":"2024-09-21T00:57:26.766061+0000","last_clean":"2024-09-21T00:57:26.766061+0000","last_became_active":"2024-09-21T00:56:46.636383+0000","last_became_peered":"2024-09-21T00:56:46.636383+0000","last_unstale":"2024-09-21T00:57:26.766061+0000","last_undegraded":"2024-09-21T00:57:26.766061+0000","last_fullsized":"2024-09-21T00:57:26.766061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:37.078166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766893+0000","last_change":"2024-09-21T00:56:48.657065+0000","last_active":"2024-09-21T00:57:26.766893+0000","last_peered":"2024-09-21T00:57:26.766893+0000","last_clean":"2024-09-21T00:57:26.766893+0000","last_became_active":"2024-09-21T00:56:48.656658+0000","last_became_peered":"2024-09-21T00:56:48.656658+0000","last_unstale":"2024-09-21T00:57:26.766893+0000","last_undegraded":"2024-09-21T00:57:26.766893+0000","last_fullsized":"2024-09-21T00:57:26.766893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:31.713457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761028+0000","last_change":"2024-09-21T00:56:46.642099+0000","last_active":"2024-09-21T00:57:26.761028+0000","last_peered":"2024-09-21T00:57:26.761028+0000","last_clean":"2024-09-21T00:57:26.761028+0000","last_became_active":"2024-09-21T00:56:46.641526+0000","last_became_peered":"2024-09-21T00:56:46.641526+0000","last_unstale":"2024-09-21T00:57:26.761028+0000","last_undegraded":"2024-09-21T00:57:26.761028+0000","last_fullsized":"2024-09-21T00:57:26.761028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:12.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770551+0000","last_change":"2024-09-21T00:56:48.660991+0000","last_active":"2024-09-21T00:57:26.770551+0000","last_peered":"2024-09-21T00:57:26.770551+0000","last_clean":"2024-09-21T00:57:26.770551+0000","last_became_active":"2024-09-21T00:56:48.660623+0000","last_became_peered":"2024-09-21T00:56:48.660623+0000","last_unstale":"2024-09-21T00:57:26.770551+0000","last_undegraded":"2024-09-21T00:57:26.770551+0000","last_fullsized":"2024-09-21T00:57:26.770551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:34.291977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761592+0000","last_change":"2024-09-21T00:56:46.637482+0000","last_active":"2024-09-21T00:57:26.761592+0000","last_peered":"2024-09-21T00:57:26.761592+0000","last_clean":"2024-09-21T00:57:26.761592+0000","last_became_active":"2024-09-21T00:56:46.634812+0000","last_became_peered":"2024-09-21T00:56:46.634812+0000","last_unstale":"2024-09-21T00:57:26.761592+0000","last_undegraded":"2024-09-21T00:57:26.761592+0000","last_fullsized":"2024-09-21T00:57:26.761592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:30.990625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.763137+0000","last_change":"2024-09-21T00:56:48.658930+0000","last_active":"2024-09-21T00:57:26.763137+0000","last_peered":"2024-09-21T00:57:26.763137+0000","last_clean":"2024-09-21T00:57:26.763137+0000","last_became_active":"2024-09-21T00:56:48.658545+0000","last_became_peered":"2024-09-21T00:56:48.658545+0000","last_unstale":"2024-09-21T00:57:26.763137+0000","last_undegraded":"2024-09-21T00:57:26.763137+0000","last_fullsized":"2024-09-21T00:57:26.763137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:30:57.850371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859892+0000","last_change":"2024-09-21T00:56:46.628768+0000","last_active":"2024-09-21T00:57:26.859892+0000","last_peered":"2024-09-21T00:57:26.859892+0000","last_clean":"2024-09-21T00:57:26.859892+0000","last_became_active":"2024-09-21T00:56:46.628374+0000","last_became_peered":"2024-09-21T00:56:46.628374+0000","last_unstale":"2024-09-21T00:57:26.859892+0000","last_undegraded":"2024-09-21T00:57:26.859892+0000","last_fullsized":"2024-09-21T00:57:26.859892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:58:15.133651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766226+0000","last_change":"2024-09-21T00:56:48.648097+0000","last_active":"2024-09-21T00:57:26.766226+0000","last_peered":"2024-09-21T00:57:26.766226+0000","last_clean":"2024-09-21T00:57:26.766226+0000","last_became_active":"2024-09-21T00:56:48.647619+0000","last_became_peered":"2024-09-21T00:56:48.647619+0000","last_unstale":"2024-09-21T00:57:26.766226+0000","last_undegraded":"2024-09-21T00:57:26.766226+0000","last_fullsized":"2024-09-21T00:57:26.766226+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:08.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770460+0000","last_change":"2024-09-21T00:56:46.636947+0000","last_active":"2024-09-21T00:57:26.770460+0000","last_peered":"2024-09-21T00:57:26.770460+0000","last_clean":"2024-09-21T00:57:26.770460+0000","last_became_active":"2024-09-21T00:56:46.636469+0000","last_became_peered":"2024-09-21T00:56:46.636469+0000","last_unstale":"2024-09-21T00:57:26.770460+0000","last_undegraded":"2024-09-21T00:57:26.770460+0000","last_fullsized":"2024-09-21T00:57:26.770460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:31.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.774275+0000","last_change":"2024-09-21T00:57:26.774145+0000","last_active":"2024-09-21T00:57:26.774275+0000","last_peered":"2024-09-21T00:57:26.774275+0000","last_clean":"2024-09-21T00:57:26.774275+0000","last_became_active":"2024-09-21T00:57:26.770919+0000","last_became_peered":"2024-09-21T00:57:26.770919+0000","last_unstale":"2024-09-21T00:57:26.774275+0000","last_undegraded":"2024-09-21T00:57:26.774275+0000","last_fullsized":"2024-09-21T00:57:26.774275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:21.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766495+0000","last_change":"2024-09-21T00:56:47.391206+0000","last_active":"2024-09-21T00:57:26.766495+0000","last_peered":"2024-09-21T00:57:26.766495+0000","last_clean":"2024-09-21T00:57:26.766495+0000","last_became_active":"2024-09-21T00:56:47.390708+0000","last_became_peered":"2024-09-21T00:56:47.390708+0000","last_unstale":"2024-09-21T00:57:26.766495+0000","last_undegraded":"2024-09-21T00:57:26.766495+0000","last_fullsized":"2024-09-21T00:57:26.766495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:59.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767463+0000","last_change":"2024-09-21T00:56:48.648452+0000","last_active":"2024-09-21T00:57:26.767463+0000","last_peered":"2024-09-21T00:57:26.767463+0000","last_clean":"2024-09-21T00:57:26.767463+0000","last_became_active":"2024-09-21T00:56:48.647682+0000","last_became_peered":"2024-09-21T00:56:48.647682+0000","last_unstale":"2024-09-21T00:57:26.767463+0000","last_undegraded":"2024-09-21T00:57:26.767463+0000","last_fullsized":"2024-09-21T00:57:26.767463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:45.844596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767127+0000","last_change":"2024-09-21T00:55:37.551147+0000","last_active":"2024-09-21T00:57:26.767127+0000","last_peered":"2024-09-21T00:57:26.767127+0000","last_clean":"2024-09-21T00:57:26.767127+0000","last_became_active":"2024-09-21T00:55:37.545124+0000","last_became_peered":"2024-09-21T00:55:37.545124+0000","last_unstale":"2024-09-21T00:57:26.767127+0000","last_undegraded":"2024-09-21T00:57:26.767127+0000","last_fullsized":"2024-09-21T00:57:26.767127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_clean_scrub_stamp":"2024-09-21T00:52:17.996374+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:20.205607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766410+0000","last_change":"2024-09-21T00:56:46.637264+0000","last_active":"2024-09-21T00:57:26.766410+0000","last_peered":"2024-09-21T00:57:26.766410+0000","last_clean":"2024-09-21T00:57:26.766410+0000","last_became_active":"2024-09-21T00:56:46.636320+0000","last_became_peered":"2024-09-21T00:56:46.636320+0000","last_unstale":"2024-09-21T00:57:26.766410+0000","last_undegraded":"2024-09-21T00:57:26.766410+0000","last_fullsized":"2024-09-21T00:57:26.766410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:42.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770001+0000","last_change":"2024-09-21T00:56:48.651051+0000","last_active":"2024-09-21T00:57:26.770001+0000","last_peered":"2024-09-21T00:57:26.770001+0000","last_clean":"2024-09-21T00:57:26.770001+0000","last_became_active":"2024-09-21T00:56:48.650693+0000","last_became_peered":"2024-09-21T00:56:48.650693+0000","last_unstale":"2024-09-21T00:57:26.770001+0000","last_undegraded":"2024-09-21T00:57:26.770001+0000","last_fullsized":"2024-09-21T00:57:26.770001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:49.575213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767099+0000","last_change":"2024-09-21T00:56:46.634826+0000","last_active":"2024-09-21T00:57:26.767099+0000","last_peered":"2024-09-21T00:57:26.767099+0000","last_clean":"2024-09-21T00:57:26.767099+0000","last_became_active":"2024-09-21T00:56:46.634370+0000","last_became_peered":"2024-09-21T00:56:46.634370+0000","last_unstale":"2024-09-21T00:57:26.767099+0000","last_undegraded":"2024-09-21T00:57:26.767099+0000","last_fullsized":"2024-09-21T00:57:26.767099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:29.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858430+0000","last_change":"2024-09-21T00:56:48.646296+0000","last_active":"2024-09-21T00:57:26.858430+0000","last_peered":"2024-09-21T00:57:26.858430+0000","last_clean":"2024-09-21T00:57:26.858430+0000","last_became_active":"2024-09-21T00:56:48.644271+0000","last_became_peered":"2024-09-21T00:56:48.644271+0000","last_unstale":"2024-09-21T00:57:26.858430+0000","last_undegraded":"2024-09-21T00:57:26.858430+0000","last_fullsized":"2024-09-21T00:57:26.858430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:27.609714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858660+0000","last_change":"2024-09-21T00:56:46.641852+0000","last_active":"2024-09-21T00:57:26.858660+0000","last_peered":"2024-09-21T00:57:26.858660+0000","last_clean":"2024-09-21T00:57:26.858660+0000","last_became_active":"2024-09-21T00:56:46.641449+0000","last_became_peered":"2024-09-21T00:56:46.641449+0000","last_unstale":"2024-09-21T00:57:26.858660+0000","last_undegraded":"2024-09-21T00:57:26.858660+0000","last_fullsized":"2024-09-21T00:57:26.858660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:51.086321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769928+0000","last_change":"2024-09-21T00:56:48.660295+0000","last_active":"2024-09-21T00:57:26.769928+0000","last_peered":"2024-09-21T00:57:26.769928+0000","last_clean":"2024-09-21T00:57:26.769928+0000","last_became_active":"2024-09-21T00:56:48.659638+0000","last_became_peered":"2024-09-21T00:56:48.659638+0000","last_unstale":"2024-09-21T00:57:26.769928+0000","last_undegraded":"2024-09-21T00:57:26.769928+0000","last_fullsized":"2024-09-21T00:57:26.769928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:34.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767333+0000","last_change":"2024-09-21T00:56:46.639317+0000","last_active":"2024-09-21T00:57:26.767333+0000","last_peered":"2024-09-21T00:57:26.767333+0000","last_clean":"2024-09-21T00:57:26.767333+0000","last_became_active":"2024-09-21T00:56:46.638732+0000","last_became_peered":"2024-09-21T00:56:46.638732+0000","last_unstale":"2024-09-21T00:57:26.767333+0000","last_undegraded":"2024-09-21T00:57:26.767333+0000","last_fullsized":"2024-09-21T00:57:26.767333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858927+0000","last_change":"2024-09-21T00:56:48.651038+0000","last_active":"2024-09-21T00:57:26.858927+0000","last_peered":"2024-09-21T00:57:26.858927+0000","last_clean":"2024-09-21T00:57:26.858927+0000","last_became_active":"2024-09-21T00:56:48.650682+0000","last_became_peered":"2024-09-21T00:56:48.650682+0000","last_unstale":"2024-09-21T00:57:26.858927+0000","last_undegraded":"2024-09-21T00:57:26.858927+0000","last_fullsized":"2024-09-21T00:57:26.858927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.015768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760268+0000","last_change":"2024-09-21T00:56:46.641993+0000","last_active":"2024-09-21T00:57:26.760268+0000","last_peered":"2024-09-21T00:57:26.760268+0000","last_clean":"2024-09-21T00:57:26.760268+0000","last_became_active":"2024-09-21T00:56:46.641631+0000","last_became_peered":"2024-09-21T00:56:46.641631+0000","last_unstale":"2024-09-21T00:57:26.760268+0000","last_undegraded":"2024-09-21T00:57:26.760268+0000","last_fullsized":"2024-09-21T00:57:26.760268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:12.986551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859024+0000","last_change":"2024-09-21T00:56:48.649620+0000","last_active":"2024-09-21T00:57:26.859024+0000","last_peered":"2024-09-21T00:57:26.859024+0000","last_clean":"2024-09-21T00:57:26.859024+0000","last_became_active":"2024-09-21T00:56:48.645757+0000","last_became_peered":"2024-09-21T00:56:48.645757+0000","last_unstale":"2024-09-21T00:57:26.859024+0000","last_undegraded":"2024-09-21T00:57:26.859024+0000","last_fullsized":"2024-09-21T00:57:26.859024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:12.802042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761384+0000","last_change":"2024-09-21T00:56:46.641723+0000","last_active":"2024-09-21T00:57:26.761384+0000","last_peered":"2024-09-21T00:57:26.761384+0000","last_clean":"2024-09-21T00:57:26.761384+0000","last_became_active":"2024-09-21T00:56:46.641219+0000","last_became_peered":"2024-09-21T00:56:46.641219+0000","last_unstale":"2024-09-21T00:57:26.761384+0000","last_undegraded":"2024-09-21T00:57:26.761384+0000","last_fullsized":"2024-09-21T00:57:26.761384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:47.676869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859888+0000","last_change":"2024-09-21T00:56:48.641940+0000","last_active":"2024-09-21T00:57:26.859888+0000","last_peered":"2024-09-21T00:57:26.859888+0000","last_clean":"2024-09-21T00:57:26.859888+0000","last_became_active":"2024-09-21T00:56:48.641521+0000","last_became_peered":"2024-09-21T00:56:48.641521+0000","last_unstale":"2024-09-21T00:57:26.859888+0000","last_undegraded":"2024-09-21T00:57:26.859888+0000","last_fullsized":"2024-09-21T00:57:26.859888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:38.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760272+0000","last_change":"2024-09-21T00:56:46.631037+0000","last_active":"2024-09-21T00:57:26.760272+0000","last_peered":"2024-09-21T00:57:26.760272+0000","last_clean":"2024-09-21T00:57:26.760272+0000","last_became_active":"2024-09-21T00:56:46.630612+0000","last_became_peered":"2024-09-21T00:56:46.630612+0000","last_unstale":"2024-09-21T00:57:26.760272+0000","last_undegraded":"2024-09-21T00:57:26.760272+0000","last_fullsized":"2024-09-21T00:57:26.760272+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.390614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770188+0000","last_change":"2024-09-21T00:56:48.649774+0000","last_active":"2024-09-21T00:57:26.770188+0000","last_peered":"2024-09-21T00:57:26.770188+0000","last_clean":"2024-09-21T00:57:26.770188+0000","last_became_active":"2024-09-21T00:56:48.649380+0000","last_became_peered":"2024-09-21T00:56:48.649380+0000","last_unstale":"2024-09-21T00:57:26.770188+0000","last_undegraded":"2024-09-21T00:57:26.770188+0000","last_fullsized":"2024-09-21T00:57:26.770188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:12.595820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766611+0000","last_change":"2024-09-21T00:56:47.391328+0000","last_active":"2024-09-21T00:57:26.766611+0000","last_peered":"2024-09-21T00:57:26.766611+0000","last_clean":"2024-09-21T00:57:26.766611+0000","last_became_active":"2024-09-21T00:56:47.390860+0000","last_became_peered":"2024-09-21T00:56:47.390860+0000","last_unstale":"2024-09-21T00:57:26.766611+0000","last_undegraded":"2024-09-21T00:57:26.766611+0000","last_fullsized":"2024-09-21T00:57:26.766611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:24.267908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858705+0000","last_change":"2024-09-21T00:56:48.657644+0000","last_active":"2024-09-21T00:57:26.858705+0000","last_peered":"2024-09-21T00:57:26.858705+0000","last_clean":"2024-09-21T00:57:26.858705+0000","last_became_active":"2024-09-21T00:56:48.657263+0000","last_became_peered":"2024-09-21T00:56:48.657263+0000","last_unstale":"2024-09-21T00:57:26.858705+0000","last_undegraded":"2024-09-21T00:57:26.858705+0000","last_fullsized":"2024-09-21T00:57:26.858705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:20.635667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.861164+0000","last_change":"2024-09-21T00:57:26.861046+0000","last_active":"2024-09-21T00:57:26.861164+0000","last_peered":"2024-09-21T00:57:26.861164+0000","last_clean":"2024-09-21T00:57:26.861164+0000","last_became_active":"2024-09-21T00:57:26.860555+0000","last_became_peered":"2024-09-21T00:57:26.860555+0000","last_unstale":"2024-09-21T00:57:26.861164+0000","last_undegraded":"2024-09-21T00:57:26.861164+0000","last_fullsized":"2024-09-21T00:57:26.861164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.786618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760939+0000","last_change":"2024-09-21T00:56:48.656028+0000","last_active":"2024-09-21T00:57:26.760939+0000","last_peered":"2024-09-21T00:57:26.760939+0000","last_clean":"2024-09-21T00:57:26.760939+0000","last_became_active":"2024-09-21T00:56:48.655380+0000","last_became_peered":"2024-09-21T00:56:48.655380+0000","last_unstale":"2024-09-21T00:57:26.760939+0000","last_undegraded":"2024-09-21T00:57:26.760939+0000","last_fullsized":"2024-09-21T00:57:26.760939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:37.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769373+0000","last_change":"2024-09-21T00:56:46.635884+0000","last_active":"2024-09-21T00:57:26.769373+0000","last_peered":"2024-09-21T00:57:26.769373+0000","last_clean":"2024-09-21T00:57:26.769373+0000","last_became_active":"2024-09-21T00:56:46.635545+0000","last_became_peered":"2024-09-21T00:56:46.635545+0000","last_unstale":"2024-09-21T00:57:26.769373+0000","last_undegraded":"2024-09-21T00:57:26.769373+0000","last_fullsized":"2024-09-21T00:57:26.769373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:03.170611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.762947+0000","last_change":"2024-09-21T00:56:48.649548+0000","last_active":"2024-09-21T00:57:26.762947+0000","last_peered":"2024-09-21T00:57:26.762947+0000","last_clean":"2024-09-21T00:57:26.762947+0000","last_became_active":"2024-09-21T00:56:48.649157+0000","last_became_peered":"2024-09-21T00:56:48.649157+0000","last_unstale":"2024-09-21T00:57:26.762947+0000","last_undegraded":"2024-09-21T00:57:26.762947+0000","last_fullsized":"2024-09-21T00:57:26.762947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:46.794274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766443+0000","last_change":"2024-09-21T00:56:46.632139+0000","last_active":"2024-09-21T00:57:26.766443+0000","last_peered":"2024-09-21T00:57:26.766443+0000","last_clean":"2024-09-21T00:57:26.766443+0000","last_became_active":"2024-09-21T00:56:46.631680+0000","last_became_peered":"2024-09-21T00:56:46.631680+0000","last_unstale":"2024-09-21T00:57:26.766443+0000","last_undegraded":"2024-09-21T00:57:26.766443+0000","last_fullsized":"2024-09-21T00:57:26.766443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:21:17.909161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769654+0000","last_change":"2024-09-21T00:56:48.654956+0000","last_active":"2024-09-21T00:57:26.769654+0000","last_peered":"2024-09-21T00:57:26.769654+0000","last_clean":"2024-09-21T00:57:26.769654+0000","last_became_active":"2024-09-21T00:56:48.654354+0000","last_became_peered":"2024-09-21T00:56:48.654354+0000","last_unstale":"2024-09-21T00:57:26.769654+0000","last_undegraded":"2024-09-21T00:57:26.769654+0000","last_fullsized":"2024-09-21T00:57:26.769654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:56.540664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.773409+0000","last_change":"2024-09-21T00:57:26.773289+0000","last_active":"2024-09-21T00:57:26.773409+0000","last_peered":"2024-09-21T00:57:26.773409+0000","last_clean":"2024-09-21T00:57:26.773409+0000","last_became_active":"2024-09-21T00:57:26.768686+0000","last_became_peered":"2024-09-21T00:57:26.768686+0000","last_unstale":"2024-09-21T00:57:26.773409+0000","last_undegraded":"2024-09-21T00:57:26.773409+0000","last_fullsized":"2024-09-21T00:57:26.773409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:04.247758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766979+0000","last_change":"2024-09-21T00:56:48.647881+0000","last_active":"2024-09-21T00:57:26.766979+0000","last_peered":"2024-09-21T00:57:26.766979+0000","last_clean":"2024-09-21T00:57:26.766979+0000","last_became_active":"2024-09-21T00:56:48.647391+0000","last_became_peered":"2024-09-21T00:56:48.647391+0000","last_unstale":"2024-09-21T00:57:26.766979+0000","last_undegraded":"2024-09-21T00:57:26.766979+0000","last_fullsized":"2024-09-21T00:57:26.766979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:57.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770259+0000","last_change":"2024-09-21T00:56:48.662093+0000","last_active":"2024-09-21T00:57:26.770259+0000","last_peered":"2024-09-21T00:57:26.770259+0000","last_clean":"2024-09-21T00:57:26.770259+0000","last_became_active":"2024-09-21T00:56:48.661652+0000","last_became_peered":"2024-09-21T00:56:48.661652+0000","last_unstale":"2024-09-21T00:57:26.770259+0000","last_undegraded":"2024-09-21T00:57:26.770259+0000","last_fullsized":"2024-09-21T00:57:26.770259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:42:29.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761597+0000","last_change":"2024-09-21T00:56:46.633958+0000","last_active":"2024-09-21T00:57:26.761597+0000","last_peered":"2024-09-21T00:57:26.761597+0000","last_clean":"2024-09-21T00:57:26.761597+0000","last_became_active":"2024-09-21T00:56:46.633473+0000","last_became_peered":"2024-09-21T00:56:46.633473+0000","last_unstale":"2024-09-21T00:57:26.761597+0000","last_undegraded":"2024-09-21T00:57:26.761597+0000","last_fullsized":"2024-09-21T00:57:26.761597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:03:41.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764943+0000","last_change":"2024-09-21T00:56:48.647961+0000","last_active":"2024-09-21T00:57:26.764943+0000","last_peered":"2024-09-21T00:57:26.764943+0000","last_clean":"2024-09-21T00:57:26.764943+0000","last_became_active":"2024-09-21T00:56:48.647301+0000","last_became_peered":"2024-09-21T00:56:48.647301+0000","last_unstale":"2024-09-21T00:57:26.764943+0000","last_undegraded":"2024-09-21T00:57:26.764943+0000","last_fullsized":"2024-09-21T00:57:26.764943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:21.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761236+0000","last_change":"2024-09-21T00:56:46.637114+0000","last_active":"2024-09-21T00:57:26.761236+0000","last_peered":"2024-09-21T00:57:26.761236+0000","last_clean":"2024-09-21T00:57:26.761236+0000","last_became_active":"2024-09-21T00:56:46.636244+0000","last_became_peered":"2024-09-21T00:56:46.636244+0000","last_unstale":"2024-09-21T00:57:26.761236+0000","last_undegraded":"2024-09-21T00:57:26.761236+0000","last_fullsized":"2024-09-21T00:57:26.761236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:36.374016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859300+0000","last_change":"2024-09-21T00:56:48.647249+0000","last_active":"2024-09-21T00:57:26.859300+0000","last_peered":"2024-09-21T00:57:26.859300+0000","last_clean":"2024-09-21T00:57:26.859300+0000","last_became_active":"2024-09-21T00:56:48.646888+0000","last_became_peered":"2024-09-21T00:56:48.646888+0000","last_unstale":"2024-09-21T00:57:26.859300+0000","last_undegraded":"2024-09-21T00:57:26.859300+0000","last_fullsized":"2024-09-21T00:57:26.859300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:02.997909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770241+0000","last_change":"2024-09-21T00:56:46.642781+0000","last_active":"2024-09-21T00:57:26.770241+0000","last_peered":"2024-09-21T00:57:26.770241+0000","last_clean":"2024-09-21T00:57:26.770241+0000","last_became_active":"2024-09-21T00:56:46.642346+0000","last_became_peered":"2024-09-21T00:56:46.642346+0000","last_unstale":"2024-09-21T00:57:26.770241+0000","last_undegraded":"2024-09-21T00:57:26.770241+0000","last_fullsized":"2024-09-21T00:57:26.770241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.050014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769909+0000","last_change":"2024-09-21T00:56:48.651942+0000","last_active":"2024-09-21T00:57:26.769909+0000","last_peered":"2024-09-21T00:57:26.769909+0000","last_clean":"2024-09-21T00:57:26.769909+0000","last_became_active":"2024-09-21T00:56:48.650577+0000","last_became_peered":"2024-09-21T00:56:48.650577+0000","last_unstale":"2024-09-21T00:57:26.769909+0000","last_undegraded":"2024-09-21T00:57:26.769909+0000","last_fullsized":"2024-09-21T00:57:26.769909+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:44.176473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760475+0000","last_change":"2024-09-21T00:56:46.634428+0000","last_active":"2024-09-21T00:57:26.760475+0000","last_peered":"2024-09-21T00:57:26.760475+0000","last_clean":"2024-09-21T00:57:26.760475+0000","last_became_active":"2024-09-21T00:56:46.634037+0000","last_became_peered":"2024-09-21T00:56:46.634037+0000","last_unstale":"2024-09-21T00:57:26.760475+0000","last_undegraded":"2024-09-21T00:57:26.760475+0000","last_fullsized":"2024-09-21T00:57:26.760475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:25.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67755,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":115,"num_read_kb":124,"num_write":83,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":203265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":402083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939677,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1511424,"data_stored":1059719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103203,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":831488,"data_stored":402782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":831488,"data_stored":402687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1425408,"data_stored":993150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40316,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704836,"statfs":{"total":95995035648,"available":95953752064,"internally_reserved":0,"allocated":827392,"data_stored":402200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":992750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":402105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":402304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":905216,"data_stored":469074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":469040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":402173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:57:53.518 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T00:57:53.782 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:54.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:54 smithi047 ceph-mon[30960]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:54.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:57:54.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:57:54.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 -- 172.21.15.47:0/4287780457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4109e10 msgr2=0x7f27e4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 --2- 172.21.15.47:0/4287780457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4109e10 0x7f27e4110640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009ca0 tx=0x7f27dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 -- 172.21.15.47:0/4287780457 shutdown_connections 2024-09-21T00:57:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 --2- 172.21.15.47:0/4287780457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4109e10 0x7f27e4110640 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 --2- 172.21.15.47:0/4287780457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e41094c0 0x7f27e41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 --2- 172.21.15.47:0/4287780457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e4103b80 0x7f27e4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 -- 172.21.15.47:0/4287780457 >> 172.21.15.47:0/4287780457 conn(0x7f27e40ff610 msgr2=0x7f27e4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 -- 172.21.15.47:0/4287780457 shutdown_connections 2024-09-21T00:57:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.223+0000 7f27eab15640 1 -- 172.21.15.47:0/4287780457 wait complete. 2024-09-21T00:57:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.224+0000 7f27eab15640 1 Processor -- start 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.224+0000 7f27eab15640 1 -- start start 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.224+0000 7f27eab15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4103b80 0x7f27e419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.224+0000 7f27eab15640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e41094c0 0x7f27e419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27eab15640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e4109e10 0x7f27e419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27eab15640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4113ad0 con 0x7f27e4103b80 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27eab15640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4113950 con 0x7f27e4109e10 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27eab15640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4113c50 con 0x7f27e41094c0 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4103b80 0x7f27e419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4103b80 0x7f27e419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57148/0 (socket says 172.21.15.47:57148) 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 -- 172.21.15.47:0/910134849 learned_addr learned my addr 172.21.15.47:0/910134849 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e90b2640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e4109e10 0x7f27e419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e3fff640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e41094c0 0x7f27e419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 -- 172.21.15.47:0/910134849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e41094c0 msgr2=0x7f27e419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e41094c0 0x7f27e419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 -- 172.21.15.47:0/910134849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e4109e10 msgr2=0x7f27e419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e4109e10 0x7f27e419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 -- 172.21.15.47:0/910134849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e41a03b0 con 0x7f27e4103b80 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e88b1640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4103b80 0x7f27e419a440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27d400d950 tx=0x7f27d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e1ffb640 1 -- 172.21.15.47:0/910134849 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4017070 con 0x7f27e4103b80 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27e1ffb640 1 -- 172.21.15.47:0/910134849 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d4009c30 con 0x7f27e4103b80 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.225+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e41a06a0 con 0x7f27e4103b80 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.226+0000 7f27e1ffb640 1 -- 172.21.15.47:0/910134849 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d400f620 con 0x7f27e4103b80 2024-09-21T00:57:54.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.226+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e40755f0 con 0x7f27e4103b80 2024-09-21T00:57:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.227+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e4103f90 con 0x7f27e4103b80 2024-09-21T00:57:54.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.228+0000 7f27e1ffb640 1 -- 172.21.15.47:0/910134849 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f27d4010460 con 0x7f27e4103b80 2024-09-21T00:57:54.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.229+0000 7f27e1ffb640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27cc0b65a0 0x7f27cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:54.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.229+0000 7f27e3fff640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27cc0b65a0 0x7f27cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:54.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.229+0000 7f27e1ffb640 1 -- 172.21.15.47:0/910134849 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f27d40e7100 con 0x7f27e4103b80 2024-09-21T00:57:54.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.230+0000 7f27e3fff640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27cc0b65a0 0x7f27cc0b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f27e4102e80 tx=0x7f27d8005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:54.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.232+0000 7f27e1ffb640 1 -- 172.21.15.47:0/910134849 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27d40ad830 con 0x7f27e4103b80 2024-09-21T00:57:54.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:54 smithi134 ceph-mon[34785]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:54.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:57:54.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:57:54.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:54.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:54 smithi114 ceph-mon[34309]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:54.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:57:54.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:57:54.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:57:54.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.415+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27e4063800 con 0x7f27cc0b65a0 2024-09-21T00:57:54.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.420+0000 7f27e1ffb640 1 -- 172.21.15.47:0/910134849 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258634 (secure 0 0 0) 0x7f27e4063800 con 0x7f27cc0b65a0 2024-09-21T00:57:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:54.424 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27cc0b65a0 msgr2=0x7f27cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27cc0b65a0 0x7f27cc0b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f27e4102e80 tx=0x7f27d8005c60 comp rx=0 tx=0).stop 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4103b80 msgr2=0x7f27e419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4103b80 0x7f27e419a440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27d400d950 tx=0x7f27d400de10 comp rx=0 tx=0).stop 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 shutdown_connections 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27cc0b65a0 0x7f27cc0b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e4109e10 0x7f27e419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e41094c0 0x7f27e419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 --2- 172.21.15.47:0/910134849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27e4103b80 0x7f27e419a440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:54.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 >> 172.21.15.47:0/910134849 conn(0x7f27e40ff610 msgr2=0x7f27e4106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:54.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 shutdown_connections 2024-09-21T00:57:54.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:54.424+0000 7f27eab15640 1 -- 172.21.15.47:0/910134849 wait complete. 2024-09-21T00:57:55.132 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-21T00:57:53.270965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658357,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":201,"num_read_kb":193,"num_write":208,"num_write_kb":2245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381816,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560008,"statfs":{"total":1151940427776,"available":1151549448192,"internally_reserved":0,"allocated":11980800,"data_stored":6800067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003087"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.763290+0000","last_change":"2024-09-21T00:56:48.655444+0000","last_active":"2024-09-21T00:57:26.763290+0000","last_peered":"2024-09-21T00:57:26.763290+0000","last_clean":"2024-09-21T00:57:26.763290+0000","last_became_active":"2024-09-21T00:56:48.655083+0000","last_became_peered":"2024-09-21T00:56:48.655083+0000","last_unstale":"2024-09-21T00:57:26.763290+0000","last_undegraded":"2024-09-21T00:57:26.763290+0000","last_fullsized":"2024-09-21T00:57:26.763290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:07.300682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858584+0000","last_change":"2024-09-21T00:56:48.655066+0000","last_active":"2024-09-21T00:57:26.858584+0000","last_peered":"2024-09-21T00:57:26.858584+0000","last_clean":"2024-09-21T00:57:26.858584+0000","last_became_active":"2024-09-21T00:56:48.654679+0000","last_became_peered":"2024-09-21T00:56:48.654679+0000","last_unstale":"2024-09-21T00:57:26.858584+0000","last_undegraded":"2024-09-21T00:57:26.858584+0000","last_fullsized":"2024-09-21T00:57:26.858584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859012+0000","last_change":"2024-09-21T00:56:48.648770+0000","last_active":"2024-09-21T00:57:26.859012+0000","last_peered":"2024-09-21T00:57:26.859012+0000","last_clean":"2024-09-21T00:57:26.859012+0000","last_became_active":"2024-09-21T00:56:48.648383+0000","last_became_peered":"2024-09-21T00:56:48.648383+0000","last_unstale":"2024-09-21T00:57:26.859012+0000","last_undegraded":"2024-09-21T00:57:26.859012+0000","last_fullsized":"2024-09-21T00:57:26.859012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.616648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.768638+0000","last_change":"2024-09-21T00:57:26.767724+0000","last_active":"2024-09-21T00:57:26.768638+0000","last_peered":"2024-09-21T00:57:26.768638+0000","last_clean":"2024-09-21T00:57:26.768638+0000","last_became_active":"2024-09-21T00:57:26.767233+0000","last_became_peered":"2024-09-21T00:57:26.767233+0000","last_unstale":"2024-09-21T00:57:26.768638+0000","last_undegraded":"2024-09-21T00:57:26.768638+0000","last_fullsized":"2024-09-21T00:57:26.768638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:41.905543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761011+0000","last_change":"2024-09-21T00:56:48.654307+0000","last_active":"2024-09-21T00:57:26.761011+0000","last_peered":"2024-09-21T00:57:26.761011+0000","last_clean":"2024-09-21T00:57:26.761011+0000","last_became_active":"2024-09-21T00:56:48.653898+0000","last_became_peered":"2024-09-21T00:56:48.653898+0000","last_unstale":"2024-09-21T00:57:26.761011+0000","last_undegraded":"2024-09-21T00:57:26.761011+0000","last_fullsized":"2024-09-21T00:57:26.761011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858766+0000","last_change":"2024-09-21T00:56:48.649950+0000","last_active":"2024-09-21T00:57:26.858766+0000","last_peered":"2024-09-21T00:57:26.858766+0000","last_clean":"2024-09-21T00:57:26.858766+0000","last_became_active":"2024-09-21T00:56:48.649305+0000","last_became_peered":"2024-09-21T00:56:48.649305+0000","last_unstale":"2024-09-21T00:57:26.858766+0000","last_undegraded":"2024-09-21T00:57:26.858766+0000","last_fullsized":"2024-09-21T00:57:26.858766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:56.456377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766670+0000","last_change":"2024-09-21T00:56:48.656109+0000","last_active":"2024-09-21T00:57:26.766670+0000","last_peered":"2024-09-21T00:57:26.766670+0000","last_clean":"2024-09-21T00:57:26.766670+0000","last_became_active":"2024-09-21T00:56:48.654465+0000","last_became_peered":"2024-09-21T00:56:48.654465+0000","last_unstale":"2024-09-21T00:57:26.766670+0000","last_undegraded":"2024-09-21T00:57:26.766670+0000","last_fullsized":"2024-09-21T00:57:26.766670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:05.779845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769201+0000","last_change":"2024-09-21T00:56:48.656351+0000","last_active":"2024-09-21T00:57:26.769201+0000","last_peered":"2024-09-21T00:57:26.769201+0000","last_clean":"2024-09-21T00:57:26.769201+0000","last_became_active":"2024-09-21T00:56:48.654388+0000","last_became_peered":"2024-09-21T00:56:48.654388+0000","last_unstale":"2024-09-21T00:57:26.769201+0000","last_undegraded":"2024-09-21T00:57:26.769201+0000","last_fullsized":"2024-09-21T00:57:26.769201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:39.441882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764916+0000","last_change":"2024-09-21T00:56:48.661083+0000","last_active":"2024-09-21T00:57:26.764916+0000","last_peered":"2024-09-21T00:57:26.764916+0000","last_clean":"2024-09-21T00:57:26.764916+0000","last_became_active":"2024-09-21T00:56:48.660418+0000","last_became_peered":"2024-09-21T00:56:48.660418+0000","last_unstale":"2024-09-21T00:57:26.764916+0000","last_undegraded":"2024-09-21T00:57:26.764916+0000","last_fullsized":"2024-09-21T00:57:26.764916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:02.494368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859192+0000","last_change":"2024-09-21T00:56:48.660257+0000","last_active":"2024-09-21T00:57:26.859192+0000","last_peered":"2024-09-21T00:57:26.859192+0000","last_clean":"2024-09-21T00:57:26.859192+0000","last_became_active":"2024-09-21T00:56:48.659894+0000","last_became_peered":"2024-09-21T00:56:48.659894+0000","last_unstale":"2024-09-21T00:57:26.859192+0000","last_undegraded":"2024-09-21T00:57:26.859192+0000","last_fullsized":"2024-09-21T00:57:26.859192+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.012107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767404+0000","last_change":"2024-09-21T00:56:48.653146+0000","last_active":"2024-09-21T00:57:26.767404+0000","last_peered":"2024-09-21T00:57:26.767404+0000","last_clean":"2024-09-21T00:57:26.767404+0000","last_became_active":"2024-09-21T00:56:48.652599+0000","last_became_peered":"2024-09-21T00:56:48.652599+0000","last_unstale":"2024-09-21T00:57:26.767404+0000","last_undegraded":"2024-09-21T00:57:26.767404+0000","last_fullsized":"2024-09-21T00:57:26.767404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:16.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766372+0000","last_change":"2024-09-21T00:56:48.659521+0000","last_active":"2024-09-21T00:57:26.766372+0000","last_peered":"2024-09-21T00:57:26.766372+0000","last_clean":"2024-09-21T00:57:26.766372+0000","last_became_active":"2024-09-21T00:56:48.658168+0000","last_became_peered":"2024-09-21T00:56:48.658168+0000","last_unstale":"2024-09-21T00:57:26.766372+0000","last_undegraded":"2024-09-21T00:57:26.766372+0000","last_fullsized":"2024-09-21T00:57:26.766372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:51.910450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859441+0000","last_change":"2024-09-21T00:56:48.652163+0000","last_active":"2024-09-21T00:57:26.859441+0000","last_peered":"2024-09-21T00:57:26.859441+0000","last_clean":"2024-09-21T00:57:26.859441+0000","last_became_active":"2024-09-21T00:56:48.651839+0000","last_became_peered":"2024-09-21T00:56:48.651839+0000","last_unstale":"2024-09-21T00:57:26.859441+0000","last_undegraded":"2024-09-21T00:57:26.859441+0000","last_fullsized":"2024-09-21T00:57:26.859441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:50.682747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858561+0000","last_change":"2024-09-21T00:56:48.655106+0000","last_active":"2024-09-21T00:57:26.858561+0000","last_peered":"2024-09-21T00:57:26.858561+0000","last_clean":"2024-09-21T00:57:26.858561+0000","last_became_active":"2024-09-21T00:56:48.654722+0000","last_became_peered":"2024-09-21T00:56:48.654722+0000","last_unstale":"2024-09-21T00:57:26.858561+0000","last_undegraded":"2024-09-21T00:57:26.858561+0000","last_fullsized":"2024-09-21T00:57:26.858561+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:36.023960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859259+0000","last_change":"2024-09-21T00:56:48.648935+0000","last_active":"2024-09-21T00:57:26.859259+0000","last_peered":"2024-09-21T00:57:26.859259+0000","last_clean":"2024-09-21T00:57:26.859259+0000","last_became_active":"2024-09-21T00:56:48.648557+0000","last_became_peered":"2024-09-21T00:56:48.648557+0000","last_unstale":"2024-09-21T00:57:26.859259+0000","last_undegraded":"2024-09-21T00:57:26.859259+0000","last_fullsized":"2024-09-21T00:57:26.859259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:17.791401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764496+0000","last_change":"2024-09-21T00:56:48.651338+0000","last_active":"2024-09-21T00:57:26.764496+0000","last_peered":"2024-09-21T00:57:26.764496+0000","last_clean":"2024-09-21T00:57:26.764496+0000","last_became_active":"2024-09-21T00:56:48.650940+0000","last_became_peered":"2024-09-21T00:56:48.650940+0000","last_unstale":"2024-09-21T00:57:26.764496+0000","last_undegraded":"2024-09-21T00:57:26.764496+0000","last_fullsized":"2024-09-21T00:57:26.764496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.763332+0000","last_change":"2024-09-21T00:56:48.655091+0000","last_active":"2024-09-21T00:57:26.763332+0000","last_peered":"2024-09-21T00:57:26.763332+0000","last_clean":"2024-09-21T00:57:26.763332+0000","last_became_active":"2024-09-21T00:56:48.654534+0000","last_became_peered":"2024-09-21T00:56:48.654534+0000","last_unstale":"2024-09-21T00:57:26.763332+0000","last_undegraded":"2024-09-21T00:57:26.763332+0000","last_fullsized":"2024-09-21T00:57:26.763332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:44.007171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760224+0000","last_change":"2024-09-21T00:56:48.654933+0000","last_active":"2024-09-21T00:57:26.760224+0000","last_peered":"2024-09-21T00:57:26.760224+0000","last_clean":"2024-09-21T00:57:26.760224+0000","last_became_active":"2024-09-21T00:56:48.654523+0000","last_became_peered":"2024-09-21T00:56:48.654523+0000","last_unstale":"2024-09-21T00:57:26.760224+0000","last_undegraded":"2024-09-21T00:57:26.760224+0000","last_fullsized":"2024-09-21T00:57:26.760224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:58.190118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766193+0000","last_change":"2024-09-21T00:56:48.645166+0000","last_active":"2024-09-21T00:57:26.766193+0000","last_peered":"2024-09-21T00:57:26.766193+0000","last_clean":"2024-09-21T00:57:26.766193+0000","last_became_active":"2024-09-21T00:56:48.644695+0000","last_became_peered":"2024-09-21T00:56:48.644695+0000","last_unstale":"2024-09-21T00:57:26.766193+0000","last_undegraded":"2024-09-21T00:57:26.766193+0000","last_fullsized":"2024-09-21T00:57:26.766193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:07.564405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.762869+0000","last_change":"2024-09-21T00:56:48.659215+0000","last_active":"2024-09-21T00:57:26.762869+0000","last_peered":"2024-09-21T00:57:26.762869+0000","last_clean":"2024-09-21T00:57:26.762869+0000","last_became_active":"2024-09-21T00:56:48.658783+0000","last_became_peered":"2024-09-21T00:56:48.658783+0000","last_unstale":"2024-09-21T00:57:26.762869+0000","last_undegraded":"2024-09-21T00:57:26.762869+0000","last_fullsized":"2024-09-21T00:57:26.762869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:08:58.663963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859549+0000","last_change":"2024-09-21T00:56:48.644461+0000","last_active":"2024-09-21T00:57:26.859549+0000","last_peered":"2024-09-21T00:57:26.859549+0000","last_clean":"2024-09-21T00:57:26.859549+0000","last_became_active":"2024-09-21T00:56:48.643842+0000","last_became_peered":"2024-09-21T00:56:48.643842+0000","last_unstale":"2024-09-21T00:57:26.859549+0000","last_undegraded":"2024-09-21T00:57:26.859549+0000","last_fullsized":"2024-09-21T00:57:26.859549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:12.673501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764701+0000","last_change":"2024-09-21T00:56:48.651212+0000","last_active":"2024-09-21T00:57:26.764701+0000","last_peered":"2024-09-21T00:57:26.764701+0000","last_clean":"2024-09-21T00:57:26.764701+0000","last_became_active":"2024-09-21T00:56:48.650802+0000","last_became_peered":"2024-09-21T00:56:48.650802+0000","last_unstale":"2024-09-21T00:57:26.764701+0000","last_undegraded":"2024-09-21T00:57:26.764701+0000","last_fullsized":"2024-09-21T00:57:26.764701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:06.310898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769255+0000","last_change":"2024-09-21T00:56:48.647772+0000","last_active":"2024-09-21T00:57:26.769255+0000","last_peered":"2024-09-21T00:57:26.769255+0000","last_clean":"2024-09-21T00:57:26.769255+0000","last_became_active":"2024-09-21T00:56:48.647379+0000","last_became_peered":"2024-09-21T00:56:48.647379+0000","last_unstale":"2024-09-21T00:57:26.769255+0000","last_undegraded":"2024-09-21T00:57:26.769255+0000","last_fullsized":"2024-09-21T00:57:26.769255+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:06.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769851+0000","last_change":"2024-09-21T00:56:48.655841+0000","last_active":"2024-09-21T00:57:26.769851+0000","last_peered":"2024-09-21T00:57:26.769851+0000","last_clean":"2024-09-21T00:57:26.769851+0000","last_became_active":"2024-09-21T00:56:48.655270+0000","last_became_peered":"2024-09-21T00:56:48.655270+0000","last_unstale":"2024-09-21T00:57:26.769851+0000","last_undegraded":"2024-09-21T00:57:26.769851+0000","last_fullsized":"2024-09-21T00:57:26.769851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:28.350627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770077+0000","last_change":"2024-09-21T00:56:48.659457+0000","last_active":"2024-09-21T00:57:26.770077+0000","last_peered":"2024-09-21T00:57:26.770077+0000","last_clean":"2024-09-21T00:57:26.770077+0000","last_became_active":"2024-09-21T00:56:48.658999+0000","last_became_peered":"2024-09-21T00:56:48.658999+0000","last_unstale":"2024-09-21T00:57:26.770077+0000","last_undegraded":"2024-09-21T00:57:26.770077+0000","last_fullsized":"2024-09-21T00:57:26.770077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:56.196167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765909+0000","last_change":"2024-09-21T00:56:48.656361+0000","last_active":"2024-09-21T00:57:26.765909+0000","last_peered":"2024-09-21T00:57:26.765909+0000","last_clean":"2024-09-21T00:57:26.765909+0000","last_became_active":"2024-09-21T00:56:48.655999+0000","last_became_peered":"2024-09-21T00:56:48.655999+0000","last_unstale":"2024-09-21T00:57:26.765909+0000","last_undegraded":"2024-09-21T00:57:26.765909+0000","last_fullsized":"2024-09-21T00:57:26.765909+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:46.533280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.763092+0000","last_change":"2024-09-21T00:56:48.656549+0000","last_active":"2024-09-21T00:57:26.763092+0000","last_peered":"2024-09-21T00:57:26.763092+0000","last_clean":"2024-09-21T00:57:26.763092+0000","last_became_active":"2024-09-21T00:56:48.656154+0000","last_became_peered":"2024-09-21T00:56:48.656154+0000","last_unstale":"2024-09-21T00:57:26.763092+0000","last_undegraded":"2024-09-21T00:57:26.763092+0000","last_fullsized":"2024-09-21T00:57:26.763092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:37.244726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859737+0000","last_change":"2024-09-21T00:56:48.645857+0000","last_active":"2024-09-21T00:57:26.859737+0000","last_peered":"2024-09-21T00:57:26.859737+0000","last_clean":"2024-09-21T00:57:26.859737+0000","last_became_active":"2024-09-21T00:56:48.644462+0000","last_became_peered":"2024-09-21T00:56:48.644462+0000","last_unstale":"2024-09-21T00:57:26.859737+0000","last_undegraded":"2024-09-21T00:57:26.859737+0000","last_fullsized":"2024-09-21T00:57:26.859737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:11.690074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858884+0000","last_change":"2024-09-21T00:56:48.649937+0000","last_active":"2024-09-21T00:57:26.858884+0000","last_peered":"2024-09-21T00:57:26.858884+0000","last_clean":"2024-09-21T00:57:26.858884+0000","last_became_active":"2024-09-21T00:56:48.649233+0000","last_became_peered":"2024-09-21T00:56:48.649233+0000","last_unstale":"2024-09-21T00:57:26.858884+0000","last_undegraded":"2024-09-21T00:57:26.858884+0000","last_fullsized":"2024-09-21T00:57:26.858884+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:00.529143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765344+0000","last_change":"2024-09-21T00:56:48.645824+0000","last_active":"2024-09-21T00:57:26.765344+0000","last_peered":"2024-09-21T00:57:26.765344+0000","last_clean":"2024-09-21T00:57:26.765344+0000","last_became_active":"2024-09-21T00:56:48.645452+0000","last_became_peered":"2024-09-21T00:56:48.645452+0000","last_unstale":"2024-09-21T00:57:26.765344+0000","last_undegraded":"2024-09-21T00:57:26.765344+0000","last_fullsized":"2024-09-21T00:57:26.765344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:40.228469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769245+0000","last_change":"2024-09-21T00:57:26.769121+0000","last_active":"2024-09-21T00:57:26.769245+0000","last_peered":"2024-09-21T00:57:26.769245+0000","last_clean":"2024-09-21T00:57:26.769245+0000","last_became_active":"2024-09-21T00:57:26.768532+0000","last_became_peered":"2024-09-21T00:57:26.768532+0000","last_unstale":"2024-09-21T00:57:26.769245+0000","last_undegraded":"2024-09-21T00:57:26.769245+0000","last_fullsized":"2024-09-21T00:57:26.769245+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:57.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.762879+0000","last_change":"2024-09-21T00:56:48.656431+0000","last_active":"2024-09-21T00:57:26.762879+0000","last_peered":"2024-09-21T00:57:26.762879+0000","last_clean":"2024-09-21T00:57:26.762879+0000","last_became_active":"2024-09-21T00:56:48.656080+0000","last_became_peered":"2024-09-21T00:56:48.656080+0000","last_unstale":"2024-09-21T00:57:26.762879+0000","last_undegraded":"2024-09-21T00:57:26.762879+0000","last_fullsized":"2024-09-21T00:57:26.762879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:00.068094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760939+0000","last_change":"2024-09-21T00:56:48.653355+0000","last_active":"2024-09-21T00:57:26.760939+0000","last_peered":"2024-09-21T00:57:26.760939+0000","last_clean":"2024-09-21T00:57:26.760939+0000","last_became_active":"2024-09-21T00:56:48.652959+0000","last_became_peered":"2024-09-21T00:56:48.652959+0000","last_unstale":"2024-09-21T00:57:26.760939+0000","last_undegraded":"2024-09-21T00:57:26.760939+0000","last_fullsized":"2024-09-21T00:57:26.760939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:16.462806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770600+0000","last_change":"2024-09-21T00:56:46.634744+0000","last_active":"2024-09-21T00:57:26.770600+0000","last_peered":"2024-09-21T00:57:26.770600+0000","last_clean":"2024-09-21T00:57:26.770600+0000","last_became_active":"2024-09-21T00:56:46.634367+0000","last_became_peered":"2024-09-21T00:56:46.634367+0000","last_unstale":"2024-09-21T00:57:26.770600+0000","last_undegraded":"2024-09-21T00:57:26.770600+0000","last_fullsized":"2024-09-21T00:57:26.770600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:40.923450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770374+0000","last_change":"2024-09-21T00:56:48.660277+0000","last_active":"2024-09-21T00:57:26.770374+0000","last_peered":"2024-09-21T00:57:26.770374+0000","last_clean":"2024-09-21T00:57:26.770374+0000","last_became_active":"2024-09-21T00:56:48.659491+0000","last_became_peered":"2024-09-21T00:56:48.659491+0000","last_unstale":"2024-09-21T00:57:26.770374+0000","last_undegraded":"2024-09-21T00:57:26.770374+0000","last_fullsized":"2024-09-21T00:57:26.770374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:39.032704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858813+0000","last_change":"2024-09-21T00:56:46.634466+0000","last_active":"2024-09-21T00:57:26.858813+0000","last_peered":"2024-09-21T00:57:26.858813+0000","last_clean":"2024-09-21T00:57:26.858813+0000","last_became_active":"2024-09-21T00:56:46.634031+0000","last_became_peered":"2024-09-21T00:56:46.634031+0000","last_unstale":"2024-09-21T00:57:26.858813+0000","last_undegraded":"2024-09-21T00:57:26.858813+0000","last_fullsized":"2024-09-21T00:57:26.858813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:49.691014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858552+0000","last_change":"2024-09-21T00:56:46.628156+0000","last_active":"2024-09-21T00:57:26.858552+0000","last_peered":"2024-09-21T00:57:26.858552+0000","last_clean":"2024-09-21T00:57:26.858552+0000","last_became_active":"2024-09-21T00:56:46.627735+0000","last_became_peered":"2024-09-21T00:56:46.627735+0000","last_unstale":"2024-09-21T00:57:26.858552+0000","last_undegraded":"2024-09-21T00:57:26.858552+0000","last_fullsized":"2024-09-21T00:57:26.858552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:55.188016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769303+0000","last_change":"2024-09-21T00:56:48.649571+0000","last_active":"2024-09-21T00:57:26.769303+0000","last_peered":"2024-09-21T00:57:26.769303+0000","last_clean":"2024-09-21T00:57:26.769303+0000","last_became_active":"2024-09-21T00:56:48.647345+0000","last_became_peered":"2024-09-21T00:56:48.647345+0000","last_unstale":"2024-09-21T00:57:26.769303+0000","last_undegraded":"2024-09-21T00:57:26.769303+0000","last_fullsized":"2024-09-21T00:57:26.769303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:43.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770076+0000","last_change":"2024-09-21T00:56:46.634886+0000","last_active":"2024-09-21T00:57:26.770076+0000","last_peered":"2024-09-21T00:57:26.770076+0000","last_clean":"2024-09-21T00:57:26.770076+0000","last_became_active":"2024-09-21T00:56:46.634481+0000","last_became_peered":"2024-09-21T00:56:46.634481+0000","last_unstale":"2024-09-21T00:57:26.770076+0000","last_undegraded":"2024-09-21T00:57:26.770076+0000","last_fullsized":"2024-09-21T00:57:26.770076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:15.062776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.759972+0000","last_change":"2024-09-21T00:56:48.655740+0000","last_active":"2024-09-21T00:57:26.759972+0000","last_peered":"2024-09-21T00:57:26.759972+0000","last_clean":"2024-09-21T00:57:26.759972+0000","last_became_active":"2024-09-21T00:56:48.655312+0000","last_became_peered":"2024-09-21T00:56:48.655312+0000","last_unstale":"2024-09-21T00:57:26.759972+0000","last_undegraded":"2024-09-21T00:57:26.759972+0000","last_fullsized":"2024-09-21T00:57:26.759972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.815954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859165+0000","last_change":"2024-09-21T00:56:46.636212+0000","last_active":"2024-09-21T00:57:26.859165+0000","last_peered":"2024-09-21T00:57:26.859165+0000","last_clean":"2024-09-21T00:57:26.859165+0000","last_became_active":"2024-09-21T00:56:46.635702+0000","last_became_peered":"2024-09-21T00:56:46.635702+0000","last_unstale":"2024-09-21T00:57:26.859165+0000","last_undegraded":"2024-09-21T00:57:26.859165+0000","last_fullsized":"2024-09-21T00:57:26.859165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:11.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765366+0000","last_change":"2024-09-21T00:56:48.646300+0000","last_active":"2024-09-21T00:57:26.765366+0000","last_peered":"2024-09-21T00:57:26.765366+0000","last_clean":"2024-09-21T00:57:26.765366+0000","last_became_active":"2024-09-21T00:56:48.645906+0000","last_became_peered":"2024-09-21T00:56:48.645906+0000","last_unstale":"2024-09-21T00:57:26.765366+0000","last_undegraded":"2024-09-21T00:57:26.765366+0000","last_fullsized":"2024-09-21T00:57:26.765366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:47.593609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766522+0000","last_change":"2024-09-21T00:56:46.639405+0000","last_active":"2024-09-21T00:57:26.766522+0000","last_peered":"2024-09-21T00:57:26.766522+0000","last_clean":"2024-09-21T00:57:26.766522+0000","last_became_active":"2024-09-21T00:56:46.638659+0000","last_became_peered":"2024-09-21T00:56:46.638659+0000","last_unstale":"2024-09-21T00:57:26.766522+0000","last_undegraded":"2024-09-21T00:57:26.766522+0000","last_fullsized":"2024-09-21T00:57:26.766522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:19.718585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859405+0000","last_change":"2024-09-21T00:56:48.657572+0000","last_active":"2024-09-21T00:57:26.859405+0000","last_peered":"2024-09-21T00:57:26.859405+0000","last_clean":"2024-09-21T00:57:26.859405+0000","last_became_active":"2024-09-21T00:56:48.657219+0000","last_became_peered":"2024-09-21T00:56:48.657219+0000","last_unstale":"2024-09-21T00:57:26.859405+0000","last_undegraded":"2024-09-21T00:57:26.859405+0000","last_fullsized":"2024-09-21T00:57:26.859405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:48.870835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770265+0000","last_change":"2024-09-21T00:56:46.642710+0000","last_active":"2024-09-21T00:57:26.770265+0000","last_peered":"2024-09-21T00:57:26.770265+0000","last_clean":"2024-09-21T00:57:26.770265+0000","last_became_active":"2024-09-21T00:56:46.642273+0000","last_became_peered":"2024-09-21T00:56:46.642273+0000","last_unstale":"2024-09-21T00:57:26.770265+0000","last_undegraded":"2024-09-21T00:57:26.770265+0000","last_fullsized":"2024-09-21T00:57:26.770265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.751651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.860956+0000","last_change":"2024-09-21T00:57:26.860826+0000","last_active":"2024-09-21T00:57:26.860956+0000","last_peered":"2024-09-21T00:57:26.860956+0000","last_clean":"2024-09-21T00:57:26.860956+0000","last_became_active":"2024-09-21T00:57:26.860389+0000","last_became_peered":"2024-09-21T00:57:26.860389+0000","last_unstale":"2024-09-21T00:57:26.860956+0000","last_undegraded":"2024-09-21T00:57:26.860956+0000","last_fullsized":"2024-09-21T00:57:26.860956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:52.229655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":171,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:51.612059+0000","last_change":"2024-09-21T00:56:46.639555+0000","last_active":"2024-09-21T00:57:51.612059+0000","last_peered":"2024-09-21T00:57:51.612059+0000","last_clean":"2024-09-21T00:57:51.612059+0000","last_became_active":"2024-09-21T00:56:46.639200+0000","last_became_peered":"2024-09-21T00:56:46.639200+0000","last_unstale":"2024-09-21T00:57:51.612059+0000","last_undegraded":"2024-09-21T00:57:51.612059+0000","last_fullsized":"2024-09-21T00:57:51.612059+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:49.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66957,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":125,"num_write":27,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761236+0000","last_change":"2024-09-21T00:56:48.653950+0000","last_active":"2024-09-21T00:57:26.761236+0000","last_peered":"2024-09-21T00:57:26.761236+0000","last_clean":"2024-09-21T00:57:26.761236+0000","last_became_active":"2024-09-21T00:56:48.653570+0000","last_became_peered":"2024-09-21T00:56:48.653570+0000","last_unstale":"2024-09-21T00:57:26.761236+0000","last_undegraded":"2024-09-21T00:57:26.761236+0000","last_fullsized":"2024-09-21T00:57:26.761236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:43.708982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766728+0000","last_change":"2024-09-21T00:56:46.635861+0000","last_active":"2024-09-21T00:57:26.766728+0000","last_peered":"2024-09-21T00:57:26.766728+0000","last_clean":"2024-09-21T00:57:26.766728+0000","last_became_active":"2024-09-21T00:56:46.635452+0000","last_became_peered":"2024-09-21T00:56:46.635452+0000","last_unstale":"2024-09-21T00:57:26.766728+0000","last_undegraded":"2024-09-21T00:57:26.766728+0000","last_fullsized":"2024-09-21T00:57:26.766728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:15.591100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858880+0000","last_change":"2024-09-21T00:56:48.645567+0000","last_active":"2024-09-21T00:57:26.858880+0000","last_peered":"2024-09-21T00:57:26.858880+0000","last_clean":"2024-09-21T00:57:26.858880+0000","last_became_active":"2024-09-21T00:56:48.644499+0000","last_became_peered":"2024-09-21T00:56:48.644499+0000","last_unstale":"2024-09-21T00:57:26.858880+0000","last_undegraded":"2024-09-21T00:57:26.858880+0000","last_fullsized":"2024-09-21T00:57:26.858880+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:08.655065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770242+0000","last_change":"2024-09-21T00:56:46.633014+0000","last_active":"2024-09-21T00:57:26.770242+0000","last_peered":"2024-09-21T00:57:26.770242+0000","last_clean":"2024-09-21T00:57:26.770242+0000","last_became_active":"2024-09-21T00:56:46.632656+0000","last_became_peered":"2024-09-21T00:56:46.632656+0000","last_unstale":"2024-09-21T00:57:26.770242+0000","last_undegraded":"2024-09-21T00:57:26.770242+0000","last_fullsized":"2024-09-21T00:57:26.770242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:46.270469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767265+0000","last_change":"2024-09-21T00:56:48.659797+0000","last_active":"2024-09-21T00:57:26.767265+0000","last_peered":"2024-09-21T00:57:26.767265+0000","last_clean":"2024-09-21T00:57:26.767265+0000","last_became_active":"2024-09-21T00:56:48.659430+0000","last_became_peered":"2024-09-21T00:56:48.659430+0000","last_unstale":"2024-09-21T00:57:26.767265+0000","last_undegraded":"2024-09-21T00:57:26.767265+0000","last_fullsized":"2024-09-21T00:57:26.767265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:45.006414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766061+0000","last_change":"2024-09-21T00:56:46.636792+0000","last_active":"2024-09-21T00:57:26.766061+0000","last_peered":"2024-09-21T00:57:26.766061+0000","last_clean":"2024-09-21T00:57:26.766061+0000","last_became_active":"2024-09-21T00:56:46.636383+0000","last_became_peered":"2024-09-21T00:56:46.636383+0000","last_unstale":"2024-09-21T00:57:26.766061+0000","last_undegraded":"2024-09-21T00:57:26.766061+0000","last_fullsized":"2024-09-21T00:57:26.766061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:37.078166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766893+0000","last_change":"2024-09-21T00:56:48.657065+0000","last_active":"2024-09-21T00:57:26.766893+0000","last_peered":"2024-09-21T00:57:26.766893+0000","last_clean":"2024-09-21T00:57:26.766893+0000","last_became_active":"2024-09-21T00:56:48.656658+0000","last_became_peered":"2024-09-21T00:56:48.656658+0000","last_unstale":"2024-09-21T00:57:26.766893+0000","last_undegraded":"2024-09-21T00:57:26.766893+0000","last_fullsized":"2024-09-21T00:57:26.766893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:31.713457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761028+0000","last_change":"2024-09-21T00:56:46.642099+0000","last_active":"2024-09-21T00:57:26.761028+0000","last_peered":"2024-09-21T00:57:26.761028+0000","last_clean":"2024-09-21T00:57:26.761028+0000","last_became_active":"2024-09-21T00:56:46.641526+0000","last_became_peered":"2024-09-21T00:56:46.641526+0000","last_unstale":"2024-09-21T00:57:26.761028+0000","last_undegraded":"2024-09-21T00:57:26.761028+0000","last_fullsized":"2024-09-21T00:57:26.761028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:12.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770551+0000","last_change":"2024-09-21T00:56:48.660991+0000","last_active":"2024-09-21T00:57:26.770551+0000","last_peered":"2024-09-21T00:57:26.770551+0000","last_clean":"2024-09-21T00:57:26.770551+0000","last_became_active":"2024-09-21T00:56:48.660623+0000","last_became_peered":"2024-09-21T00:56:48.660623+0000","last_unstale":"2024-09-21T00:57:26.770551+0000","last_undegraded":"2024-09-21T00:57:26.770551+0000","last_fullsized":"2024-09-21T00:57:26.770551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:34.291977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761592+0000","last_change":"2024-09-21T00:56:46.637482+0000","last_active":"2024-09-21T00:57:26.761592+0000","last_peered":"2024-09-21T00:57:26.761592+0000","last_clean":"2024-09-21T00:57:26.761592+0000","last_became_active":"2024-09-21T00:56:46.634812+0000","last_became_peered":"2024-09-21T00:56:46.634812+0000","last_unstale":"2024-09-21T00:57:26.761592+0000","last_undegraded":"2024-09-21T00:57:26.761592+0000","last_fullsized":"2024-09-21T00:57:26.761592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:30.990625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.763137+0000","last_change":"2024-09-21T00:56:48.658930+0000","last_active":"2024-09-21T00:57:26.763137+0000","last_peered":"2024-09-21T00:57:26.763137+0000","last_clean":"2024-09-21T00:57:26.763137+0000","last_became_active":"2024-09-21T00:56:48.658545+0000","last_became_peered":"2024-09-21T00:56:48.658545+0000","last_unstale":"2024-09-21T00:57:26.763137+0000","last_undegraded":"2024-09-21T00:57:26.763137+0000","last_fullsized":"2024-09-21T00:57:26.763137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:30:57.850371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859892+0000","last_change":"2024-09-21T00:56:46.628768+0000","last_active":"2024-09-21T00:57:26.859892+0000","last_peered":"2024-09-21T00:57:26.859892+0000","last_clean":"2024-09-21T00:57:26.859892+0000","last_became_active":"2024-09-21T00:56:46.628374+0000","last_became_peered":"2024-09-21T00:56:46.628374+0000","last_unstale":"2024-09-21T00:57:26.859892+0000","last_undegraded":"2024-09-21T00:57:26.859892+0000","last_fullsized":"2024-09-21T00:57:26.859892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:58:15.133651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766226+0000","last_change":"2024-09-21T00:56:48.648097+0000","last_active":"2024-09-21T00:57:26.766226+0000","last_peered":"2024-09-21T00:57:26.766226+0000","last_clean":"2024-09-21T00:57:26.766226+0000","last_became_active":"2024-09-21T00:56:48.647619+0000","last_became_peered":"2024-09-21T00:56:48.647619+0000","last_unstale":"2024-09-21T00:57:26.766226+0000","last_undegraded":"2024-09-21T00:57:26.766226+0000","last_fullsized":"2024-09-21T00:57:26.766226+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:08.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770460+0000","last_change":"2024-09-21T00:56:46.636947+0000","last_active":"2024-09-21T00:57:26.770460+0000","last_peered":"2024-09-21T00:57:26.770460+0000","last_clean":"2024-09-21T00:57:26.770460+0000","last_became_active":"2024-09-21T00:56:46.636469+0000","last_became_peered":"2024-09-21T00:56:46.636469+0000","last_unstale":"2024-09-21T00:57:26.770460+0000","last_undegraded":"2024-09-21T00:57:26.770460+0000","last_fullsized":"2024-09-21T00:57:26.770460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:31.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.774275+0000","last_change":"2024-09-21T00:57:26.774145+0000","last_active":"2024-09-21T00:57:26.774275+0000","last_peered":"2024-09-21T00:57:26.774275+0000","last_clean":"2024-09-21T00:57:26.774275+0000","last_became_active":"2024-09-21T00:57:26.770919+0000","last_became_peered":"2024-09-21T00:57:26.770919+0000","last_unstale":"2024-09-21T00:57:26.774275+0000","last_undegraded":"2024-09-21T00:57:26.774275+0000","last_fullsized":"2024-09-21T00:57:26.774275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:21.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766495+0000","last_change":"2024-09-21T00:56:47.391206+0000","last_active":"2024-09-21T00:57:26.766495+0000","last_peered":"2024-09-21T00:57:26.766495+0000","last_clean":"2024-09-21T00:57:26.766495+0000","last_became_active":"2024-09-21T00:56:47.390708+0000","last_became_peered":"2024-09-21T00:56:47.390708+0000","last_unstale":"2024-09-21T00:57:26.766495+0000","last_undegraded":"2024-09-21T00:57:26.766495+0000","last_fullsized":"2024-09-21T00:57:26.766495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:59.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767463+0000","last_change":"2024-09-21T00:56:48.648452+0000","last_active":"2024-09-21T00:57:26.767463+0000","last_peered":"2024-09-21T00:57:26.767463+0000","last_clean":"2024-09-21T00:57:26.767463+0000","last_became_active":"2024-09-21T00:56:48.647682+0000","last_became_peered":"2024-09-21T00:56:48.647682+0000","last_unstale":"2024-09-21T00:57:26.767463+0000","last_undegraded":"2024-09-21T00:57:26.767463+0000","last_fullsized":"2024-09-21T00:57:26.767463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:45.844596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767127+0000","last_change":"2024-09-21T00:55:37.551147+0000","last_active":"2024-09-21T00:57:26.767127+0000","last_peered":"2024-09-21T00:57:26.767127+0000","last_clean":"2024-09-21T00:57:26.767127+0000","last_became_active":"2024-09-21T00:55:37.545124+0000","last_became_peered":"2024-09-21T00:55:37.545124+0000","last_unstale":"2024-09-21T00:57:26.767127+0000","last_undegraded":"2024-09-21T00:57:26.767127+0000","last_fullsized":"2024-09-21T00:57:26.767127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_clean_scrub_stamp":"2024-09-21T00:52:17.996374+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:20.205607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766410+0000","last_change":"2024-09-21T00:56:46.637264+0000","last_active":"2024-09-21T00:57:26.766410+0000","last_peered":"2024-09-21T00:57:26.766410+0000","last_clean":"2024-09-21T00:57:26.766410+0000","last_became_active":"2024-09-21T00:56:46.636320+0000","last_became_peered":"2024-09-21T00:56:46.636320+0000","last_unstale":"2024-09-21T00:57:26.766410+0000","last_undegraded":"2024-09-21T00:57:26.766410+0000","last_fullsized":"2024-09-21T00:57:26.766410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:42.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770001+0000","last_change":"2024-09-21T00:56:48.651051+0000","last_active":"2024-09-21T00:57:26.770001+0000","last_peered":"2024-09-21T00:57:26.770001+0000","last_clean":"2024-09-21T00:57:26.770001+0000","last_became_active":"2024-09-21T00:56:48.650693+0000","last_became_peered":"2024-09-21T00:56:48.650693+0000","last_unstale":"2024-09-21T00:57:26.770001+0000","last_undegraded":"2024-09-21T00:57:26.770001+0000","last_fullsized":"2024-09-21T00:57:26.770001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:49.575213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767099+0000","last_change":"2024-09-21T00:56:46.634826+0000","last_active":"2024-09-21T00:57:26.767099+0000","last_peered":"2024-09-21T00:57:26.767099+0000","last_clean":"2024-09-21T00:57:26.767099+0000","last_became_active":"2024-09-21T00:56:46.634370+0000","last_became_peered":"2024-09-21T00:56:46.634370+0000","last_unstale":"2024-09-21T00:57:26.767099+0000","last_undegraded":"2024-09-21T00:57:26.767099+0000","last_fullsized":"2024-09-21T00:57:26.767099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:29.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858430+0000","last_change":"2024-09-21T00:56:48.646296+0000","last_active":"2024-09-21T00:57:26.858430+0000","last_peered":"2024-09-21T00:57:26.858430+0000","last_clean":"2024-09-21T00:57:26.858430+0000","last_became_active":"2024-09-21T00:56:48.644271+0000","last_became_peered":"2024-09-21T00:56:48.644271+0000","last_unstale":"2024-09-21T00:57:26.858430+0000","last_undegraded":"2024-09-21T00:57:26.858430+0000","last_fullsized":"2024-09-21T00:57:26.858430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:27.609714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858660+0000","last_change":"2024-09-21T00:56:46.641852+0000","last_active":"2024-09-21T00:57:26.858660+0000","last_peered":"2024-09-21T00:57:26.858660+0000","last_clean":"2024-09-21T00:57:26.858660+0000","last_became_active":"2024-09-21T00:56:46.641449+0000","last_became_peered":"2024-09-21T00:56:46.641449+0000","last_unstale":"2024-09-21T00:57:26.858660+0000","last_undegraded":"2024-09-21T00:57:26.858660+0000","last_fullsized":"2024-09-21T00:57:26.858660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:51.086321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769928+0000","last_change":"2024-09-21T00:56:48.660295+0000","last_active":"2024-09-21T00:57:26.769928+0000","last_peered":"2024-09-21T00:57:26.769928+0000","last_clean":"2024-09-21T00:57:26.769928+0000","last_became_active":"2024-09-21T00:56:48.659638+0000","last_became_peered":"2024-09-21T00:56:48.659638+0000","last_unstale":"2024-09-21T00:57:26.769928+0000","last_undegraded":"2024-09-21T00:57:26.769928+0000","last_fullsized":"2024-09-21T00:57:26.769928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:34.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767333+0000","last_change":"2024-09-21T00:56:46.639317+0000","last_active":"2024-09-21T00:57:26.767333+0000","last_peered":"2024-09-21T00:57:26.767333+0000","last_clean":"2024-09-21T00:57:26.767333+0000","last_became_active":"2024-09-21T00:56:46.638732+0000","last_became_peered":"2024-09-21T00:56:46.638732+0000","last_unstale":"2024-09-21T00:57:26.767333+0000","last_undegraded":"2024-09-21T00:57:26.767333+0000","last_fullsized":"2024-09-21T00:57:26.767333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858927+0000","last_change":"2024-09-21T00:56:48.651038+0000","last_active":"2024-09-21T00:57:26.858927+0000","last_peered":"2024-09-21T00:57:26.858927+0000","last_clean":"2024-09-21T00:57:26.858927+0000","last_became_active":"2024-09-21T00:56:48.650682+0000","last_became_peered":"2024-09-21T00:56:48.650682+0000","last_unstale":"2024-09-21T00:57:26.858927+0000","last_undegraded":"2024-09-21T00:57:26.858927+0000","last_fullsized":"2024-09-21T00:57:26.858927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.015768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760268+0000","last_change":"2024-09-21T00:56:46.641993+0000","last_active":"2024-09-21T00:57:26.760268+0000","last_peered":"2024-09-21T00:57:26.760268+0000","last_clean":"2024-09-21T00:57:26.760268+0000","last_became_active":"2024-09-21T00:56:46.641631+0000","last_became_peered":"2024-09-21T00:56:46.641631+0000","last_unstale":"2024-09-21T00:57:26.760268+0000","last_undegraded":"2024-09-21T00:57:26.760268+0000","last_fullsized":"2024-09-21T00:57:26.760268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:12.986551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859024+0000","last_change":"2024-09-21T00:56:48.649620+0000","last_active":"2024-09-21T00:57:26.859024+0000","last_peered":"2024-09-21T00:57:26.859024+0000","last_clean":"2024-09-21T00:57:26.859024+0000","last_became_active":"2024-09-21T00:56:48.645757+0000","last_became_peered":"2024-09-21T00:56:48.645757+0000","last_unstale":"2024-09-21T00:57:26.859024+0000","last_undegraded":"2024-09-21T00:57:26.859024+0000","last_fullsized":"2024-09-21T00:57:26.859024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:12.802042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761384+0000","last_change":"2024-09-21T00:56:46.641723+0000","last_active":"2024-09-21T00:57:26.761384+0000","last_peered":"2024-09-21T00:57:26.761384+0000","last_clean":"2024-09-21T00:57:26.761384+0000","last_became_active":"2024-09-21T00:56:46.641219+0000","last_became_peered":"2024-09-21T00:56:46.641219+0000","last_unstale":"2024-09-21T00:57:26.761384+0000","last_undegraded":"2024-09-21T00:57:26.761384+0000","last_fullsized":"2024-09-21T00:57:26.761384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:47.676869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859888+0000","last_change":"2024-09-21T00:56:48.641940+0000","last_active":"2024-09-21T00:57:26.859888+0000","last_peered":"2024-09-21T00:57:26.859888+0000","last_clean":"2024-09-21T00:57:26.859888+0000","last_became_active":"2024-09-21T00:56:48.641521+0000","last_became_peered":"2024-09-21T00:56:48.641521+0000","last_unstale":"2024-09-21T00:57:26.859888+0000","last_undegraded":"2024-09-21T00:57:26.859888+0000","last_fullsized":"2024-09-21T00:57:26.859888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:38.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760272+0000","last_change":"2024-09-21T00:56:46.631037+0000","last_active":"2024-09-21T00:57:26.760272+0000","last_peered":"2024-09-21T00:57:26.760272+0000","last_clean":"2024-09-21T00:57:26.760272+0000","last_became_active":"2024-09-21T00:56:46.630612+0000","last_became_peered":"2024-09-21T00:56:46.630612+0000","last_unstale":"2024-09-21T00:57:26.760272+0000","last_undegraded":"2024-09-21T00:57:26.760272+0000","last_fullsized":"2024-09-21T00:57:26.760272+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.390614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770188+0000","last_change":"2024-09-21T00:56:48.649774+0000","last_active":"2024-09-21T00:57:26.770188+0000","last_peered":"2024-09-21T00:57:26.770188+0000","last_clean":"2024-09-21T00:57:26.770188+0000","last_became_active":"2024-09-21T00:56:48.649380+0000","last_became_peered":"2024-09-21T00:56:48.649380+0000","last_unstale":"2024-09-21T00:57:26.770188+0000","last_undegraded":"2024-09-21T00:57:26.770188+0000","last_fullsized":"2024-09-21T00:57:26.770188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:12.595820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766611+0000","last_change":"2024-09-21T00:56:47.391328+0000","last_active":"2024-09-21T00:57:26.766611+0000","last_peered":"2024-09-21T00:57:26.766611+0000","last_clean":"2024-09-21T00:57:26.766611+0000","last_became_active":"2024-09-21T00:56:47.390860+0000","last_became_peered":"2024-09-21T00:56:47.390860+0000","last_unstale":"2024-09-21T00:57:26.766611+0000","last_undegraded":"2024-09-21T00:57:26.766611+0000","last_fullsized":"2024-09-21T00:57:26.766611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:24.267908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858705+0000","last_change":"2024-09-21T00:56:48.657644+0000","last_active":"2024-09-21T00:57:26.858705+0000","last_peered":"2024-09-21T00:57:26.858705+0000","last_clean":"2024-09-21T00:57:26.858705+0000","last_became_active":"2024-09-21T00:56:48.657263+0000","last_became_peered":"2024-09-21T00:56:48.657263+0000","last_unstale":"2024-09-21T00:57:26.858705+0000","last_undegraded":"2024-09-21T00:57:26.858705+0000","last_fullsized":"2024-09-21T00:57:26.858705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:20.635667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.861164+0000","last_change":"2024-09-21T00:57:26.861046+0000","last_active":"2024-09-21T00:57:26.861164+0000","last_peered":"2024-09-21T00:57:26.861164+0000","last_clean":"2024-09-21T00:57:26.861164+0000","last_became_active":"2024-09-21T00:57:26.860555+0000","last_became_peered":"2024-09-21T00:57:26.860555+0000","last_unstale":"2024-09-21T00:57:26.861164+0000","last_undegraded":"2024-09-21T00:57:26.861164+0000","last_fullsized":"2024-09-21T00:57:26.861164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.786618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760939+0000","last_change":"2024-09-21T00:56:48.656028+0000","last_active":"2024-09-21T00:57:26.760939+0000","last_peered":"2024-09-21T00:57:26.760939+0000","last_clean":"2024-09-21T00:57:26.760939+0000","last_became_active":"2024-09-21T00:56:48.655380+0000","last_became_peered":"2024-09-21T00:56:48.655380+0000","last_unstale":"2024-09-21T00:57:26.760939+0000","last_undegraded":"2024-09-21T00:57:26.760939+0000","last_fullsized":"2024-09-21T00:57:26.760939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:37.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769373+0000","last_change":"2024-09-21T00:56:46.635884+0000","last_active":"2024-09-21T00:57:26.769373+0000","last_peered":"2024-09-21T00:57:26.769373+0000","last_clean":"2024-09-21T00:57:26.769373+0000","last_became_active":"2024-09-21T00:56:46.635545+0000","last_became_peered":"2024-09-21T00:56:46.635545+0000","last_unstale":"2024-09-21T00:57:26.769373+0000","last_undegraded":"2024-09-21T00:57:26.769373+0000","last_fullsized":"2024-09-21T00:57:26.769373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:03.170611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.762947+0000","last_change":"2024-09-21T00:56:48.649548+0000","last_active":"2024-09-21T00:57:26.762947+0000","last_peered":"2024-09-21T00:57:26.762947+0000","last_clean":"2024-09-21T00:57:26.762947+0000","last_became_active":"2024-09-21T00:56:48.649157+0000","last_became_peered":"2024-09-21T00:56:48.649157+0000","last_unstale":"2024-09-21T00:57:26.762947+0000","last_undegraded":"2024-09-21T00:57:26.762947+0000","last_fullsized":"2024-09-21T00:57:26.762947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:46.794274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766443+0000","last_change":"2024-09-21T00:56:46.632139+0000","last_active":"2024-09-21T00:57:26.766443+0000","last_peered":"2024-09-21T00:57:26.766443+0000","last_clean":"2024-09-21T00:57:26.766443+0000","last_became_active":"2024-09-21T00:56:46.631680+0000","last_became_peered":"2024-09-21T00:56:46.631680+0000","last_unstale":"2024-09-21T00:57:26.766443+0000","last_undegraded":"2024-09-21T00:57:26.766443+0000","last_fullsized":"2024-09-21T00:57:26.766443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:21:17.909161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769654+0000","last_change":"2024-09-21T00:56:48.654956+0000","last_active":"2024-09-21T00:57:26.769654+0000","last_peered":"2024-09-21T00:57:26.769654+0000","last_clean":"2024-09-21T00:57:26.769654+0000","last_became_active":"2024-09-21T00:56:48.654354+0000","last_became_peered":"2024-09-21T00:56:48.654354+0000","last_unstale":"2024-09-21T00:57:26.769654+0000","last_undegraded":"2024-09-21T00:57:26.769654+0000","last_fullsized":"2024-09-21T00:57:26.769654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:56.540664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.773409+0000","last_change":"2024-09-21T00:57:26.773289+0000","last_active":"2024-09-21T00:57:26.773409+0000","last_peered":"2024-09-21T00:57:26.773409+0000","last_clean":"2024-09-21T00:57:26.773409+0000","last_became_active":"2024-09-21T00:57:26.768686+0000","last_became_peered":"2024-09-21T00:57:26.768686+0000","last_unstale":"2024-09-21T00:57:26.773409+0000","last_undegraded":"2024-09-21T00:57:26.773409+0000","last_fullsized":"2024-09-21T00:57:26.773409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:04.247758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766979+0000","last_change":"2024-09-21T00:56:48.647881+0000","last_active":"2024-09-21T00:57:26.766979+0000","last_peered":"2024-09-21T00:57:26.766979+0000","last_clean":"2024-09-21T00:57:26.766979+0000","last_became_active":"2024-09-21T00:56:48.647391+0000","last_became_peered":"2024-09-21T00:56:48.647391+0000","last_unstale":"2024-09-21T00:57:26.766979+0000","last_undegraded":"2024-09-21T00:57:26.766979+0000","last_fullsized":"2024-09-21T00:57:26.766979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:57.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770259+0000","last_change":"2024-09-21T00:56:48.662093+0000","last_active":"2024-09-21T00:57:26.770259+0000","last_peered":"2024-09-21T00:57:26.770259+0000","last_clean":"2024-09-21T00:57:26.770259+0000","last_became_active":"2024-09-21T00:56:48.661652+0000","last_became_peered":"2024-09-21T00:56:48.661652+0000","last_unstale":"2024-09-21T00:57:26.770259+0000","last_undegraded":"2024-09-21T00:57:26.770259+0000","last_fullsized":"2024-09-21T00:57:26.770259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:42:29.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761597+0000","last_change":"2024-09-21T00:56:46.633958+0000","last_active":"2024-09-21T00:57:26.761597+0000","last_peered":"2024-09-21T00:57:26.761597+0000","last_clean":"2024-09-21T00:57:26.761597+0000","last_became_active":"2024-09-21T00:56:46.633473+0000","last_became_peered":"2024-09-21T00:56:46.633473+0000","last_unstale":"2024-09-21T00:57:26.761597+0000","last_undegraded":"2024-09-21T00:57:26.761597+0000","last_fullsized":"2024-09-21T00:57:26.761597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:03:41.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764943+0000","last_change":"2024-09-21T00:56:48.647961+0000","last_active":"2024-09-21T00:57:26.764943+0000","last_peered":"2024-09-21T00:57:26.764943+0000","last_clean":"2024-09-21T00:57:26.764943+0000","last_became_active":"2024-09-21T00:56:48.647301+0000","last_became_peered":"2024-09-21T00:56:48.647301+0000","last_unstale":"2024-09-21T00:57:26.764943+0000","last_undegraded":"2024-09-21T00:57:26.764943+0000","last_fullsized":"2024-09-21T00:57:26.764943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:21.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761236+0000","last_change":"2024-09-21T00:56:46.637114+0000","last_active":"2024-09-21T00:57:26.761236+0000","last_peered":"2024-09-21T00:57:26.761236+0000","last_clean":"2024-09-21T00:57:26.761236+0000","last_became_active":"2024-09-21T00:56:46.636244+0000","last_became_peered":"2024-09-21T00:56:46.636244+0000","last_unstale":"2024-09-21T00:57:26.761236+0000","last_undegraded":"2024-09-21T00:57:26.761236+0000","last_fullsized":"2024-09-21T00:57:26.761236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:36.374016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859300+0000","last_change":"2024-09-21T00:56:48.647249+0000","last_active":"2024-09-21T00:57:26.859300+0000","last_peered":"2024-09-21T00:57:26.859300+0000","last_clean":"2024-09-21T00:57:26.859300+0000","last_became_active":"2024-09-21T00:56:48.646888+0000","last_became_peered":"2024-09-21T00:56:48.646888+0000","last_unstale":"2024-09-21T00:57:26.859300+0000","last_undegraded":"2024-09-21T00:57:26.859300+0000","last_fullsized":"2024-09-21T00:57:26.859300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:02.997909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770241+0000","last_change":"2024-09-21T00:56:46.642781+0000","last_active":"2024-09-21T00:57:26.770241+0000","last_peered":"2024-09-21T00:57:26.770241+0000","last_clean":"2024-09-21T00:57:26.770241+0000","last_became_active":"2024-09-21T00:56:46.642346+0000","last_became_peered":"2024-09-21T00:56:46.642346+0000","last_unstale":"2024-09-21T00:57:26.770241+0000","last_undegraded":"2024-09-21T00:57:26.770241+0000","last_fullsized":"2024-09-21T00:57:26.770241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.050014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769909+0000","last_change":"2024-09-21T00:56:48.651942+0000","last_active":"2024-09-21T00:57:26.769909+0000","last_peered":"2024-09-21T00:57:26.769909+0000","last_clean":"2024-09-21T00:57:26.769909+0000","last_became_active":"2024-09-21T00:56:48.650577+0000","last_became_peered":"2024-09-21T00:56:48.650577+0000","last_unstale":"2024-09-21T00:57:26.769909+0000","last_undegraded":"2024-09-21T00:57:26.769909+0000","last_fullsized":"2024-09-21T00:57:26.769909+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:44.176473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760475+0000","last_change":"2024-09-21T00:56:46.634428+0000","last_active":"2024-09-21T00:57:26.760475+0000","last_peered":"2024-09-21T00:57:26.760475+0000","last_clean":"2024-09-21T00:57:26.760475+0000","last_became_active":"2024-09-21T00:56:46.634037+0000","last_became_peered":"2024-09-21T00:56:46.634037+0000","last_unstale":"2024-09-21T00:57:26.760475+0000","last_undegraded":"2024-09-21T00:57:26.760475+0000","last_fullsized":"2024-09-21T00:57:26.760475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:25.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67755,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":125,"num_read_kb":129,"num_write":83,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":203265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":402083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1511424,"data_stored":1059719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":831488,"data_stored":402782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266729,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":831488,"data_stored":402687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495661,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1425408,"data_stored":993150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40316,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704836,"statfs":{"total":95995035648,"available":95953752064,"internally_reserved":0,"allocated":827392,"data_stored":402200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":992750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":402105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":402304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":905216,"data_stored":469074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":469040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":402173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:57:55.136 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T00:57:55.136 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T00:57:55.136 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T00:57:55.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T00:57:55.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:55 smithi134 ceph-mon[34785]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:55.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:55 smithi134 ceph-mon[34785]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:55.396 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:55 smithi114 ceph-mon[34309]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:55 smithi114 ceph-mon[34309]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:55.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:55 smithi047 ceph-mon[30960]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:55.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:55 smithi047 ceph-mon[30960]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:57:55.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/3589036155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba01083d0 msgr2=0x7f2ba01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:55.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/3589036155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba01083d0 0x7f2ba01087e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009900 tx=0x7f2b9402a410 comp rx=0 tx=0).stop 2024-09-21T00:57:55.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/3589036155 shutdown_connections 2024-09-21T00:57:55.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/3589036155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ba0108d20 0x7f2ba010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:55.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/3589036155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba01083d0 0x7f2ba01087e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:55.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/3589036155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0102ae0 0x7f2ba0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/3589036155 >> 172.21.15.47:0/3589036155 conn(0x7f2ba0079760 msgr2=0x7f2ba0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/3589036155 shutdown_connections 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.845+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/3589036155 wait complete. 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.846+0000 7f2ba6ebf640 1 Processor -- start 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.846+0000 7f2ba6ebf640 1 -- start start 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba6ebf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba0102ae0 0x7f2ba0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba6ebf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ba01083d0 0x7f2ba01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba6ebf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0108d20 0x7f2ba019db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba6ebf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba01129d0 con 0x7f2ba0102ae0 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba6ebf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba0112850 con 0x7f2ba0108d20 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba6ebf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba0112b50 con 0x7f2ba01083d0 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba0102ae0 0x7f2ba0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba0102ae0 0x7f2ba0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57164/0 (socket says 172.21.15.47:57164) 2024-09-21T00:57:55.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 -- 172.21.15.47:0/4202066450 learned_addr learned my addr 172.21.15.47:0/4202066450 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2b9ffff640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ba01083d0 0x7f2ba01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba545c640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0108d20 0x7f2ba019db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 -- 172.21.15.47:0/4202066450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ba01083d0 msgr2=0x7f2ba01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ba01083d0 0x7f2ba01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 -- 172.21.15.47:0/4202066450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0108d20 msgr2=0x7f2ba019db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0108d20 0x7f2ba019db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 -- 172.21.15.47:0/4202066450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba019e240 con 0x7f2ba0102ae0 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba545c640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0108d20 0x7f2ba019db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.847+0000 7f2ba4c5b640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba0102ae0 0x7f2ba0198440 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000c890 tx=0x7f2b9000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.848+0000 7f2b9dffb640 1 -- 172.21.15.47:0/4202066450 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90004220 con 0x7f2ba0102ae0 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.848+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba019e4d0 con 0x7f2ba0102ae0 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.848+0000 7f2b9dffb640 1 -- 172.21.15.47:0/4202066450 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b900043c0 con 0x7f2ba0102ae0 2024-09-21T00:57:55.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.848+0000 7f2b9dffb640 1 -- 172.21.15.47:0/4202066450 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90004a00 con 0x7f2ba0102ae0 2024-09-21T00:57:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.848+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba019ec80 con 0x7f2ba0102ae0 2024-09-21T00:57:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.849+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba0103d10 con 0x7f2ba0102ae0 2024-09-21T00:57:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.850+0000 7f2b9dffb640 1 -- 172.21.15.47:0/4202066450 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2b900079b0 con 0x7f2ba0102ae0 2024-09-21T00:57:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.851+0000 7f2b9dffb640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2b880b65a0 0x7f2b880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.851+0000 7f2b9ffff640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2b880b65a0 0x7f2b880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.851+0000 7f2b9dffb640 1 -- 172.21.15.47:0/4202066450 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f2b900e7220 con 0x7f2ba0102ae0 2024-09-21T00:57:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.852+0000 7f2b9ffff640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2b880b65a0 0x7f2b880b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000c00 tx=0x7f2b94031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:55.856+0000 7f2b9dffb640 1 -- 172.21.15.47:0/4202066450 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b90014030 con 0x7f2ba0102ae0 2024-09-21T00:57:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.084+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2ba019f020 con 0x7f2ba0102ae0 2024-09-21T00:57:56.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.084+0000 7f2b9dffb640 1 -- 172.21.15.47:0/4202066450 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2b900ad950 con 0x7f2ba0102ae0 2024-09-21T00:57:56.085 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:56.085 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T00:57:56.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2b880b65a0 msgr2=0x7f2b880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2b880b65a0 0x7f2b880b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000c00 tx=0x7f2b94031400 comp rx=0 tx=0).stop 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba0102ae0 msgr2=0x7f2ba0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba0102ae0 0x7f2ba0198440 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000c890 tx=0x7f2b9000cd50 comp rx=0 tx=0).stop 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 shutdown_connections 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2b880b65a0 0x7f2b880b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0108d20 0x7f2ba019db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ba01083d0 0x7f2ba01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 --2- 172.21.15.47:0/4202066450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ba0102ae0 0x7f2ba0198440 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 >> 172.21.15.47:0/4202066450 conn(0x7f2ba0079760 msgr2=0x7f2ba006bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 shutdown_connections 2024-09-21T00:57:56.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:56.087+0000 7f2ba6ebf640 1 -- 172.21.15.47:0/4202066450 wait complete. 2024-09-21T00:57:56.098 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:56 smithi047 ceph-mon[30960]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:56.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:56 smithi134 ceph-mon[34785]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:56.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:56 smithi114 ceph-mon[34309]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:57:56.814 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T00:57:56.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:57:57.091 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:57 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4202066450' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:57:57.351 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:57 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4202066450' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:57:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:57 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4202066450' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T00:57:57.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.623+0000 7f67322a0640 1 -- 172.21.15.47:0/1462115444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c109df0 msgr2=0x7f672c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.623+0000 7f67322a0640 1 --2- 172.21.15.47:0/1462115444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c109df0 0x7f672c110620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6724009ca0 tx=0x7f672402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 -- 172.21.15.47:0/1462115444 shutdown_connections 2024-09-21T00:57:57.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 --2- 172.21.15.47:0/1462115444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c109df0 0x7f672c110620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 --2- 172.21.15.47:0/1462115444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c1094a0 0x7f672c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 --2- 172.21.15.47:0/1462115444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f672c103b60 0x7f672c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 -- 172.21.15.47:0/1462115444 >> 172.21.15.47:0/1462115444 conn(0x7f672c07b850 msgr2=0x7f672c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:57.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 -- 172.21.15.47:0/1462115444 shutdown_connections 2024-09-21T00:57:57.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 -- 172.21.15.47:0/1462115444 wait complete. 2024-09-21T00:57:57.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 Processor -- start 2024-09-21T00:57:57.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.624+0000 7f67322a0640 1 -- start start 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f67322a0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c103b60 0x7f672c19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f67322a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f672c1094a0 0x7f672c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f67322a0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c109df0 0x7f672c1a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f67322a0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f672c113ab0 con 0x7f672c103b60 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f67322a0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f672c113930 con 0x7f672c109df0 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f67322a0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f672c113c30 con 0x7f672c1094a0 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c103b60 0x7f672c19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c103b60 0x7f672c19c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57176/0 (socket says 172.21.15.47:57176) 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672bfff640 1 -- 172.21.15.47:0/3422876003 learned_addr learned my addr 172.21.15.47:0/3422876003 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f673083d640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c109df0 0x7f672c1a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672b7fe640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f672c1094a0 0x7f672c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672bfff640 1 -- 172.21.15.47:0/3422876003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f672c1094a0 msgr2=0x7f672c19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672bfff640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f672c1094a0 0x7f672c19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672bfff640 1 -- 172.21.15.47:0/3422876003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c109df0 msgr2=0x7f672c1a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672bfff640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c109df0 0x7f672c1a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.625+0000 7f672bfff640 1 -- 172.21.15.47:0/3422876003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c1a2570 con 0x7f672c103b60 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.626+0000 7f672bfff640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c103b60 0x7f672c19c600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f671c00d950 tx=0x7f671c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.626+0000 7f67297fa640 1 -- 172.21.15.47:0/3422876003 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c017070 con 0x7f672c103b60 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.626+0000 7f67297fa640 1 -- 172.21.15.47:0/3422876003 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f671c009c30 con 0x7f672c103b60 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.626+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672c1a2860 con 0x7f672c103b60 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.626+0000 7f67297fa640 1 -- 172.21.15.47:0/3422876003 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c00f620 con 0x7f672c103b60 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.626+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672c1a8fc0 con 0x7f672c103b60 2024-09-21T00:57:57.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.627+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c103f70 con 0x7f672c103b60 2024-09-21T00:57:57.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.628+0000 7f67297fa640 1 -- 172.21.15.47:0/3422876003 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f671c005030 con 0x7f672c103b60 2024-09-21T00:57:57.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.629+0000 7f67297fa640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67140b65a0 0x7f67140b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:57.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.630+0000 7f672b7fe640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67140b65a0 0x7f67140b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:57.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.630+0000 7f67297fa640 1 -- 172.21.15.47:0/3422876003 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f671c0e6f70 con 0x7f672c103b60 2024-09-21T00:57:57.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.630+0000 7f672b7fe640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67140b65a0 0x7f67140b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f672c107020 tx=0x7f672000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:57.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.633+0000 7f67297fa640 1 -- 172.21.15.47:0/3422876003 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f671c009de0 con 0x7f672c103b60 2024-09-21T00:57:57.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.856+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f672c1a92b0 con 0x7f672c103b60 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.857+0000 7f67297fa640 1 -- 172.21.15.47:0/3422876003 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f671c0b1b00 con 0x7f672c103b60 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:57.858 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:57:57.859 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67140b65a0 msgr2=0x7f67140b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67140b65a0 0x7f67140b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f672c107020 tx=0x7f672000b410 comp rx=0 tx=0).stop 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c103b60 msgr2=0x7f672c19c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c103b60 0x7f672c19c600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f671c00d950 tx=0x7f671c00de10 comp rx=0 tx=0).stop 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 shutdown_connections 2024-09-21T00:57:57.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67140b65a0 0x7f67140b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c109df0 0x7f672c1a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f672c1094a0 0x7f672c19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 --2- 172.21.15.47:0/3422876003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f672c103b60 0x7f672c19c600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:57.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 >> 172.21.15.47:0/3422876003 conn(0x7f672c07b850 msgr2=0x7f672c105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:57.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 shutdown_connections 2024-09-21T00:57:57.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:57.859+0000 7f67322a0640 1 -- 172.21.15.47:0/3422876003 wait complete. 2024-09-21T00:57:58.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:58 smithi047 ceph-mon[30960]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:57:58 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3422876003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:58 smithi134 ceph-mon[34785]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:57:58 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3422876003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:58.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:58 smithi114 ceph-mon[34309]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:57:58.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:57:58 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3422876003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:57:58.535 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:57:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:57:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 -- 172.21.15.47:0/3728192992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438102a60 msgr2=0x7fa438102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/3728192992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438102a60 0x7fa438102e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa428009900 tx=0x7fa42802a3f0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 -- 172.21.15.47:0/3728192992 shutdown_connections 2024-09-21T00:57:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/3728192992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa438108cf0 0x7fa43810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/3728192992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4381083a0 0x7fa4381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/3728192992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438102a60 0x7fa438102e70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 -- 172.21.15.47:0/3728192992 >> 172.21.15.47:0/3728192992 conn(0x7fa438079730 msgr2=0x7fa438079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 -- 172.21.15.47:0/3728192992 shutdown_connections 2024-09-21T00:57:59.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.273+0000 7fa43eb6d640 1 -- 172.21.15.47:0/3728192992 wait complete. 2024-09-21T00:57:59.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43eb6d640 1 Processor -- start 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43eb6d640 1 -- start start 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43eb6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa438102a60 0x7fa43819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43eb6d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4381083a0 0x7fa43819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43eb6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438108cf0 0x7fa43819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43eb6d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa438112960 con 0x7fa438108cf0 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43eb6d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4381127e0 con 0x7fa438102a60 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43eb6d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa438112ae0 con 0x7fa4381083a0 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43d10a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438108cf0 0x7fa43819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43d10a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438108cf0 0x7fa43819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57182/0 (socket says 172.21.15.47:57182) 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43d10a640 1 -- 172.21.15.47:0/1939185570 learned_addr learned my addr 172.21.15.47:0/1939185570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:57:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.274+0000 7fa43c909640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa438102a60 0x7fa43819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa437fff640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4381083a0 0x7fa43819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa43d10a640 1 -- 172.21.15.47:0/1939185570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4381083a0 msgr2=0x7fa43819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa43d10a640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4381083a0 0x7fa43819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa43d10a640 1 -- 172.21.15.47:0/1939185570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa438102a60 msgr2=0x7fa43819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa43d10a640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa438102a60 0x7fa43819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa43d10a640 1 -- 172.21.15.47:0/1939185570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4381a03f0 con 0x7fa438108cf0 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa43d10a640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438108cf0 0x7fa43819fd80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa43000cce0 tx=0x7fa43000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa435ffb640 1 -- 172.21.15.47:0/1939185570 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43000f450 con 0x7fa438108cf0 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa435ffb640 1 -- 172.21.15.47:0/1939185570 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa43000faa0 con 0x7fa438108cf0 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4381a06e0 con 0x7fa438108cf0 2024-09-21T00:57:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa435ffb640 1 -- 172.21.15.47:0/1939185570 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430018b70 con 0x7fa438108cf0 2024-09-21T00:57:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.275+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4381042f0 con 0x7fa438108cf0 2024-09-21T00:57:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.277+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa438103ce0 con 0x7fa438108cf0 2024-09-21T00:57:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.278+0000 7fa435ffb640 1 -- 172.21.15.47:0/1939185570 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa430018d10 con 0x7fa438108cf0 2024-09-21T00:57:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.279+0000 7fa435ffb640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa4200b65d0 0x7fa4200b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:57:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.279+0000 7fa43c909640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa4200b65d0 0x7fa4200b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:57:59.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.279+0000 7fa435ffb640 1 -- 172.21.15.47:0/1939185570 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa4300e7740 con 0x7fa438108cf0 2024-09-21T00:57:59.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.279+0000 7fa43c909640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa4200b65d0 0x7fa4200b8ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa428031440 tx=0x7fa428005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:57:59.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.283+0000 7fa435ffb640 1 -- 172.21.15.47:0/1939185570 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa430014030 con 0x7fa438108cf0 2024-09-21T00:57:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.510+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa43819b670 con 0x7fa438108cf0 2024-09-21T00:57:59.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.511+0000 7fa435ffb640 1 -- 172.21.15.47:0/1939185570 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7fa4300adf70 con 0x7fa438108cf0 2024-09-21T00:57:59.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:57:59.512 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:57:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:57:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa4200b65d0 msgr2=0x7fa4200b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa4200b65d0 0x7fa4200b8ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa428031440 tx=0x7fa428005e80 comp rx=0 tx=0).stop 2024-09-21T00:57:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438108cf0 msgr2=0x7fa43819fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:57:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438108cf0 0x7fa43819fd80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa43000cce0 tx=0x7fa43000a620 comp rx=0 tx=0).stop 2024-09-21T00:57:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 shutdown_connections 2024-09-21T00:57:59.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa4200b65d0 0x7fa4200b8ae0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa438108cf0 0x7fa43819fd80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4381083a0 0x7fa43819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 --2- 172.21.15.47:0/1939185570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa438102a60 0x7fa43819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:57:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 >> 172.21.15.47:0/1939185570 conn(0x7fa438079730 msgr2=0x7fa4381067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:57:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 shutdown_connections 2024-09-21T00:57:59.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:57:59.513+0000 7fa43eb6d640 1 -- 172.21.15.47:0/1939185570 wait complete. 2024-09-21T00:58:00.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:58:00.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:00 smithi047 ceph-mon[30960]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:00.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:00 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1939185570' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:00.462 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:00 smithi134 ceph-mon[34785]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:00 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1939185570' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:00.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:00 smithi114 ceph-mon[34309]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:00.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:00 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1939185570' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 -- 172.21.15.47:0/2446576722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a10105300 msgr2=0x7f9a1010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 --2- 172.21.15.47:0/2446576722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a10105300 0x7f9a1010d850 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009900 tx=0x7f9a0402a410 comp rx=0 tx=0).stop 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 -- 172.21.15.47:0/2446576722 shutdown_connections 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 --2- 172.21.15.47:0/2446576722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a1010de10 0x7f9a10110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 --2- 172.21.15.47:0/2446576722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a10105300 0x7f9a1010d850 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 --2- 172.21.15.47:0/2446576722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a101049b0 0x7f9a10104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 -- 172.21.15.47:0/2446576722 >> 172.21.15.47:0/2446576722 conn(0x7f9a10079730 msgr2=0x7f9a10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 -- 172.21.15.47:0/2446576722 shutdown_connections 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.930+0000 7f9a15883640 1 -- 172.21.15.47:0/2446576722 wait complete. 2024-09-21T00:58:00.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a15883640 1 Processor -- start 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a15883640 1 -- start start 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a15883640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a101049b0 0x7f9a1019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a15883640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a10105300 0x7f9a1019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a15883640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a1010de10 0x7f9a1019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a15883640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10113a70 con 0x7f9a1010de10 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a15883640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101138f0 con 0x7f9a101049b0 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a15883640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10113bf0 con 0x7f9a10105300 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a0f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a1010de10 0x7f9a1019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a0f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a1010de10 0x7f9a1019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57210/0 (socket says 172.21.15.47:57210) 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.931+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1649366882 learned_addr learned my addr 172.21.15.47:0/1649366882 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0effd640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a101049b0 0x7f9a1019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0e7fc640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a10105300 0x7f9a1019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1649366882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a10105300 msgr2=0x7f9a1019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0f7fe640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a10105300 0x7f9a1019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:00.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1649366882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a101049b0 msgr2=0x7f9a1019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0f7fe640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a101049b0 0x7f9a1019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1649366882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a101a0410 con 0x7f9a1010de10 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0effd640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a101049b0 0x7f9a1019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a0f7fe640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a1010de10 0x7f9a1019fce0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800d950 tx=0x7f9a0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a14881640 1 -- 172.21.15.47:0/1649366882 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08017030 con 0x7f9a1010de10 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a101a0700 con 0x7f9a1010de10 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a14881640 1 -- 172.21.15.47:0/1649366882 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a08004020 con 0x7f9a1010de10 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a14881640 1 -- 172.21.15.47:0/1649366882 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08003b50 con 0x7f9a1010de10 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.932+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a101a6e60 con 0x7f9a1010de10 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.933+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a10104dc0 con 0x7f9a1010de10 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.935+0000 7f9a14881640 1 -- 172.21.15.47:0/1649366882 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f9a0801a070 con 0x7f9a1010de10 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.936+0000 7f9a14881640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f99f80b65a0 0x7f99f80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.936+0000 7f9a0effd640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f99f80b65a0 0x7f99f80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:00.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.936+0000 7f9a14881640 1 -- 172.21.15.47:0/1649366882 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f9a080e7040 con 0x7f9a1010de10 2024-09-21T00:58:00.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.936+0000 7f9a0effd640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f99f80b65a0 0x7f99f80b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a1006bc60 tx=0x7f9a00009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:00.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:00.939+0000 7f9a14881640 1 -- 172.21.15.47:0/1649366882 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a08021070 con 0x7f9a1010de10 2024-09-21T00:58:01.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.129+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a10108f70 con 0x7f9a1010de10 2024-09-21T00:58:01.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.131+0000 7f9a14881640 1 -- 172.21.15.47:0/1649366882 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22632 (secure 0 0 0) 0x7f9a080ad770 con 0x7f9a1010de10 2024-09-21T00:58:01.132 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:01.133 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":77,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:57:26.756741+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:58:01.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f99f80b65a0 msgr2=0x7f99f80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:01.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f99f80b65a0 0x7f99f80b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a1006bc60 tx=0x7f9a00009500 comp rx=0 tx=0).stop 2024-09-21T00:58:01.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a1010de10 msgr2=0x7f9a1019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:01.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a1010de10 0x7f9a1019fce0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800d950 tx=0x7f9a0800de10 comp rx=0 tx=0).stop 2024-09-21T00:58:01.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 shutdown_connections 2024-09-21T00:58:01.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f99f80b65a0 0x7f99f80b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:01.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a1010de10 0x7f9a1019fce0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:01.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a10105300 0x7f9a1019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:01.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 --2- 172.21.15.47:0/1649366882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a101049b0 0x7f9a1019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:01.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 >> 172.21.15.47:0/1649366882 conn(0x7f9a10079730 msgr2=0x7f9a10100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:01.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 shutdown_connections 2024-09-21T00:58:01.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:01.134+0000 7f9a15883640 1 -- 172.21.15.47:0/1649366882 wait complete. 2024-09-21T00:58:01.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:01 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1649366882' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:01.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:01 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1649366882' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:01.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:01 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1649366882' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:01.838 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:58:02.095 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:02.480 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:02 smithi047 ceph-mon[30960]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:02.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:02 smithi134 ceph-mon[34785]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:02.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 -- 172.21.15.47:0/3561686774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa181094f0 msgr2=0x7faa18109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 --2- 172.21.15.47:0/3561686774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa181094f0 0x7faa18109900 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009900 tx=0x7faa0c02a410 comp rx=0 tx=0).stop 2024-09-21T00:58:02.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 -- 172.21.15.47:0/3561686774 shutdown_connections 2024-09-21T00:58:02.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 --2- 172.21.15.47:0/3561686774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa18109e40 0x7faa18110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 --2- 172.21.15.47:0/3561686774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa181094f0 0x7faa18109900 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 --2- 172.21.15.47:0/3561686774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa18103bb0 0x7faa18103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 -- 172.21.15.47:0/3561686774 >> 172.21.15.47:0/3561686774 conn(0x7faa180ff600 msgr2=0x7faa18101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 -- 172.21.15.47:0/3561686774 shutdown_connections 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 -- 172.21.15.47:0/3561686774 wait complete. 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.571+0000 7faa1de18640 1 Processor -- start 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa1de18640 1 -- start start 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa1de18640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa18103bb0 0x7faa1819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa1de18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa181094f0 0x7faa1819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa1de18640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa18109e40 0x7faa1819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa1de18640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa18113b20 con 0x7faa18109e40 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa1de18640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa181139a0 con 0x7faa181094f0 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa1de18640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa18113ca0 con 0x7faa18103bb0 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa18109e40 0x7faa1819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa18109e40 0x7faa1819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48896/0 (socket says 172.21.15.47:48896) 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 -- 172.21.15.47:0/98583739 learned_addr learned my addr 172.21.15.47:0/98583739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa177fe640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa18103bb0 0x7faa1819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa16ffd640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa181094f0 0x7faa1819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 -- 172.21.15.47:0/98583739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa18103bb0 msgr2=0x7faa1819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa18103bb0 0x7faa1819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 -- 172.21.15.47:0/98583739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa181094f0 msgr2=0x7faa1819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa181094f0 0x7faa1819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 -- 172.21.15.47:0/98583739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa181a03c0 con 0x7faa18109e40 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.572+0000 7faa17fff640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa18109e40 0x7faa1819fd50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faa1000b970 tx=0x7faa1000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.573+0000 7faa14ff9640 1 -- 172.21.15.47:0/98583739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10019070 con 0x7faa18109e40 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.573+0000 7faa14ff9640 1 -- 172.21.15.47:0/98583739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa10014440 con 0x7faa18109e40 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.573+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa181a06b0 con 0x7faa18109e40 2024-09-21T00:58:02.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.573+0000 7faa14ff9640 1 -- 172.21.15.47:0/98583739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100075d0 con 0x7faa18109e40 2024-09-21T00:58:02.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.573+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa181a6ed0 con 0x7faa18109e40 2024-09-21T00:58:02.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.574+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa18103fc0 con 0x7faa18109e40 2024-09-21T00:58:02.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.576+0000 7faa14ff9640 1 -- 172.21.15.47:0/98583739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7faa1001c070 con 0x7faa18109e40 2024-09-21T00:58:02.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.577+0000 7faa14ff9640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa000b65d0 0x7faa000b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:02.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.577+0000 7faa177fe640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa000b65d0 0x7faa000b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:02.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.577+0000 7faa14ff9640 1 -- 172.21.15.47:0/98583739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7faa100e6df0 con 0x7faa18109e40 2024-09-21T00:58:02.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.578+0000 7faa177fe640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa000b65d0 0x7faa000b8ae0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa0800abe0 tx=0x7faa0800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:02.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.581+0000 7faa14ff9640 1 -- 172.21.15.47:0/98583739 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa100ad520 con 0x7faa18109e40 2024-09-21T00:58:02.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:02 smithi114 ceph-mon[34309]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:02.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.808+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa1819b640 con 0x7faa18109e40 2024-09-21T00:58:02.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.808+0000 7faa14ff9640 1 -- 172.21.15.47:0/98583739 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7faa1819b640 con 0x7faa18109e40 2024-09-21T00:58:02.809 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:02.810 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:58:02.810 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:58:02.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.810+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa000b65d0 msgr2=0x7faa000b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.810+0000 7faa1de18640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa000b65d0 0x7faa000b8ae0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa0800abe0 tx=0x7faa0800a2d0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.810+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa18109e40 msgr2=0x7faa1819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.810+0000 7faa1de18640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa18109e40 0x7faa1819fd50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faa1000b970 tx=0x7faa1000bd70 comp rx=0 tx=0).stop 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.811+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 shutdown_connections 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.811+0000 7faa1de18640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa000b65d0 0x7faa000b8ae0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.811+0000 7faa1de18640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa18109e40 0x7faa1819fd50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.811+0000 7faa1de18640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa181094f0 0x7faa1819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.811+0000 7faa1de18640 1 --2- 172.21.15.47:0/98583739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa18103bb0 0x7faa1819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.811+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 >> 172.21.15.47:0/98583739 conn(0x7faa180ff600 msgr2=0x7faa18101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.811+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 shutdown_connections 2024-09-21T00:58:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:02.811+0000 7faa1de18640 1 -- 172.21.15.47:0/98583739 wait complete. 2024-09-21T00:58:03.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T00:56:49.241985+0000', 'modified': '2024-09-21T00:56:58.284880+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24653}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24637': {'gid': 24637, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6839/924032014', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 924032014}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 924032014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.114:6839/4124175185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6838', 'nonce': 4124175185}, {'type': 'v1', 'addr': '172.21.15.114:6839', 'nonce': 4124175185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24653]} 2024-09-21T00:58:03.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T00:58:03.414 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T00:58:03.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:03 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/98583739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:03.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:03 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/98583739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:03.673 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:03.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:03 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/98583739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:04.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 -- 172.21.15.47:0/3104079276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 msgr2=0x7f413c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 --2- 172.21.15.47:0/3104079276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 0x7f413c102e70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f412c009900 tx=0x7f412c02a3f0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 -- 172.21.15.47:0/3104079276 shutdown_connections 2024-09-21T00:58:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 --2- 172.21.15.47:0/3104079276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c108cf0 0x7f413c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 --2- 172.21.15.47:0/3104079276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f413c1083a0 0x7f413c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 --2- 172.21.15.47:0/3104079276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 0x7f413c102e70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 -- 172.21.15.47:0/3104079276 >> 172.21.15.47:0/3104079276 conn(0x7f413c079730 msgr2=0x7f413c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 -- 172.21.15.47:0/3104079276 shutdown_connections 2024-09-21T00:58:04.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 -- 172.21.15.47:0/3104079276 wait complete. 2024-09-21T00:58:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.104+0000 7f4141136640 1 Processor -- start 2024-09-21T00:58:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f4141136640 1 -- start start 2024-09-21T00:58:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f4141136640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 0x7f413c19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f4141136640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c1083a0 0x7f413c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f4141136640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f413c108cf0 0x7f413c1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f4141136640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f413c1129b0 con 0x7f413c102a60 2024-09-21T00:58:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f4141136640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f413c112830 con 0x7f413c1083a0 2024-09-21T00:58:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f4141136640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f413c112b30 con 0x7f413c108cf0 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f413ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 0x7f413c19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f413ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 0x7f413c19c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48914/0 (socket says 172.21.15.47:48914) 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f413ad9d640 1 -- 172.21.15.47:0/893488273 learned_addr learned my addr 172.21.15.47:0/893488273 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f413b59e640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f413c108cf0 0x7f413c1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.105+0000 7f413a59c640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c1083a0 0x7f413c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f413ad9d640 1 -- 172.21.15.47:0/893488273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f413c108cf0 msgr2=0x7f413c1a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f413ad9d640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f413c108cf0 0x7f413c1a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f413ad9d640 1 -- 172.21.15.47:0/893488273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c1083a0 msgr2=0x7f413c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f413ad9d640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c1083a0 0x7f413c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f413ad9d640 1 -- 172.21.15.47:0/893488273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c1a24e0 con 0x7f413c102a60 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f413ad9d640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 0x7f413c19c640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f412c005ab0 tx=0x7f412c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f4123fff640 1 -- 172.21.15.47:0/893488273 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c03f070 con 0x7f413c102a60 2024-09-21T00:58:04.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f4141136640 1 -- 172.21.15.47:0/893488273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c1a2770 con 0x7f413c102a60 2024-09-21T00:58:04.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f4123fff640 1 -- 172.21.15.47:0/893488273 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c031d60 con 0x7f413c102a60 2024-09-21T00:58:04.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f4123fff640 1 -- 172.21.15.47:0/893488273 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c035030 con 0x7f413c102a60 2024-09-21T00:58:04.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.106+0000 7f4141136640 1 -- 172.21.15.47:0/893488273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c1a2ca0 con 0x7f413c102a60 2024-09-21T00:58:04.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f41476aa740 1 Processor -- start 2024-09-21T00:58:04.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f41476aa740 1 -- start start 2024-09-21T00:58:04.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f4123fff640 1 -- 172.21.15.47:0/893488273 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f412c042070 con 0x7f413c102a60 2024-09-21T00:58:04.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f41476aa740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c803e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f41476aa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803e4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f41476aa740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 0x558c803e4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f41476aa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558c8035bc10 con 0x558c800150a0 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f41476aa740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558c8034b040 con 0x558c8001d280 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f41476aa740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558c8034ee50 con 0x558c8003df60 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f413ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f413ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803e4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48920/0 (socket says 172.21.15.47:48920) 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.109+0000 7f413ad9d640 1 -- 172.21.15.47:0/2803453778 learned_addr learned my addr 172.21.15.47:0/2803453778 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413b59e640 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c803e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413a59c640 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 0x558c803e4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413ad9d640 1 -- 172.21.15.47:0/2803453778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 msgr2=0x558c803e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413ad9d640 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c803e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413ad9d640 1 -- 172.21.15.47:0/2803453778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 msgr2=0x558c803e4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413ad9d640 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 0x558c803e4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413ad9d640 1 -- 172.21.15.47:0/2803453778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c800a9540 con 0x558c800150a0 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413ad9d640 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803e4440 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f412c1053b0 tx=0x7f412c10bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6479ca24dda6cb5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f4123fff640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f41240b65d0 0x7f41240b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f41217fa640 1 -- 172.21.15.47:0/2803453778 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c1107c0 con 0x558c800150a0 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f41217fa640 1 -- 172.21.15.47:0/2803453778 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c119070 con 0x558c800150a0 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f413b59e640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f41240b65d0 0x7f41240b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.110+0000 7f41217fa640 1 -- 172.21.15.47:0/2803453778 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0cd260 con 0x558c800150a0 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f4123fff640 1 -- 172.21.15.47:0/893488273 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f412c1079c0 con 0x7f413c102a60 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f41476aa740 1 -- 172.21.15.47:0/2803453778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 msgr2=0x558c803e4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f41476aa740 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803e4440 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f412c1053b0 tx=0x7f412c10bb90 comp rx=0 tx=0).stop 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f413b59e640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f41240b65d0 0x7f41240b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4134007f00 tx=0x7f4134007520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f41476aa740 1 -- 172.21.15.47:0/2803453778 shutdown_connections 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f41476aa740 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 0x558c803e4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f41476aa740 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803e4440 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f41476aa740 1 --2- 172.21.15.47:0/2803453778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c803e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.111+0000 7f41476aa740 1 -- 172.21.15.47:0/2803453778 >> 172.21.15.47:0/2803453778 conn(0x558c80032350 msgr2=0x558c803e1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 -- 172.21.15.47:0/2803453778 shutdown_connections 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 -- 172.21.15.47:0/2803453778 wait complete. 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 -- start start 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 Processor -- start 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c800150a0 0x558c803ef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 0x558c803efc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8003df60 0x558c803fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558c801ac5f0 con 0x558c8003df60 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558c802e6010 con 0x558c8001d280 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558c803f24a0 con 0x558c800150a0 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.112+0000 7f41476aa740 10 client.0 _ll_register_callbacks cb 0x558c80345340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8003df60 0x558c803fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8003df60 0x558c803fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48926/0 (socket says 172.21.15.47:48926) 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 -- 172.21.15.47:0/3497219924 learned_addr learned my addr 172.21.15.47:0/3497219924 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413a59c640 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 0x558c803efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413ad9d640 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c800150a0 0x558c803ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 -- 172.21.15.47:0/3497219924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c800150a0 msgr2=0x558c803ef730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c800150a0 0x558c803ef730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 -- 172.21.15.47:0/3497219924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 msgr2=0x558c803efc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 0x558c803efc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 -- 172.21.15.47:0/3497219924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c80313a00 con 0x558c8003df60 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413ad9d640 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c800150a0 0x558c803ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f413b59e640 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8003df60 0x558c803fb6c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f413401ebf0 tx=0x7f4134004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d84b76cd257165 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f411eff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f411eff5640 1 -- 172.21.15.47:0/3497219924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413400fcb0 con 0x558c8003df60 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f411eff5640 1 -- 172.21.15.47:0/3497219924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f4134016030 con 0x558c8003df60 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.113+0000 7f41476aa740 1 -- 172.21.15.47:0/3497219924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f412c119070 con 0x558c8003df60 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f411eff5640 1 -- 172.21.15.47:0/3497219924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f413400fe50 con 0x558c8003df60 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f41476aa740 10 client.15129 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f41476aa740 1 -- 172.21.15.47:0/3497219924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558c803fe260 con 0x558c8003df60 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f411eff5640 1 -- 172.21.15.47:0/3497219924 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c119070 con 0x558c8003df60 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f411eff5640 1 -- 172.21.15.47:0/3497219924 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4134026400 con 0x558c8003df60 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f41476aa740 10 client.15129 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f41476aa740 10 client.15129 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f41476aa740 20 client.15129 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f41476aa740 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558c7fffc8e0 0x558c80401d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f41476aa740 4 client.15129 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:04.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f41476aa740 1 -- 172.21.15.47:0/3497219924 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c8035db60 con 0x558c7fffc8e0 2024-09-21T00:58:04.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.114+0000 7f413ad9d640 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558c7fffc8e0 0x558c80401d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.115+0000 7f411eff5640 10 client.15129 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.115+0000 7f413ad9d640 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558c7fffc8e0 0x558c80401d60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecdb147292ce45b0 server_cookie=1d39475e42145c72 in_seq=0 out_seq=0 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f411eff5640 1 -- 172.21.15.47:0/3497219924 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c8035db60 con 0x558c7fffc8e0 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f411eff5640 10 client.15129 handle_command_reply: tid=0 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 client.15129 shutdown 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 -- 172.21.15.47:0/3497219924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8003df60 msgr2=0x558c803fb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8003df60 0x558c803fb6c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f413401ebf0 tx=0x7f4134004ab0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 -- 172.21.15.47:0/3497219924 shutdown_connections 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558c7fffc8e0 0x558c80401d60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8003df60 0x558c803fb6c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8001d280 0x558c803efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 --2- 172.21.15.47:0/3497219924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c800150a0 0x558c803ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 -- 172.21.15.47:0/3497219924 >> 172.21.15.47:0/3497219924 conn(0x558c80032350 msgr2=0x558c803e7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f411eff5640 0 client.15129 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:04.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 -- 172.21.15.47:0/3497219924 shutdown_connections 2024-09-21T00:58:04.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 1 -- 172.21.15.47:0/3497219924 wait complete. 2024-09-21T00:58:04.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.116+0000 7f41476aa740 20 client.15129 trim_cache size 0 max 16384 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f41476aa740 1 Processor -- start 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f41476aa740 1 -- start start 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f41476aa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803eec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f41476aa740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8001d280 0x558c803ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f41476aa740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8003df60 0x558c803efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f41476aa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558c804000a0 con 0x558c800150a0 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f41476aa740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558c80400770 con 0x558c8003df60 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f41476aa740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558c80400e40 con 0x558c8001d280 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.134+0000 7f413ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803eec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48940/0 (socket says 172.21.15.47:48940) 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413ad9d640 1 -- 172.21.15.47:0/2039463021 learned_addr learned my addr 172.21.15.47:0/2039463021 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413a59c640 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8001d280 0x558c803ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413b59e640 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8003df60 0x558c803efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413ad9d640 1 -- 172.21.15.47:0/2039463021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8001d280 msgr2=0x558c803ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413ad9d640 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8001d280 0x558c803ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413ad9d640 1 -- 172.21.15.47:0/2039463021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8003df60 msgr2=0x558c803efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413ad9d640 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8003df60 0x558c803efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413ad9d640 1 -- 172.21.15.47:0/2039463021 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c803f07d0 con 0x558c800150a0 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f413ad9d640 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803eec20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f412c02a9b0 tx=0x7f412c03b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e942c94f9a55a0e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f4120ff9640 1 -- 172.21.15.47:0/2039463021 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0ba380 con 0x558c800150a0 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f4120ff9640 1 -- 172.21.15.47:0/2039463021 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c119070 con 0x558c800150a0 2024-09-21T00:58:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.135+0000 7f4120ff9640 1 -- 172.21.15.47:0/2039463021 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c0b7b20 con 0x558c800150a0 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 -- 172.21.15.47:0/2039463021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 msgr2=0x558c803eec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803eec20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f412c02a9b0 tx=0x7f412c03b460 comp rx=0 tx=0).stop 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 -- 172.21.15.47:0/2039463021 shutdown_connections 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c8003df60 0x558c803efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8001d280 0x558c803ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 --2- 172.21.15.47:0/2039463021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c800150a0 0x558c803eec20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 -- 172.21.15.47:0/2039463021 >> 172.21.15.47:0/2039463021 conn(0x558c80032350 msgr2=0x558c803ea8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 -- 172.21.15.47:0/2039463021 shutdown_connections 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 -- 172.21.15.47:0/2039463021 wait complete. 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.136+0000 7f41476aa740 1 -- start start 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f41476aa740 1 Processor -- start 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f41476aa740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c800150a0 0x558c804030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f41476aa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8001d280 0x558c80403680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f41476aa740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c804086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f41476aa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558c80401be0 con 0x558c8001d280 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f41476aa740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558c80401510 con 0x558c800150a0 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f41476aa740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558c804022b0 con 0x558c8003df60 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f41476aa740 10 client.0 _ll_register_callbacks cb 0x7f4134007950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8001d280 0x558c80403680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8001d280 0x558c80403680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48948/0 (socket says 172.21.15.47:48948) 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413a59c640 1 -- 172.21.15.47:0/3288887529 learned_addr learned my addr 172.21.15.47:0/3288887529 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413ad9d640 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c800150a0 0x558c804030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413b59e640 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c804086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413a59c640 1 -- 172.21.15.47:0/3288887529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 msgr2=0x558c804086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413a59c640 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c804086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413a59c640 1 -- 172.21.15.47:0/3288887529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c800150a0 msgr2=0x558c804030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413a59c640 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c800150a0 0x558c804030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413a59c640 1 -- 172.21.15.47:0/3288887529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c80408d20 con 0x558c8001d280 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.137+0000 7f413b59e640 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c804086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f413a59c640 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8001d280 0x558c80403680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4130011a60 tx=0x7f4130011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebd8cc701d746f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f411eff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f411eff5640 1 -- 172.21.15.47:0/3288887529 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130010be0 con 0x558c8001d280 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f411eff5640 1 -- 172.21.15.47:0/3288887529 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f4130010d80 con 0x558c8001d280 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 1 -- 172.21.15.47:0/3288887529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f412c119070 con 0x558c8001d280 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f411eff5640 1 -- 172.21.15.47:0/3288887529 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4130005020 con 0x558c8001d280 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 10 client.15135 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 1 -- 172.21.15.47:0/3288887529 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558c8040a140 con 0x558c8001d280 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f411eff5640 1 -- 172.21.15.47:0/3288887529 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c119070 con 0x558c8001d280 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f411eff5640 1 -- 172.21.15.47:0/3288887529 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4130025020 con 0x558c8001d280 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 10 client.15135 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:04.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 20 client.15135 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558c7ffd1c90 0x558c8046fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 4 client.15135 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.138+0000 7f41476aa740 1 -- 172.21.15.47:0/3288887529 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "status"}) -- 0x558c80359610 con 0x558c7ffd1c90 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.139+0000 7f413ad9d640 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558c7ffd1c90 0x558c8046fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.139+0000 7f413ad9d640 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558c7ffd1c90 0x558c8046fd80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ebb024b743ca3ae server_cookie=bc7f386316a405ce in_seq=0 out_seq=0 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.139+0000 7f411eff5640 10 client.15135 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.139+0000 7f411eff5640 1 -- 172.21.15.47:0/3288887529 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558c80359610 con 0x558c7ffd1c90 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.139+0000 7f411eff5640 10 client.15135 handle_command_reply: tid=0 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.139+0000 7f41476aa740 1 client.15135 shutdown 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 -- 172.21.15.47:0/3288887529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8001d280 msgr2=0x558c80403680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8001d280 0x558c80403680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4130011a60 tx=0x7f4130011f20 comp rx=0 tx=0).stop 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 -- 172.21.15.47:0/3288887529 shutdown_connections 2024-09-21T00:58:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558c7ffd1c90 0x558c8046fd80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558c8003df60 0x558c804086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558c8001d280 0x558c80403680 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 --2- 172.21.15.47:0/3288887529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558c800150a0 0x558c804030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 -- 172.21.15.47:0/3288887529 >> 172.21.15.47:0/3288887529 conn(0x558c80032350 msgr2=0x558c803ef6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f411eff5640 0 client.15135 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 -- 172.21.15.47:0/3288887529 shutdown_connections 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 1 -- 172.21.15.47:0/3288887529 wait complete. 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f41476aa740 20 client.15135 trim_cache size 0 max 16384 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "1256112e-77b3-11ef-baf5-efdc52797490", 2024-09-21T00:58:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24653, 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 74.492302426999998, 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 19, 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 77, 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 84.730645671999994 2024-09-21T00:58:04.146 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 -- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f41240b65d0 msgr2=0x7f41240b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f41240b65d0 0x7f41240b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4134007f00 tx=0x7f4134007520 comp rx=0 tx=0).stop 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 -- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 msgr2=0x7f413c19c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 0x7f413c19c640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f412c005ab0 tx=0x7f412c003d50 comp rx=0 tx=0).stop 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 -- 172.21.15.47:0/893488273 shutdown_connections 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f41240b65d0 0x7f41240b8ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f413c108cf0 0x7f413c1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c1083a0 0x7f413c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 --2- 172.21.15.47:0/893488273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f413c102a60 0x7f413c19c640 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.140+0000 7f4141136640 1 -- 172.21.15.47:0/893488273 >> 172.21.15.47:0/893488273 conn(0x7f413c079730 msgr2=0x7f413c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.141+0000 7f4141136640 1 -- 172.21.15.47:0/893488273 shutdown_connections 2024-09-21T00:58:04.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:04.141+0000 7f4141136640 1 -- 172.21.15.47:0/893488273 wait complete. 2024-09-21T00:58:04.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:04 smithi134 ceph-mon[34785]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:04.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:04 smithi114 ceph-mon[34309]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:04.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:04 smithi047 ceph-mon[30960]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:04.829 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T00:58:04.829 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:58:04.846 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-09-21T00:58:04.846 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T00:58:05.105 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:05.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 -- 172.21.15.47:0/884979470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5006b980 msgr2=0x7fbb50106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:05.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 --2- 172.21.15.47:0/884979470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5006b980 0x7fbb50106390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009900 tx=0x7fbb4802a410 comp rx=0 tx=0).stop 2024-09-21T00:58:05.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 -- 172.21.15.47:0/884979470 shutdown_connections 2024-09-21T00:58:05.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 --2- 172.21.15.47:0/884979470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb50109470 0x7fbb5010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 --2- 172.21.15.47:0/884979470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb501068d0 0x7fbb50108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 --2- 172.21.15.47:0/884979470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5006b980 0x7fbb50106390 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 -- 172.21.15.47:0/884979470 >> 172.21.15.47:0/884979470 conn(0x7fbb500fdfb0 msgr2=0x7fbb50100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:05.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 -- 172.21.15.47:0/884979470 shutdown_connections 2024-09-21T00:58:05.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.581+0000 7fbb55a53640 1 -- 172.21.15.47:0/884979470 wait complete. 2024-09-21T00:58:05.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb55a53640 1 Processor -- start 2024-09-21T00:58:05.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb55a53640 1 -- start start 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb55a53640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5006b980 0x7fbb501039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb55a53640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb501068d0 0x7fbb50102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb55a53640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb50109470 0x7fbb501027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb55a53640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5010f380 con 0x7fbb501068d0 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb55a53640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5010f200 con 0x7fbb50109470 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb55a53640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5010f500 con 0x7fbb5006b980 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb4e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb501068d0 0x7fbb50102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb4e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb501068d0 0x7fbb50102290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48976/0 (socket says 172.21.15.47:48976) 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb4e7fc640 1 -- 172.21.15.47:0/1594443379 learned_addr learned my addr 172.21.15.47:0/1594443379 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb4effd640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5006b980 0x7fbb501039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.582+0000 7fbb4f7fe640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb50109470 0x7fbb501027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb4e7fc640 1 -- 172.21.15.47:0/1594443379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5006b980 msgr2=0x7fbb501039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb4e7fc640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5006b980 0x7fbb501039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb4e7fc640 1 -- 172.21.15.47:0/1594443379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb50109470 msgr2=0x7fbb501027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb4e7fc640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb50109470 0x7fbb501027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb4e7fc640 1 -- 172.21.15.47:0/1594443379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb50102e40 con 0x7fbb501068d0 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb4f7fe640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb50109470 0x7fbb501027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb4e7fc640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb501068d0 0x7fbb50102290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c920 tx=0x7fbb3800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb54a51640 1 -- 172.21.15.47:0/1594443379 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38007c70 con 0x7fbb501068d0 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb54a51640 1 -- 172.21.15.47:0/1594443379 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb38007e10 con 0x7fbb501068d0 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb54a51640 1 -- 172.21.15.47:0/1594443379 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38018820 con 0x7fbb501068d0 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb501a4000 con 0x7fbb501068d0 2024-09-21T00:58:05.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.583+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb501a43f0 con 0x7fbb501068d0 2024-09-21T00:58:05.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.584+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb500ffad0 con 0x7fbb501068d0 2024-09-21T00:58:05.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.586+0000 7fbb54a51640 1 -- 172.21.15.47:0/1594443379 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fbb3800f450 con 0x7fbb501068d0 2024-09-21T00:58:05.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.587+0000 7fbb54a51640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb3c0b65a0 0x7fbb3c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:05.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.587+0000 7fbb4effd640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb3c0b65a0 0x7fbb3c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:05.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.587+0000 7fbb54a51640 1 -- 172.21.15.47:0/1594443379 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbb380e7620 con 0x7fbb501068d0 2024-09-21T00:58:05.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.587+0000 7fbb4effd640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb3c0b65a0 0x7fbb3c0b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbb48000c00 tx=0x7fbb48031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:05.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.591+0000 7fbb54a51640 1 -- 172.21.15.47:0/1594443379 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb38014030 con 0x7fbb501068d0 2024-09-21T00:58:05.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.797+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fbb50063800 con 0x7fbb3c0b65a0 2024-09-21T00:58:05.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.798+0000 7fbb54a51640 1 -- 172.21.15.47:0/1594443379 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fbb50063800 con 0x7fbb3c0b65a0 2024-09-21T00:58:05.799 INFO:teuthology.orchestra.run.smithi047.stdout:Backend: cephadm 2024-09-21T00:58:05.799 INFO:teuthology.orchestra.run.smithi047.stdout:Available: Yes 2024-09-21T00:58:05.800 INFO:teuthology.orchestra.run.smithi047.stdout:Paused: No 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb3c0b65a0 msgr2=0x7fbb3c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb3c0b65a0 0x7fbb3c0b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbb48000c00 tx=0x7fbb48031400 comp rx=0 tx=0).stop 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb501068d0 msgr2=0x7fbb50102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb501068d0 0x7fbb50102290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c920 tx=0x7fbb3800cde0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 shutdown_connections 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbb3c0b65a0 0x7fbb3c0b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb50109470 0x7fbb501027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb501068d0 0x7fbb50102290 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 --2- 172.21.15.47:0/1594443379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5006b980 0x7fbb501039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 >> 172.21.15.47:0/1594443379 conn(0x7fbb500fdfb0 msgr2=0x7fbb50104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 shutdown_connections 2024-09-21T00:58:05.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:05.801+0000 7fbb55a53640 1 -- 172.21.15.47:0/1594443379 wait complete. 2024-09-21T00:58:06.459 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T00:58:06.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:06 smithi134 ceph-mon[34785]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:06.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:06 smithi134 ceph-mon[34785]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:06.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:06 smithi114 ceph-mon[34309]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:06.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:06 smithi114 ceph-mon[34309]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:06.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:06 smithi047 ceph-mon[30960]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:06.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:06 smithi047 ceph-mon[30960]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:06.723 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:07.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 -- 172.21.15.47:0/2228916880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 msgr2=0x7feeb8103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:07.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 --2- 172.21.15.47:0/2228916880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 0x7feeb8103be0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009900 tx=0x7feeb402a480 comp rx=0 tx=0).stop 2024-09-21T00:58:07.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 -- 172.21.15.47:0/2228916880 shutdown_connections 2024-09-21T00:58:07.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 --2- 172.21.15.47:0/2228916880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb81051a0 0x7feeb810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 --2- 172.21.15.47:0/2228916880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb8104800 0x7feeb8104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 --2- 172.21.15.47:0/2228916880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 0x7feeb8103be0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 -- 172.21.15.47:0/2228916880 >> 172.21.15.47:0/2228916880 conn(0x7feeb80ff0c0 msgr2=0x7feeb8101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:07.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 -- 172.21.15.47:0/2228916880 shutdown_connections 2024-09-21T00:58:07.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.211+0000 7feebfe14640 1 -- 172.21.15.47:0/2228916880 wait complete. 2024-09-21T00:58:07.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebfe14640 1 Processor -- start 2024-09-21T00:58:07.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebfe14640 1 -- start start 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebfe14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 0x7feeb8076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebfe14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb8104800 0x7feeb8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebfe14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb81051a0 0x7feeb8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebfe14640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feeb810f430 con 0x7feeb8103770 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebfe14640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feeb810f2b0 con 0x7feeb8104800 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebfe14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feeb810f5b0 con 0x7feeb81051a0 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebdbb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 0x7feeb8076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebdbb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 0x7feeb8076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48998/0 (socket says 172.21.15.47:48998) 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.212+0000 7feebdbb0640 1 -- 172.21.15.47:0/650922292 learned_addr learned my addr 172.21.15.47:0/650922292 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebe3b1640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb81051a0 0x7feeb8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebd3af640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb8104800 0x7feeb8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebdbb0640 1 -- 172.21.15.47:0/650922292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb81051a0 msgr2=0x7feeb8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebdbb0640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb81051a0 0x7feeb8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebdbb0640 1 -- 172.21.15.47:0/650922292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb8104800 msgr2=0x7feeb8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebdbb0640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb8104800 0x7feeb8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebdbb0640 1 -- 172.21.15.47:0/650922292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb8076350 con 0x7feeb8103770 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebdbb0640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 0x7feeb8076e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feeb4006010 tx=0x7feeb4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feeaeffd640 1 -- 172.21.15.47:0/650922292 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb403f030 con 0x7feeb8103770 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feeaeffd640 1 -- 172.21.15.47:0/650922292 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeb4003cb0 con 0x7feeb8103770 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb81a4080 con 0x7feeb8103770 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feeaeffd640 1 -- 172.21.15.47:0/650922292 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4035070 con 0x7feeb8103770 2024-09-21T00:58:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.213+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb81a44a0 con 0x7feeb8103770 2024-09-21T00:58:07.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.214+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb810a950 con 0x7feeb8103770 2024-09-21T00:58:07.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.216+0000 7feeaeffd640 1 -- 172.21.15.47:0/650922292 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7feeb4042030 con 0x7feeb8103770 2024-09-21T00:58:07.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.217+0000 7feeaeffd640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feea40b65a0 0x7feea40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:07.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.217+0000 7feebd3af640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feea40b65a0 0x7feea40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:07.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.217+0000 7feeaeffd640 1 -- 172.21.15.47:0/650922292 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7feeb41082f0 con 0x7feeb8103770 2024-09-21T00:58:07.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.217+0000 7feebd3af640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feea40b65a0 0x7feea40b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feea8009890 tx=0x7feea8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:07.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.220+0000 7feeaeffd640 1 -- 172.21.15.47:0/650922292 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feeb40cea20 con 0x7feeb8103770 2024-09-21T00:58:07.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.418+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7feeb8063800 con 0x7feea40b65a0 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.430+0000 7feeaeffd640 1 -- 172.21.15.47:0/650922292 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7feeb8063800 con 0x7feea40b65a0 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stdout:mds.a smithi047 running (91s) 14s ago 90s 83.2M - 19.3.0-5120-g18432218 ddce307e1f32 2ed37a86bd1b 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stdout:mds.b smithi114 running (88s) 21s ago 87s 93.9M - 19.3.0-5120-g18432218 ddce307e1f32 51291ae2298c 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stdout:mds.c smithi134 running (102s) 21s ago 101s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 04bbdf9ee27f 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stdout:mds.d smithi047 running (109s) 14s ago 109s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 c48ba9d4ee18 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stdout:mds.e smithi114 running (107s) 21s ago 106s 82.4M - 19.3.0-5120-g18432218 ddce307e1f32 a65e57a02ed4 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stdout:mds.f smithi134 running (104s) 21s ago 104s 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 ac84252df888 2024-09-21T00:58:07.431 INFO:teuthology.orchestra.run.smithi047.stdout:mds.g smithi047 running (94s) 14s ago 93s 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 bba7e9b5d4a5 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mds.h smithi114 running (99s) 21s ago 99s 83.2M - 19.3.0-5120-g18432218 ddce307e1f32 f95e835f9f1a 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mds.i smithi134 running (97s) 21s ago 96s 85.4M - 19.3.0-5120-g18432218 ddce307e1f32 1f2f9abe9574 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mds.j smithi047 running (112s) 14s ago 112s 83.8M - 19.3.0-5120-g18432218 ddce307e1f32 89d58e110204 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mds.k smithi114 running (116s) 21s ago 115s 82.3M - 19.3.0-5120-g18432218 ddce307e1f32 446099b5f6b6 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mds.l smithi134 running (118s) 21s ago 118s 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 f760e2e48020 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.x smithi047 *:9283,8765 running (9m) 14s ago 9m 591M - 19.3.0-5120-g18432218 ddce307e1f32 ad3984ea913e 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.y smithi114 *:8443,8765 running (7m) 21s ago 7m 523M - 19.3.0-5120-g18432218 ddce307e1f32 99048e0d70dc 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mgr.z smithi134 *:8443,8765 running (7m) 21s ago 7m 523M - 19.3.0-5120-g18432218 ddce307e1f32 b036b3909eaa 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mon.a smithi047 running (9m) 14s ago 9m 121M 2048M 19.3.0-5120-g18432218 ddce307e1f32 8538b21c152b 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mon.b smithi114 running (7m) 21s ago 7m 108M 2048M 19.3.0-5120-g18432218 ddce307e1f32 0753b23967ed 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:mon.c smithi134 running (8m) 21s ago 8m 108M 2048M 19.3.0-5120-g18432218 ddce307e1f32 12b713ce9ec3 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 smithi047 running (6m) 14s ago 6m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 d14b418a0905 2024-09-21T00:58:07.432 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 smithi114 running (6m) 21s ago 6m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 114157088f9f 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 smithi134 running (6m) 21s ago 6m 127M 4272M 19.3.0-5120-g18432218 ddce307e1f32 84d4db730545 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 smithi047 running (5m) 14s ago 5m 113M 4273M 19.3.0-5120-g18432218 ddce307e1f32 48422cd398c7 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 smithi114 running (5m) 21s ago 5m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1c428ab52f52 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 smithi134 running (4m) 21s ago 4m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1961fc9720a7 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.6 smithi047 running (4m) 14s ago 4m 119M 4273M 19.3.0-5120-g18432218 ddce307e1f32 0c0e28ba6cb6 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.7 smithi114 running (3m) 21s ago 3m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 5acf10fa1082 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.8 smithi134 running (3m) 21s ago 3m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 bbe6e7a9393a 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.9 smithi047 running (3m) 14s ago 3m 116M 4273M 19.3.0-5120-g18432218 ddce307e1f32 bc50b9e46310 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.10 smithi114 running (2m) 21s ago 2m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 795f56cf1210 2024-09-21T00:58:07.433 INFO:teuthology.orchestra.run.smithi047.stdout:osd.11 smithi134 running (2m) 21s ago 2m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1e6011c03211 2024-09-21T00:58:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feea40b65a0 msgr2=0x7feea40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feea40b65a0 0x7feea40b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feea8009890 tx=0x7feea8008040 comp rx=0 tx=0).stop 2024-09-21T00:58:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 msgr2=0x7feeb8076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 0x7feeb8076e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feeb4006010 tx=0x7feeb4004340 comp rx=0 tx=0).stop 2024-09-21T00:58:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 shutdown_connections 2024-09-21T00:58:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feea40b65a0 0x7feea40b8ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb81051a0 0x7feeb8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb8104800 0x7feeb8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 --2- 172.21.15.47:0/650922292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feeb8103770 0x7feeb8076e40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.432+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 >> 172.21.15.47:0/650922292 conn(0x7feeb80ff0c0 msgr2=0x7feeb8107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.433+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 shutdown_connections 2024-09-21T00:58:07.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:07.433+0000 7feebfe14640 1 -- 172.21.15.47:0/650922292 wait complete. 2024-09-21T00:58:08.242 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T00:58:08.506 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:08.628 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:08 smithi047 ceph-mon[30960]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:08.628 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:08 smithi047 ceph-mon[30960]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:08.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:08 smithi114 ceph-mon[34309]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:08.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:08 smithi114 ceph-mon[34309]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:08.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:08 smithi134 ceph-mon[34785]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:08.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:08 smithi134 ceph-mon[34785]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 -- 172.21.15.47:0/2329088448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 msgr2=0x7f2470103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 --2- 172.21.15.47:0/2329088448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 0x7f2470103af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2464009900 tx=0x7f246402a480 comp rx=0 tx=0).stop 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 -- 172.21.15.47:0/2329088448 shutdown_connections 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 --2- 172.21.15.47:0/2329088448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2470104080 0x7f247010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 --2- 172.21.15.47:0/2329088448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 0x7f2470103af0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 --2- 172.21.15.47:0/2329088448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2470102650 0x7f2470102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 -- 172.21.15.47:0/2329088448 >> 172.21.15.47:0/2329088448 conn(0x7f24700fdfa0 msgr2=0x7f2470100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 -- 172.21.15.47:0/2329088448 shutdown_connections 2024-09-21T00:58:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.019+0000 7f24772a5640 1 -- 172.21.15.47:0/2329088448 wait complete. 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f24772a5640 1 Processor -- start 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f24772a5640 1 -- start start 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f24772a5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2470102650 0x7f2470199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f24772a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 0x7f247019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f24772a5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2470104080 0x7f247019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f24772a5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f247010e2a0 con 0x7f24701036e0 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f24772a5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f247010e120 con 0x7f2470102650 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f24772a5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f247010e420 con 0x7f2470104080 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2474840640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 0x7f247019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2474840640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 0x7f247019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49020/0 (socket says 172.21.15.47:49020) 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2474840640 1 -- 172.21.15.47:0/1370390841 learned_addr learned my addr 172.21.15.47:0/1370390841 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2475842640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2470104080 0x7f247019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2475041640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2470102650 0x7f2470199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:09.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2474840640 1 -- 172.21.15.47:0/1370390841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2470104080 msgr2=0x7f247019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2474840640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2470104080 0x7f247019b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2474840640 1 -- 172.21.15.47:0/1370390841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2470102650 msgr2=0x7f2470199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2474840640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2470102650 0x7f2470199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.020+0000 7f2474840640 1 -- 172.21.15.47:0/1370390841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247019b9f0 con 0x7f24701036e0 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.021+0000 7f2475041640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2470102650 0x7f2470199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.021+0000 7f2474840640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 0x7f247019a630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2464006010 tx=0x7f2464004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.021+0000 7f246e7fc640 1 -- 172.21.15.47:0/1370390841 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246403f030 con 0x7f24701036e0 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.021+0000 7f246e7fc640 1 -- 172.21.15.47:0/1370390841 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2464003cb0 con 0x7f24701036e0 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.021+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247019bc80 con 0x7f24701036e0 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.021+0000 7f246e7fc640 1 -- 172.21.15.47:0/1370390841 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464035070 con 0x7f24701036e0 2024-09-21T00:58:09.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.021+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24701a2210 con 0x7f24701036e0 2024-09-21T00:58:09.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.022+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24701a2530 con 0x7f24701036e0 2024-09-21T00:58:09.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.024+0000 7f246e7fc640 1 -- 172.21.15.47:0/1370390841 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2464042030 con 0x7f24701036e0 2024-09-21T00:58:09.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.024+0000 7f246e7fc640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24580b65a0 0x7f24580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:09.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.024+0000 7f2475041640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24580b65a0 0x7f24580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:09.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.025+0000 7f246e7fc640 1 -- 172.21.15.47:0/1370390841 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f24641080f0 con 0x7f24701036e0 2024-09-21T00:58:09.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.025+0000 7f2475041640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24580b65a0 0x7f24580b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f24680058c0 tx=0x7f2468005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:09.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.028+0000 7f246e7fc640 1 -- 172.21.15.47:0/1370390841 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24640ce920 con 0x7f24701036e0 2024-09-21T00:58:09.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.227+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f24700fffb0 con 0x7f24580b65a0 2024-09-21T00:58:09.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.233+0000 7f246e7fc640 1 -- 172.21.15.47:0/1370390841 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f24700fffb0 con 0x7f24580b65a0 2024-09-21T00:58:09.234 INFO:teuthology.orchestra.run.smithi047.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T00:58:09.234 INFO:teuthology.orchestra.run.smithi047.stdout:mds.all 12/12 23s ago 2m smithi047=a;smithi047=d;smithi047=g;smithi047=j;smithi114=b;smithi114=e;smithi114=h;smithi114=k;smithi134=c;smithi134=f;smithi134=i;smithi134=l;count:12 2024-09-21T00:58:09.234 INFO:teuthology.orchestra.run.smithi047.stdout:mgr 3/3 23s ago 7m smithi047=x;smithi114=y;smithi134=z;count:3 2024-09-21T00:58:09.234 INFO:teuthology.orchestra.run.smithi047.stdout:mon 3/3 23s ago 8m smithi047:172.21.15.47=a;smithi114:172.21.15.114=b;smithi134:172.21.15.134=c;count:3 2024-09-21T00:58:09.234 INFO:teuthology.orchestra.run.smithi047.stdout:osd 12 23s ago - 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24580b65a0 msgr2=0x7f24580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24580b65a0 0x7f24580b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f24680058c0 tx=0x7f2468005ec0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 msgr2=0x7f247019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 0x7f247019a630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2464006010 tx=0x7f2464004340 comp rx=0 tx=0).stop 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 shutdown_connections 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24580b65a0 0x7f24580b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2470104080 0x7f247019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24701036e0 0x7f247019a630 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 --2- 172.21.15.47:0/1370390841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2470102650 0x7f2470199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:09.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 >> 172.21.15.47:0/1370390841 conn(0x7f24700fdfa0 msgr2=0x7f24700ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:09.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 shutdown_connections 2024-09-21T00:58:09.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:09.235+0000 7f24772a5640 1 -- 172.21.15.47:0/1370390841 wait complete. 2024-09-21T00:58:09.962 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T00:58:10.225 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:10.602 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:10 smithi047 ceph-mon[30960]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:10.602 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:10 smithi047 ceph-mon[30960]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:10.646 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:10 smithi134 ceph-mon[34785]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:10.646 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:10 smithi134 ceph-mon[34785]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:10.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:10 smithi114 ceph-mon[34309]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:10.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:10 smithi114 ceph-mon[34309]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:10.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 -- 172.21.15.47:0/4108121776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 msgr2=0x7fc98010db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 --2- 172.21.15.47:0/4108121776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 0x7fc98010db90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc978009ca0 tx=0x7fc97802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 -- 172.21.15.47:0/4108121776 shutdown_connections 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 --2- 172.21.15.47:0/4108121776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 0x7fc98010db90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 --2- 172.21.15.47:0/4108121776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980108cd0 0x7fc98010b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 --2- 172.21.15.47:0/4108121776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98006b7b0 0x7fc980108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 -- 172.21.15.47:0/4108121776 >> 172.21.15.47:0/4108121776 conn(0x7fc9800fdfb0 msgr2=0x7fc980100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 -- 172.21.15.47:0/4108121776 shutdown_connections 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.696+0000 7fc987cac640 1 -- 172.21.15.47:0/4108121776 wait complete. 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc987cac640 1 Processor -- start 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc987cac640 1 -- start start 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc987cac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98006b7b0 0x7fc98019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc987cac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980108cd0 0x7fc98019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc987cac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 0x7fc98019d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc987cac640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc980111570 con 0x7fc98010b680 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc987cac640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9801113f0 con 0x7fc980108cd0 2024-09-21T00:58:10.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc987cac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9801116f0 con 0x7fc98006b7b0 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc986249640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 0x7fc98019d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc986249640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 0x7fc98019d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49036/0 (socket says 172.21.15.47:49036) 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc986249640 1 -- 172.21.15.47:0/4161686338 learned_addr learned my addr 172.21.15.47:0/4161686338 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc985a48640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98006b7b0 0x7fc98019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc985247640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980108cd0 0x7fc98019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc986249640 1 -- 172.21.15.47:0/4161686338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98006b7b0 msgr2=0x7fc98019c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc986249640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98006b7b0 0x7fc98019c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc986249640 1 -- 172.21.15.47:0/4161686338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980108cd0 msgr2=0x7fc98019c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc986249640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980108cd0 0x7fc98019c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc986249640 1 -- 172.21.15.47:0/4161686338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98019db10 con 0x7fc98010b680 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.697+0000 7fc985247640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980108cd0 0x7fc98019c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.698+0000 7fc986249640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 0x7fc98019d2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc9780097b0 tx=0x7fc978003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.698+0000 7fc976ffd640 1 -- 172.21.15.47:0/4161686338 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978004240 con 0x7fc98010b680 2024-09-21T00:58:10.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.698+0000 7fc976ffd640 1 -- 172.21.15.47:0/4161686338 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc97802f380 con 0x7fc98010b680 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.698+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98019dda0 con 0x7fc98010b680 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.698+0000 7fc976ffd640 1 -- 172.21.15.47:0/4161686338 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97802fc30 con 0x7fc98010b680 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.698+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9801a4500 con 0x7fc98010b680 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.699+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9800ffad0 con 0x7fc98010b680 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.700+0000 7fc976ffd640 1 -- 172.21.15.47:0/4161686338 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fc9780043e0 con 0x7fc98010b680 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.701+0000 7fc976ffd640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc96c0b6620 0x7fc96c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.701+0000 7fc985a48640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc96c0b6620 0x7fc96c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.701+0000 7fc976ffd640 1 -- 172.21.15.47:0/4161686338 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fc9781089d0 con 0x7fc98010b680 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.702+0000 7fc985a48640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc96c0b6620 0x7fc96c0b8b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00bbe0 tx=0x7fc97c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.704+0000 7fc976ffd640 1 -- 172.21.15.47:0/4161686338 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9780cf200 con 0x7fc98010b680 2024-09-21T00:58:10.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.896+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fc980063800 con 0x7fc96c0b6620 2024-09-21T00:58:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.898+0000 7fc976ffd640 1 -- 172.21.15.47:0/4161686338 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fc980063800 con 0x7fc96c0b6620 2024-09-21T00:58:10.899 INFO:teuthology.orchestra.run.smithi047.stdout:HOST ADDR LABELS STATUS 2024-09-21T00:58:10.899 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 172.21.15.47 2024-09-21T00:58:10.899 INFO:teuthology.orchestra.run.smithi047.stdout:smithi114 172.21.15.114 2024-09-21T00:58:10.899 INFO:teuthology.orchestra.run.smithi047.stdout:smithi134 172.21.15.134 2024-09-21T00:58:10.899 INFO:teuthology.orchestra.run.smithi047.stdout:3 hosts in cluster 2024-09-21T00:58:10.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc96c0b6620 msgr2=0x7fc96c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc96c0b6620 0x7fc96c0b8b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00bbe0 tx=0x7fc97c00b390 comp rx=0 tx=0).stop 2024-09-21T00:58:10.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 msgr2=0x7fc98019d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 0x7fc98019d2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc9780097b0 tx=0x7fc978003c20 comp rx=0 tx=0).stop 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 shutdown_connections 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc96c0b6620 0x7fc96c0b8b30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc98010b680 0x7fc98019d2f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980108cd0 0x7fc98019c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 --2- 172.21.15.47:0/4161686338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98006b7b0 0x7fc98019c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.900+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 >> 172.21.15.47:0/4161686338 conn(0x7fc9800fdfb0 msgr2=0x7fc980109aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.901+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 shutdown_connections 2024-09-21T00:58:10.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:10.901+0000 7fc987cac640 1 -- 172.21.15.47:0/4161686338 wait complete. 2024-09-21T00:58:11.554 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T00:58:11.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:11 smithi114 ceph-mon[34309]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:11.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:11 smithi047 ceph-mon[30960]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:11.818 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:11.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:11 smithi134 ceph-mon[34785]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:12.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.319+0000 7f4f4a13a640 1 -- 172.21.15.47:0/3479303409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 msgr2=0x7f4f44103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.319+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/3479303409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 0x7f4f44103ae0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009900 tx=0x7f4f3402a480 comp rx=0 tx=0).stop 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.319+0000 7f4f4a13a640 1 -- 172.21.15.47:0/3479303409 shutdown_connections 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.319+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/3479303409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f44104070 0x7f4f4410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.319+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/3479303409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 0x7f4f44103ae0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.319+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/3479303409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f44102640 0x7f4f44102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.319+0000 7f4f4a13a640 1 -- 172.21.15.47:0/3479303409 >> 172.21.15.47:0/3479303409 conn(0x7f4f440fdfb0 msgr2=0x7f4f44100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.320+0000 7f4f4a13a640 1 -- 172.21.15.47:0/3479303409 shutdown_connections 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.320+0000 7f4f4a13a640 1 -- 172.21.15.47:0/3479303409 wait complete. 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.320+0000 7f4f4a13a640 1 Processor -- start 2024-09-21T00:58:12.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.320+0000 7f4f4a13a640 1 -- start start 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f4a13a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f44102640 0x7f4f44198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f4a13a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 0x7f4f441994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f4a13a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f44104070 0x7f4f4419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f4a13a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4410e270 con 0x7f4f441036d0 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f4a13a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4410e0f0 con 0x7f4f44102640 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f4a13a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4410e3f0 con 0x7f4f44104070 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 0x7f4f441994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 0x7f4f441994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37024/0 (socket says 172.21.15.47:37024) 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 -- 172.21.15.47:0/2276469956 learned_addr learned my addr 172.21.15.47:0/2276469956 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f43fff640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f44104070 0x7f4f4419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f437fe640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f44102640 0x7f4f44198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 -- 172.21.15.47:0/2276469956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f44104070 msgr2=0x7f4f4419a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:12.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f44104070 0x7f4f4419a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 -- 172.21.15.47:0/2276469956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f44102640 msgr2=0x7f4f44198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f44102640 0x7f4f44198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 -- 172.21.15.47:0/2276469956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4419a7d0 con 0x7f4f441036d0 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.321+0000 7f4f42ffd640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 0x7f4f441994a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4f34006010 tx=0x7f4f340043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.322+0000 7f4f40ff9640 1 -- 172.21.15.47:0/2276469956 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3403f030 con 0x7f4f441036d0 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.322+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4419aa60 con 0x7f4f441036d0 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.322+0000 7f4f40ff9640 1 -- 172.21.15.47:0/2276469956 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f34003cb0 con 0x7f4f441036d0 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.322+0000 7f4f40ff9640 1 -- 172.21.15.47:0/2276469956 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34035070 con 0x7f4f441036d0 2024-09-21T00:58:12.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.322+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f441a1080 con 0x7f4f441036d0 2024-09-21T00:58:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.323+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f44109820 con 0x7f4f441036d0 2024-09-21T00:58:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.324+0000 7f4f40ff9640 1 -- 172.21.15.47:0/2276469956 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f4f34042030 con 0x7f4f441036d0 2024-09-21T00:58:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.325+0000 7f4f40ff9640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f300b65a0 0x7f4f300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.326+0000 7f4f437fe640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f300b65a0 0x7f4f300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.326+0000 7f4f40ff9640 1 -- 172.21.15.47:0/2276469956 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f4f341082a0 con 0x7f4f441036d0 2024-09-21T00:58:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.326+0000 7f4f437fe640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f300b65a0 0x7f4f300b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c005e10 tx=0x7f4f2c005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.329+0000 7f4f40ff9640 1 -- 172.21.15.47:0/2276469956 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f340cea50 con 0x7f4f441036d0 2024-09-21T00:58:12.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.526+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4f44063800 con 0x7f4f300b65a0 2024-09-21T00:58:12.527 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:12 smithi047 ceph-mon[30960]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:12.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.528+0000 7f4f40ff9640 1 -- 172.21.15.47:0/2276469956 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f4f44063800 con 0x7f4f300b65a0 2024-09-21T00:58:12.529 INFO:teuthology.orchestra.run.smithi047.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T00:58:12.529 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130022480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T00:58:12.529 INFO:teuthology.orchestra.run.smithi047.stdout:smithi114 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WB400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T00:58:12.529 INFO:teuthology.orchestra.run.smithi047.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T00:58:12.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f300b65a0 msgr2=0x7f4f300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:12.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f300b65a0 0x7f4f300b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c005e10 tx=0x7f4f2c005da0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 msgr2=0x7f4f441994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:12.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 0x7f4f441994a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4f34006010 tx=0x7f4f340043b0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 shutdown_connections 2024-09-21T00:58:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4f300b65a0 0x7f4f300b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f44104070 0x7f4f4419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f441036d0 0x7f4f441994a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 --2- 172.21.15.47:0/2276469956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f44102640 0x7f4f44198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.530+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 >> 172.21.15.47:0/2276469956 conn(0x7f4f440fdfb0 msgr2=0x7f4f441069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.531+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 shutdown_connections 2024-09-21T00:58:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:12.531+0000 7f4f4a13a640 1 -- 172.21.15.47:0/2276469956 wait complete. 2024-09-21T00:58:12.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:12 smithi114 ceph-mon[34309]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:12.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:12 smithi134 ceph-mon[34785]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:13.235 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T00:58:13.245 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-09-21T00:58:13.245 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T00:58:13.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:13 smithi047 ceph-mon[30960]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:13.508 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:13.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:13 smithi114 ceph-mon[34309]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:13.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:13 smithi134 ceph-mon[34785]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T00:58:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 -- 172.21.15.47:0/4095195850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 msgr2=0x7f839810b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 --2- 172.21.15.47:0/4095195850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 0x7f839810b9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8390009900 tx=0x7f839002a410 comp rx=0 tx=0).stop 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 -- 172.21.15.47:0/4095195850 shutdown_connections 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 --2- 172.21.15.47:0/4095195850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 0x7f839810b9c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 --2- 172.21.15.47:0/4095195850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8398106be0 0x7f8398109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 --2- 172.21.15.47:0/4095195850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8398101b40 0x7f8398101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 -- 172.21.15.47:0/4095195850 >> 172.21.15.47:0/4095195850 conn(0x7f83980fd770 msgr2=0x7f83980ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 -- 172.21.15.47:0/4095195850 shutdown_connections 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 -- 172.21.15.47:0/4095195850 wait complete. 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.950+0000 7f839d759640 1 Processor -- start 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f839d759640 1 -- start start 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f839d759640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8398101b40 0x7f8398104210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f839d759640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8398106be0 0x7f8398102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f839d759640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 0x7f8398103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f839d759640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f839810f420 con 0x7f8398109540 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f839d759640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f839810f2a0 con 0x7f8398101b40 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f839d759640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f839810f5a0 con 0x7f8398106be0 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f83977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 0x7f8398103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f83977fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 0x7f8398103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37040/0 (socket says 172.21.15.47:37040) 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f83977fe640 1 -- 172.21.15.47:0/766508066 learned_addr learned my addr 172.21.15.47:0/766508066 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.951+0000 7f83967fc640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8398106be0 0x7f8398102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f8396ffd640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8398101b40 0x7f8398104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f83977fe640 1 -- 172.21.15.47:0/766508066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8398106be0 msgr2=0x7f8398102ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f83977fe640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8398106be0 0x7f8398102ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f83977fe640 1 -- 172.21.15.47:0/766508066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8398101b40 msgr2=0x7f8398104210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f83977fe640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8398101b40 0x7f8398104210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:13.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f83977fe640 1 -- 172.21.15.47:0/766508066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8398103720 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f83977fe640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 0x7f8398103020 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8390005ab0 tx=0x7f8390004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f837ffff640 1 -- 172.21.15.47:0/766508066 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839003f030 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83981a4050 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f837ffff640 1 -- 172.21.15.47:0/766508066 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8390003cb0 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f837ffff640 1 -- 172.21.15.47:0/766508066 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390035070 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.952+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83981a4470 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.953+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8398101f50 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.955+0000 7f837ffff640 1 -- 172.21.15.47:0/766508066 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8390042030 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.955+0000 7f837ffff640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f83800b65a0 0x7f83800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.955+0000 7f8396ffd640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f83800b65a0 0x7f83800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.955+0000 7f837ffff640 1 -- 172.21.15.47:0/766508066 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8390107e60 con 0x7f8398109540 2024-09-21T00:58:13.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.956+0000 7f8396ffd640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f83800b65a0 0x7f83800b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8388005c40 tx=0x7f8388008230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:13.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:13.960+0000 7f837ffff640 1 -- 172.21.15.47:0/766508066 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83900ce690 con 0x7f8398109540 2024-09-21T00:58:14.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.187+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f83980ff290 con 0x7f8398109540 2024-09-21T00:58:14.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.187+0000 7f837ffff640 1 -- 172.21.15.47:0/766508066 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+3048 (secure 0 0 0) 0x7f83900d2a70 con 0x7f8398109540 2024-09-21T00:58:14.189 INFO:teuthology.orchestra.run.smithi047.stdout:e19 2024-09-21T00:58:14.189 INFO:teuthology.orchestra.run.smithi047.stdout:btime 2024-09-21T00:56:58:679975+0000 2024-09-21T00:58:14.189 INFO:teuthology.orchestra.run.smithi047.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T00:58:14.189 INFO:teuthology.orchestra.run.smithi047.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:58:14.189 INFO:teuthology.orchestra.run.smithi047.stdout:legacy client fscid: 1 2024-09-21T00:58:14.189 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:14.190 INFO:teuthology.orchestra.run.smithi047.stdout:Filesystem 'cephfs' (1) 2024-09-21T00:58:14.190 INFO:teuthology.orchestra.run.smithi047.stdout:fs_name cephfs 2024-09-21T00:58:14.190 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 19 2024-09-21T00:58:14.190 INFO:teuthology.orchestra.run.smithi047.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T00:58:14.190 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-09-21T00:56:49.241985+0000 2024-09-21T00:58:14.190 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-09-21T00:56:58.284880+0000 2024-09-21T00:58:14.190 INFO:teuthology.orchestra.run.smithi047.stdout:tableserver 0 2024-09-21T00:58:14.191 INFO:teuthology.orchestra.run.smithi047.stdout:root 0 2024-09-21T00:58:14.191 INFO:teuthology.orchestra.run.smithi047.stdout:session_timeout 300 2024-09-21T00:58:14.191 INFO:teuthology.orchestra.run.smithi047.stdout:session_autoclose 300 2024-09-21T00:58:14.191 INFO:teuthology.orchestra.run.smithi047.stdout:max_file_size 1099511627776 2024-09-21T00:58:14.191 INFO:teuthology.orchestra.run.smithi047.stdout:max_xattr_size 65536 2024-09-21T00:58:14.191 INFO:teuthology.orchestra.run.smithi047.stdout:required_client_features {} 2024-09-21T00:58:14.192 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure 0 2024-09-21T00:58:14.192 INFO:teuthology.orchestra.run.smithi047.stdout:last_failure_osd_epoch 0 2024-09-21T00:58:14.192 INFO:teuthology.orchestra.run.smithi047.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T00:58:14.192 INFO:teuthology.orchestra.run.smithi047.stdout:max_mds 1 2024-09-21T00:58:14.192 INFO:teuthology.orchestra.run.smithi047.stdout:in 0 2024-09-21T00:58:14.192 INFO:teuthology.orchestra.run.smithi047.stdout:up {0=24653} 2024-09-21T00:58:14.193 INFO:teuthology.orchestra.run.smithi047.stdout:failed 2024-09-21T00:58:14.193 INFO:teuthology.orchestra.run.smithi047.stdout:damaged 2024-09-21T00:58:14.193 INFO:teuthology.orchestra.run.smithi047.stdout:stopped 2024-09-21T00:58:14.193 INFO:teuthology.orchestra.run.smithi047.stdout:data_pools [3] 2024-09-21T00:58:14.193 INFO:teuthology.orchestra.run.smithi047.stdout:metadata_pool 2 2024-09-21T00:58:14.193 INFO:teuthology.orchestra.run.smithi047.stdout:inline_data disabled 2024-09-21T00:58:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:balancer 2024-09-21T00:58:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:bal_rank_mask -1 2024-09-21T00:58:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:standby_count_wanted 0 2024-09-21T00:58:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:qdb_cluster leader: 24653 members: 24653 2024-09-21T00:58:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b{0:24653} state up:active seq 4 addr [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.i{0:24637} state up:standby-replay seq 1 addr [v2:172.21.15.134:6838/924032014,v1:172.21.15.134:6839/924032014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.195 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:14.195 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:Standby daemons: 2024-09-21T00:58:14.195 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.j{-1:14697} state up:standby seq 1 addr [v2:172.21.15.47:6834/661733967,v1:172.21.15.47:6835/661733967] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.195 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d{-1:14709} state up:standby seq 1 addr [v2:172.21.15.47:6836/1306058041,v1:172.21.15.47:6837/1306058041] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.g{-1:14763} state up:standby seq 1 addr [v2:172.21.15.47:6838/1305457594,v1:172.21.15.47:6839/1305457594] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a{-1:14769} state up:standby seq 1 addr [v2:172.21.15.47:6840/1666315878,v1:172.21.15.47:6841/1666315878] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.k{-1:24563} state up:standby seq 1 addr [v2:172.21.15.114:6832/1826356330,v1:172.21.15.114:6833/1826356330] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.l{-1:24577} state up:standby seq 1 addr [v2:172.21.15.134:6832/2433850762,v1:172.21.15.134:6833/2433850762] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.e{-1:24590} state up:standby seq 1 addr [v2:172.21.15.114:6834/27443904,v1:172.21.15.114:6835/27443904] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.196 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.f{-1:24610} state up:standby seq 1 addr [v2:172.21.15.134:6834/1078728658,v1:172.21.15.134:6835/1078728658] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.h{-1:24617} state up:standby seq 1 addr [v2:172.21.15.114:6836/2922289361,v1:172.21.15.114:6837/2922289361] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.197 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c{-1:24622} state up:standby seq 1 addr [v2:172.21.15.134:6836/4289116211,v1:172.21.15.134:6837/4289116211] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T00:58:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:58:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f83800b65a0 msgr2=0x7f83800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f83800b65a0 0x7f83800b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8388005c40 tx=0x7f8388008230 comp rx=0 tx=0).stop 2024-09-21T00:58:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 msgr2=0x7f8398103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 0x7f8398103020 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8390005ab0 tx=0x7f8390004360 comp rx=0 tx=0).stop 2024-09-21T00:58:14.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 shutdown_connections 2024-09-21T00:58:14.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f83800b65a0 0x7f83800b8ab0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:14.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8398109540 0x7f8398103020 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:14.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8398106be0 0x7f8398102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:14.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 --2- 172.21.15.47:0/766508066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8398101b40 0x7f8398104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:14.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.189+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 >> 172.21.15.47:0/766508066 conn(0x7f83980fd770 msgr2=0x7f83981079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.190+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 shutdown_connections 2024-09-21T00:58:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:14.190+0000 7f839d759640 1 -- 172.21.15.47:0/766508066 wait complete. 2024-09-21T00:58:14.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:14 smithi114 ceph-mon[34309]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:14.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:14 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/766508066' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:58:14.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:14 smithi047 ceph-mon[30960]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:14.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:14 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/766508066' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:58:14.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:14 smithi134 ceph-mon[34785]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:14.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:14 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/766508066' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T00:58:14.878 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T00:58:15.141 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:15.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 -- 172.21.15.47:0/2602721823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 msgr2=0x7f6ea8106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2602721823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 0x7f6ea8106400 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009900 tx=0x7f6e9802a410 comp rx=0 tx=0).stop 2024-09-21T00:58:15.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 -- 172.21.15.47:0/2602721823 shutdown_connections 2024-09-21T00:58:15.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2602721823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ea8109480 0x7f6ea810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2602721823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ea8106940 0x7f6ea8108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2602721823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 0x7f6ea8106400 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 -- 172.21.15.47:0/2602721823 >> 172.21.15.47:0/2602721823 conn(0x7f6ea80fdfe0 msgr2=0x7f6ea8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 -- 172.21.15.47:0/2602721823 shutdown_connections 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 -- 172.21.15.47:0/2602721823 wait complete. 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.598+0000 7f6eae62b640 1 Processor -- start 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6eae62b640 1 -- start start 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6eae62b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 0x7f6ea819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6eae62b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ea8106940 0x7f6ea819c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6eae62b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ea8109480 0x7f6ea819d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6eae62b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810f3e0 con 0x7f6ea806c600 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6eae62b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810f260 con 0x7f6ea8109480 2024-09-21T00:58:15.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6eae62b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810f560 con 0x7f6ea8106940 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6ea7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 0x7f6ea819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6ea7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 0x7f6ea819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37060/0 (socket says 172.21.15.47:37060) 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6ea7fff640 1 -- 172.21.15.47:0/2926423187 learned_addr learned my addr 172.21.15.47:0/2926423187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6e9ffff640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ea8106940 0x7f6ea819c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6eacbc8640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ea8109480 0x7f6ea819d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6ea7fff640 1 -- 172.21.15.47:0/2926423187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ea8106940 msgr2=0x7f6ea819c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6ea7fff640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ea8106940 0x7f6ea819c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6ea7fff640 1 -- 172.21.15.47:0/2926423187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ea8109480 msgr2=0x7f6ea819d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6ea7fff640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ea8109480 0x7f6ea819d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.599+0000 7f6ea7fff640 1 -- 172.21.15.47:0/2926423187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea819dc60 con 0x7f6ea806c600 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.600+0000 7f6ea7fff640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 0x7f6ea819c230 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6e98006010 tx=0x7f6e98004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.600+0000 7f6ea5ffb640 1 -- 172.21.15.47:0/2926423187 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9803f030 con 0x7f6ea806c600 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.600+0000 7f6ea5ffb640 1 -- 172.21.15.47:0/2926423187 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e98003cb0 con 0x7f6ea806c600 2024-09-21T00:58:15.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.600+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea819def0 con 0x7f6ea806c600 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.600+0000 7f6ea5ffb640 1 -- 172.21.15.47:0/2926423187 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98035070 con 0x7f6ea806c600 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.600+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea81a4650 con 0x7f6ea806c600 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.601+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea810b060 con 0x7f6ea806c600 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.602+0000 7f6ea5ffb640 1 -- 172.21.15.47:0/2926423187 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f6e98042030 con 0x7f6ea806c600 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.603+0000 7f6ea5ffb640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e940b6620 0x7f6e940b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.603+0000 7f6e9ffff640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e940b6620 0x7f6e940b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.603+0000 7f6ea5ffb640 1 -- 172.21.15.47:0/2926423187 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f6e98107fd0 con 0x7f6ea806c600 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.604+0000 7f6e9ffff640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e940b6620 0x7f6e940b8b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009990 tx=0x7f6e90009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:15.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.606+0000 7f6ea5ffb640 1 -- 172.21.15.47:0/2926423187 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e980ce800 con 0x7f6ea806c600 2024-09-21T00:58:15.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.796+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f6ea802e640 con 0x7f6ea806c600 2024-09-21T00:58:15.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.797+0000 7f6ea5ffb640 1 -- 172.21.15.47:0/2926423187 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5233 (secure 0 0 0) 0x7f6e98003e60 con 0x7f6ea806c600 2024-09-21T00:58:15.798 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 77 2024-09-21T00:58:15.798 INFO:teuthology.orchestra.run.smithi047.stdout:fsid 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T00:58:15.798 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-09-21T00:48:36.407074+0000 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:modified 2024-09-21T00:57:26.756741+0000 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:crush_version 26 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:full_ratio 0.95 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:backfillfull_ratio 0.9 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:nearfull_ratio 0.85 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:require_min_compat_client luminous 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:min_compat_client luminous 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:require_osd_release squid 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:stretch_mode_enabled false 2024-09-21T00:58:15.799 INFO:teuthology.orchestra.run.smithi047.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:max_osd 12 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:osd.0 up in weight 1 up_from 8 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6802/629047334,v1:172.21.15.47:6803/629047334] [v2:172.21.15.47:6804/629047334,v1:172.21.15.47:6805/629047334] exists,up de86c79d-f53b-4eab-800e-4d753d91edcb 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:osd.1 up in weight 1 up_from 13 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6800/2077637956,v1:172.21.15.114:6801/2077637956] [v2:172.21.15.114:6802/2077637956,v1:172.21.15.114:6803/2077637956] exists,up fb0a490d-37e6-4813-8581-97797d58186e 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:osd.2 up in weight 1 up_from 18 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/2759710953,v1:172.21.15.134:6801/2759710953] [v2:172.21.15.134:6802/2759710953,v1:172.21.15.134:6803/2759710953] exists,up 8b64b789-55fa-4e4e-bb5d-d853fd5f466c 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:osd.3 up in weight 1 up_from 26 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6810/1095561403,v1:172.21.15.47:6811/1095561403] [v2:172.21.15.47:6812/1095561403,v1:172.21.15.47:6813/1095561403] exists,up 4a93ad02-8a42-41ef-9eb8-6f787f0ae186 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:osd.4 up in weight 1 up_from 31 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6808/3945171658,v1:172.21.15.114:6809/3945171658] [v2:172.21.15.114:6810/3945171658,v1:172.21.15.114:6811/3945171658] exists,up 3fefab4d-27ed-43e7-bc5e-8438c93a827c 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:osd.5 up in weight 1 up_from 36 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/1310952352,v1:172.21.15.134:6809/1310952352] [v2:172.21.15.134:6810/1310952352,v1:172.21.15.134:6811/1310952352] exists,up e32d102e-b303-4ecd-83af-60bcb38996d2 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:osd.6 up in weight 1 up_from 42 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6818/4174188807,v1:172.21.15.47:6819/4174188807] [v2:172.21.15.47:6820/4174188807,v1:172.21.15.47:6821/4174188807] exists,up 775f48c6-25b0-4e62-b1dd-c132a13c72e0 2024-09-21T00:58:15.800 INFO:teuthology.orchestra.run.smithi047.stdout:osd.7 up in weight 1 up_from 46 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6816/4057336411,v1:172.21.15.114:6817/4057336411] [v2:172.21.15.114:6818/4057336411,v1:172.21.15.114:6819/4057336411] exists,up 57c50ddf-b4db-435a-bfda-5cf763920d78 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:osd.8 up in weight 1 up_from 53 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/690122230,v1:172.21.15.134:6817/690122230] [v2:172.21.15.134:6818/690122230,v1:172.21.15.134:6819/690122230] exists,up f5c831d8-e430-457b-a42f-2fd18ee686be 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:osd.9 up in weight 1 up_from 58 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6826/525420370,v1:172.21.15.47:6827/525420370] [v2:172.21.15.47:6828/525420370,v1:172.21.15.47:6829/525420370] exists,up 3820216c-43ae-4cab-8f20-487787f5fa2c 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:osd.10 up in weight 1 up_from 63 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6824/1056730214,v1:172.21.15.114:6825/1056730214] [v2:172.21.15.114:6826/1056730214,v1:172.21.15.114:6827/1056730214] exists,up 8b2e5646-7db2-41ad-9b2d-ca7c7377466d 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/1422408215,v1:172.21.15.134:6825/1422408215] [v2:172.21.15.134:6826/1422408215,v1:172.21.15.134:6827/1422408215] exists,up 78c28fc6-4934-498a-8600-d78cf377eb4a 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.8 [2,11] 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 2.b [8,11] 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.c [3,9] 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.14 [4,6] 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.21 [5,9] 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:pg_upmap_items 3.3c [4,9] 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3201312639 expires 2024-09-22T00:49:25.157910+0000 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/1191304788 expires 2024-09-22T00:49:25.157910+0000 2024-09-21T00:58:15.801 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/3930494204 expires 2024-09-22T00:49:25.157910+0000 2024-09-21T00:58:15.802 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/1191304788 expires 2024-09-22T00:49:25.157910+0000 2024-09-21T00:58:15.802 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2329069135 expires 2024-09-22T00:49:25.157910+0000 2024-09-21T00:58:15.802 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/2951177130 expires 2024-09-22T00:48:58.868983+0000 2024-09-21T00:58:15.802 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/1944491425 expires 2024-09-22T00:48:58.868983+0000 2024-09-21T00:58:15.802 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6801/3263172120 expires 2024-09-22T00:48:58.868983+0000 2024-09-21T00:58:15.802 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:0/1988986045 expires 2024-09-22T00:48:58.868983+0000 2024-09-21T00:58:15.802 INFO:teuthology.orchestra.run.smithi047.stdout:blocklist 172.21.15.47:6800/3263172120 expires 2024-09-22T00:48:58.868983+0000 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.799+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e940b6620 msgr2=0x7f6e940b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.799+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e940b6620 0x7f6e940b8b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009990 tx=0x7f6e90009110 comp rx=0 tx=0).stop 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.799+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 msgr2=0x7f6ea819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.799+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 0x7f6ea819c230 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6e98006010 tx=0x7f6e98004340 comp rx=0 tx=0).stop 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.800+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 shutdown_connections 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.800+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e940b6620 0x7f6e940b8b30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.800+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ea8109480 0x7f6ea819d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.800+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ea8106940 0x7f6ea819c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.800+0000 7f6eae62b640 1 --2- 172.21.15.47:0/2926423187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ea806c600 0x7f6ea819c230 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:15.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.800+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 >> 172.21.15.47:0/2926423187 conn(0x7f6ea80fdfe0 msgr2=0x7f6ea8104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:15.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.800+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 shutdown_connections 2024-09-21T00:58:15.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:15.800+0000 7f6eae62b640 1 -- 172.21.15.47:0/2926423187 wait complete. 2024-09-21T00:58:16.553 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:16 smithi047 ceph-mon[30960]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:16.553 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:16 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2926423187' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:58:16.587 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T00:58:16.598 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:58:16.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:16 smithi114 ceph-mon[34309]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:16.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:16 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2926423187' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:58:16.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:16 smithi134 ceph-mon[34785]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:16.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:16 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2926423187' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T00:58:16.860 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.322+0000 7f3042777640 1 -- 172.21.15.47:0/926521885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c1083e0 msgr2=0x7f303c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.322+0000 7f3042777640 1 --2- 172.21.15.47:0/926521885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c1083e0 0x7f303c1087f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3024009900 tx=0x7f302402a410 comp rx=0 tx=0).stop 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.322+0000 7f3042777640 1 -- 172.21.15.47:0/926521885 shutdown_connections 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.322+0000 7f3042777640 1 --2- 172.21.15.47:0/926521885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f303c108d30 0x7f303c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.322+0000 7f3042777640 1 --2- 172.21.15.47:0/926521885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c1083e0 0x7f303c1087f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.322+0000 7f3042777640 1 --2- 172.21.15.47:0/926521885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f303c102aa0 0x7f303c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.322+0000 7f3042777640 1 -- 172.21.15.47:0/926521885 >> 172.21.15.47:0/926521885 conn(0x7f303c079750 msgr2=0x7f303c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.322+0000 7f3042777640 1 -- 172.21.15.47:0/926521885 shutdown_connections 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.323+0000 7f3042777640 1 -- 172.21.15.47:0/926521885 wait complete. 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.323+0000 7f3042777640 1 Processor -- start 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.323+0000 7f3042777640 1 -- start start 2024-09-21T00:58:17.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3042777640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f303c102aa0 0x7f303c19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3042777640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f303c1083e0 0x7f303c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3042777640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c108d30 0x7f303c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3042777640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f303c1129f0 con 0x7f303c108d30 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3042777640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f303c112870 con 0x7f303c1083e0 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3042777640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f303c112b70 con 0x7f303c102aa0 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c108d30 0x7f303c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c108d30 0x7f303c19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37088/0 (socket says 172.21.15.47:37088) 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 -- 172.21.15.47:0/1461511237 learned_addr learned my addr 172.21.15.47:0/1461511237 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f303bfff640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f303c102aa0 0x7f303c19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3033fff640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f303c1083e0 0x7f303c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 -- 172.21.15.47:0/1461511237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f303c102aa0 msgr2=0x7f303c19b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f303c102aa0 0x7f303c19b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 -- 172.21.15.47:0/1461511237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f303c1083e0 msgr2=0x7f303c19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f303c1083e0 0x7f303c19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 -- 172.21.15.47:0/1461511237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303c1a6580 con 0x7f303c108d30 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f303bfff640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f303c102aa0 0x7f303c19b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.324+0000 7f3040d14640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c108d30 0x7f303c19bd40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f303400eaa0 tx=0x7f303400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.325+0000 7f3039ffb640 1 -- 172.21.15.47:0/1461511237 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303400cdb0 con 0x7f303c108d30 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.325+0000 7f3039ffb640 1 -- 172.21.15.47:0/1461511237 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3034005020 con 0x7f303c108d30 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.325+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303c1a6870 con 0x7f303c108d30 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.325+0000 7f3039ffb640 1 -- 172.21.15.47:0/1461511237 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30340116d0 con 0x7f303c108d30 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.325+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f303c1a6d30 con 0x7f303c108d30 2024-09-21T00:58:17.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.326+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f303c103d20 con 0x7f303c108d30 2024-09-21T00:58:17.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.328+0000 7f3039ffb640 1 -- 172.21.15.47:0/1461511237 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f30340051d0 con 0x7f303c108d30 2024-09-21T00:58:17.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.328+0000 7f3039ffb640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30280b65a0 0x7f30280b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:17.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.329+0000 7f303bfff640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30280b65a0 0x7f30280b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:17.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.329+0000 7f3039ffb640 1 -- 172.21.15.47:0/1461511237 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f30340e7a10 con 0x7f303c108d30 2024-09-21T00:58:17.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.329+0000 7f303bfff640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30280b65a0 0x7f30280b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f302c005fd0 tx=0x7f302c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:17.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.332+0000 7f3039ffb640 1 -- 172.21.15.47:0/1461511237 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3034016030 con 0x7f303c108d30 2024-09-21T00:58:17.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.557+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f303c102eb0 con 0x7f303c108d30 2024-09-21T00:58:17.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.558+0000 7f3039ffb640 1 -- 172.21.15.47:0/1461511237 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f30340ae240 con 0x7f303c108d30 2024-09-21T00:58:17.559 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:17.559 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:58:17.559 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:58:17.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30280b65a0 msgr2=0x7f30280b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30280b65a0 0x7f30280b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f302c005fd0 tx=0x7f302c005850 comp rx=0 tx=0).stop 2024-09-21T00:58:17.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c108d30 msgr2=0x7f303c19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:17.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c108d30 0x7f303c19bd40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f303400eaa0 tx=0x7f303400ef60 comp rx=0 tx=0).stop 2024-09-21T00:58:17.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 shutdown_connections 2024-09-21T00:58:17.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f30280b65a0 0x7f30280b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303c108d30 0x7f303c19bd40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f303c1083e0 0x7f303c19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 --2- 172.21.15.47:0/1461511237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f303c102aa0 0x7f303c19b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:17.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.560+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 >> 172.21.15.47:0/1461511237 conn(0x7f303c079750 msgr2=0x7f303c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:17.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.561+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 shutdown_connections 2024-09-21T00:58:17.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:17.561+0000 7f3042777640 1 -- 172.21.15.47:0/1461511237 wait complete. 2024-09-21T00:58:18.191 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:58:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:18.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:18 smithi047 ceph-mon[30960]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:18.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:18 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1461511237' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:18.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:18 smithi114 ceph-mon[34309]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:18.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:18 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1461511237' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:18.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:18 smithi134 ceph-mon[34785]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:18.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:18 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1461511237' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.895+0000 7f0de477c640 1 -- 172.21.15.47:0/2395231724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc1084c0 msgr2=0x7f0ddc10ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.895+0000 7f0de477c640 1 --2- 172.21.15.47:0/2395231724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc1084c0 0x7f0ddc10ecf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009ca0 tx=0x7f0dd402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.895+0000 7f0de477c640 1 -- 172.21.15.47:0/2395231724 shutdown_connections 2024-09-21T00:58:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.895+0000 7f0de477c640 1 --2- 172.21.15.47:0/2395231724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc1084c0 0x7f0ddc10ecf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.895+0000 7f0de477c640 1 --2- 172.21.15.47:0/2395231724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ddc107b70 0x7f0ddc107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.896+0000 7f0de477c640 1 --2- 172.21.15.47:0/2395231724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ddc102230 0x7f0ddc102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.896+0000 7f0de477c640 1 -- 172.21.15.47:0/2395231724 >> 172.21.15.47:0/2395231724 conn(0x7f0ddc079e40 msgr2=0x7f0ddc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.896+0000 7f0de477c640 1 -- 172.21.15.47:0/2395231724 shutdown_connections 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.896+0000 7f0de477c640 1 -- 172.21.15.47:0/2395231724 wait complete. 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.896+0000 7f0de477c640 1 Processor -- start 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.896+0000 7f0de477c640 1 -- start start 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de477c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ddc102230 0x7f0ddc19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de477c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc107b70 0x7f0ddc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de477c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ddc1084c0 0x7f0ddc1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de477c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1121e0 con 0x7f0ddc107b70 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de477c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc112060 con 0x7f0ddc102230 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de477c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc112360 con 0x7f0ddc1084c0 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc107b70 0x7f0ddc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc107b70 0x7f0ddc19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37092/0 (socket says 172.21.15.47:37092) 2024-09-21T00:58:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 -- 172.21.15.47:0/4270768774 learned_addr learned my addr 172.21.15.47:0/4270768774 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de2518640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ddc102230 0x7f0ddc19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de2d19640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ddc1084c0 0x7f0ddc1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 -- 172.21.15.47:0/4270768774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ddc1084c0 msgr2=0x7f0ddc1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ddc1084c0 0x7f0ddc1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 -- 172.21.15.47:0/4270768774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ddc102230 msgr2=0x7f0ddc19c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ddc102230 0x7f0ddc19c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 -- 172.21.15.47:0/4270768774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc1a2660 con 0x7f0ddc107b70 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.897+0000 7f0de1d17640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc107b70 0x7f0ddc19cce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00d740 tx=0x7f0dcc00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.898+0000 7f0dd37fe640 1 -- 172.21.15.47:0/4270768774 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc017070 con 0x7f0ddc107b70 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.898+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc1a2950 con 0x7f0ddc107b70 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.898+0000 7f0dd37fe640 1 -- 172.21.15.47:0/4270768774 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dcc010460 con 0x7f0ddc107b70 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.898+0000 7f0dd37fe640 1 -- 172.21.15.47:0/4270768774 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00f600 con 0x7f0ddc107b70 2024-09-21T00:58:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.898+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc1a9130 con 0x7f0ddc107b70 2024-09-21T00:58:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.899+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ddc102640 con 0x7f0ddc107b70 2024-09-21T00:58:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.901+0000 7f0dd37fe640 1 -- 172.21.15.47:0/4270768774 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f0dcc01a070 con 0x7f0ddc107b70 2024-09-21T00:58:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.901+0000 7f0dd37fe640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0dc80b65a0 0x7f0dc80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.902+0000 7f0de2518640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0dc80b65a0 0x7f0dc80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.902+0000 7f0dd37fe640 1 -- 172.21.15.47:0/4270768774 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f0dcc0e6cc0 con 0x7f0ddc107b70 2024-09-21T00:58:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.902+0000 7f0de2518640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0dc80b65a0 0x7f0dc80b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009990 tx=0x7f0dd8009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:18.904+0000 7f0dd37fe640 1 -- 172.21.15.47:0/4270768774 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0dcc0ad4f0 con 0x7f0ddc107b70 2024-09-21T00:58:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.131+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ddc19d820 con 0x7f0ddc107b70 2024-09-21T00:58:19.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.132+0000 7f0dd37fe640 1 -- 172.21.15.47:0/4270768774 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f0dcc0b18d0 con 0x7f0ddc107b70 2024-09-21T00:58:19.133 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:19.133 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:58:19.134 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:58:19.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.134+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0dc80b65a0 msgr2=0x7f0dc80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.134+0000 7f0de477c640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0dc80b65a0 0x7f0dc80b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009990 tx=0x7f0dd8009110 comp rx=0 tx=0).stop 2024-09-21T00:58:19.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.134+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc107b70 msgr2=0x7f0ddc19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:19.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.134+0000 7f0de477c640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc107b70 0x7f0ddc19cce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00d740 tx=0x7f0dcc00db40 comp rx=0 tx=0).stop 2024-09-21T00:58:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.135+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 shutdown_connections 2024-09-21T00:58:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.135+0000 7f0de477c640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0dc80b65a0 0x7f0dc80b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.135+0000 7f0de477c640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ddc1084c0 0x7f0ddc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.135+0000 7f0de477c640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ddc107b70 0x7f0ddc19cce0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.135+0000 7f0de477c640 1 --2- 172.21.15.47:0/4270768774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ddc102230 0x7f0ddc19c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.135+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 >> 172.21.15.47:0/4270768774 conn(0x7f0ddc079e40 msgr2=0x7f0ddc106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.135+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 shutdown_connections 2024-09-21T00:58:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:19.135+0000 7f0de477c640 1 -- 172.21.15.47:0/4270768774 wait complete. 2024-09-21T00:58:19.580 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:19 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4270768774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:19.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:19 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4270768774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:19.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:58:19.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:19 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4270768774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:20.083 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:20.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:20 smithi047 ceph-mon[30960]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:20.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 -- 172.21.15.47:0/563981458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 msgr2=0x7fe264110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:20.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 --2- 172.21.15.47:0/563981458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 0x7fe264110620 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009ca0 tx=0x7fe25c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 -- 172.21.15.47:0/563981458 shutdown_connections 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 --2- 172.21.15.47:0/563981458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 0x7fe264110620 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 --2- 172.21.15.47:0/563981458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2641094a0 0x7fe2641098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 --2- 172.21.15.47:0/563981458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe264103b60 0x7fe264103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 -- 172.21.15.47:0/563981458 >> 172.21.15.47:0/563981458 conn(0x7fe26407b850 msgr2=0x7fe26407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 -- 172.21.15.47:0/563981458 shutdown_connections 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.512+0000 7fe268dc8640 1 -- 172.21.15.47:0/563981458 wait complete. 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe268dc8640 1 Processor -- start 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe268dc8640 1 -- start start 2024-09-21T00:58:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe268dc8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe264103b60 0x7fe26419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe268dc8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2641094a0 0x7fe26419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe268dc8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 0x7fe26419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe268dc8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe264113ab0 con 0x7fe264109df0 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe268dc8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe264113930 con 0x7fe2641094a0 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe268dc8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe264113c30 con 0x7fe264103b60 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe262d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 0x7fe26419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe262d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 0x7fe26419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37112/0 (socket says 172.21.15.47:37112) 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.513+0000 7fe262d9d640 1 -- 172.21.15.47:0/3578805459 learned_addr learned my addr 172.21.15.47:0/3578805459 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe261d9b640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2641094a0 0x7fe26419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe26259c640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe264103b60 0x7fe26419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe262d9d640 1 -- 172.21.15.47:0/3578805459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe264103b60 msgr2=0x7fe26419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:20.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe262d9d640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe264103b60 0x7fe26419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe262d9d640 1 -- 172.21.15.47:0/3578805459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2641094a0 msgr2=0x7fe26419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe262d9d640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2641094a0 0x7fe26419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe262d9d640 1 -- 172.21.15.47:0/3578805459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2641a0370 con 0x7fe264109df0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe262d9d640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 0x7fe26419fc40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe25c005cc0 tx=0x7fe25c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe2537fe640 1 -- 172.21.15.47:0/3578805459 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c003bf0 con 0x7fe264109df0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2641a0600 con 0x7fe264109df0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe2537fe640 1 -- 172.21.15.47:0/3578805459 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe25c003d90 con 0x7fe264109df0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe2537fe640 1 -- 172.21.15.47:0/3578805459 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c02fbc0 con 0x7fe264109df0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.514+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2641a6dc0 con 0x7fe264109df0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.515+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe264103f70 con 0x7fe264109df0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.517+0000 7fe2537fe640 1 -- 172.21.15.47:0/3578805459 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe25c02fd60 con 0x7fe264109df0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.518+0000 7fe2537fe640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe24c0b65a0 0x7fe24c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.518+0000 7fe26259c640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe24c0b65a0 0x7fe24c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:20.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.518+0000 7fe2537fe640 1 -- 172.21.15.47:0/3578805459 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fe25c108a30 con 0x7fe264109df0 2024-09-21T00:58:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.518+0000 7fe26259c640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe24c0b65a0 0x7fe24c0b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe254005fd0 tx=0x7fe254005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.521+0000 7fe2537fe640 1 -- 172.21.15.47:0/3578805459 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe25c0cf260 con 0x7fe264109df0 2024-09-21T00:58:20.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:20 smithi114 ceph-mon[34309]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:20.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.733+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe26419b530 con 0x7fe264109df0 2024-09-21T00:58:20.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.734+0000 7fe2537fe640 1 -- 172.21.15.47:0/3578805459 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22632 (secure 0 0 0) 0x7fe25c0f0880 con 0x7fe264109df0 2024-09-21T00:58:20.735 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:20.735 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":77,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:57:26.756741+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:58:20.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.736+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe24c0b65a0 msgr2=0x7fe24c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.736+0000 7fe268dc8640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe24c0b65a0 0x7fe24c0b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe254005fd0 tx=0x7fe254005850 comp rx=0 tx=0).stop 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.736+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 msgr2=0x7fe26419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.736+0000 7fe268dc8640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 0x7fe26419fc40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe25c005cc0 tx=0x7fe25c02f380 comp rx=0 tx=0).stop 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.737+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 shutdown_connections 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.737+0000 7fe268dc8640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe24c0b65a0 0x7fe24c0b8ab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.737+0000 7fe268dc8640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe264109df0 0x7fe26419fc40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.737+0000 7fe268dc8640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2641094a0 0x7fe26419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.737+0000 7fe268dc8640 1 --2- 172.21.15.47:0/3578805459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe264103b60 0x7fe26419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.737+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 >> 172.21.15.47:0/3578805459 conn(0x7fe26407b850 msgr2=0x7fe264105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.737+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 shutdown_connections 2024-09-21T00:58:20.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:20.737+0000 7fe268dc8640 1 -- 172.21.15.47:0/3578805459 wait complete. 2024-09-21T00:58:20.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:20 smithi134 ceph-mon[34785]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:21.356 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T00:56:49.241985+0000', 'modified': '2024-09-21T00:56:58.284880+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24653}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24637': {'gid': 24637, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6839/924032014', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 924032014}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 924032014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.114:6839/4124175185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6838', 'nonce': 4124175185}, {'type': 'v1', 'addr': '172.21.15.114:6839', 'nonce': 4124175185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24653]} 2024-09-21T00:58:21.356 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T00:58:21.356 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T00:58:21.618 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:21.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:21 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3578805459' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:21.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:21 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3578805459' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:21.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:21 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3578805459' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.136+0000 7fb380857640 1 -- 172.21.15.47:0/2616832490 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c1083e0 msgr2=0x7fb37c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.136+0000 7fb380857640 1 --2- 172.21.15.47:0/2616832490 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c1083e0 0x7fb37c1087f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb370009900 tx=0x7fb37002a410 comp rx=0 tx=0).stop 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.136+0000 7fb380857640 1 -- 172.21.15.47:0/2616832490 shutdown_connections 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.136+0000 7fb380857640 1 --2- 172.21.15.47:0/2616832490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb37c108d30 0x7fb37c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.136+0000 7fb380857640 1 --2- 172.21.15.47:0/2616832490 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c1083e0 0x7fb37c1087f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.136+0000 7fb380857640 1 --2- 172.21.15.47:0/2616832490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c102aa0 0x7fb37c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.136+0000 7fb380857640 1 -- 172.21.15.47:0/2616832490 >> 172.21.15.47:0/2616832490 conn(0x7fb37c079750 msgr2=0x7fb37c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.136+0000 7fb380857640 1 -- 172.21.15.47:0/2616832490 shutdown_connections 2024-09-21T00:58:22.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.137+0000 7fb380857640 1 -- 172.21.15.47:0/2616832490 wait complete. 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb380857640 1 Processor -- start 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb380857640 1 -- start start 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb380857640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c102aa0 0x7fb37c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb380857640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb37c1083e0 0x7fb37c199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb380857640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c108d30 0x7fb37c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb380857640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c1129f0 con 0x7fb37c102aa0 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb380857640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c112870 con 0x7fb37c108d30 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb380857640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c112b70 con 0x7fb37c1083e0 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb37a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c102aa0 0x7fb37c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb37a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c102aa0 0x7fb37c1993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58518/0 (socket says 172.21.15.47:58518) 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.138+0000 7fb37a59c640 1 -- 172.21.15.47:0/3060642065 learned_addr learned my addr 172.21.15.47:0/3060642065 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb379d9b640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb37c1083e0 0x7fb37c199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb37a59c640 1 -- 172.21.15.47:0/3060642065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb37c1083e0 msgr2=0x7fb37c199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb37a59c640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb37c1083e0 0x7fb37c199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c108d30 0x7fb37c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb37a59c640 1 -- 172.21.15.47:0/3060642065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c108d30 msgr2=0x7fb37c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb37a59c640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c108d30 0x7fb37c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb37a59c640 1 -- 172.21.15.47:0/3060642065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c19f250 con 0x7fb37c102aa0 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c108d30 0x7fb37c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb37a59c640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c102aa0 0x7fb37c1993a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb36c007b50 tx=0x7fb36c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb36b7fe640 1 -- 172.21.15.47:0/3060642065 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c007c40 con 0x7fb37c102aa0 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb380857640 1 -- 172.21.15.47:0/3060642065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37c19f540 con 0x7fb37c102aa0 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb36b7fe640 1 -- 172.21.15.47:0/3060642065 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb36c007de0 con 0x7fb37c102aa0 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb36b7fe640 1 -- 172.21.15.47:0/3060642065 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00ace0 con 0x7fb37c102aa0 2024-09-21T00:58:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.139+0000 7fb380857640 1 -- 172.21.15.47:0/3060642065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37c06bb40 con 0x7fb37c102aa0 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb386dcb740 1 Processor -- start 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb386dcb740 1 -- start start 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb36b7fe640 1 -- 172.21.15.47:0/3060642065 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fb36c00eb30 con 0x7fb37c102aa0 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b8804af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b8804b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 0x562b8804b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb386dcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562b87fc2c10 con 0x562b87c7c0a0 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb386dcb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562b87fb2040 con 0x562b87c84280 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.142+0000 7fb386dcb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b87fb5e50 con 0x562b87ca4f60 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b8804b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b8804b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58524/0 (socket says 172.21.15.47:58524) 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 -- 172.21.15.47:0/1255120880 learned_addr learned my addr 172.21.15.47:0/1255120880 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:22.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b8804af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb379d9b640 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 0x562b8804b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 -- 172.21.15.47:0/1255120880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 msgr2=0x562b8804af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b8804af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 -- 172.21.15.47:0/1255120880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 msgr2=0x562b8804b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 0x562b8804b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 -- 172.21.15.47:0/1255120880 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b87d10540 con 0x562b87c7c0a0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37a59c640 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b8804b440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0e63b0 tx=0x7fb36c0f15b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30af2c47b64c1867 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb36b7fe640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3640b65d0 0x7fb3640b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb368ff9640 1 -- 172.21.15.47:0/1255120880 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0ab1d0 con 0x562b87c7c0a0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.143+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3640b65d0 0x7fb3640b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.144+0000 7fb368ff9640 1 -- 172.21.15.47:0/1255120880 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb36c0fa070 con 0x562b87c7c0a0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.144+0000 7fb368ff9640 1 -- 172.21.15.47:0/1255120880 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0ae2f0 con 0x562b87c7c0a0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.144+0000 7fb36b7fe640 1 -- 172.21.15.47:0/3060642065 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb36c0e89c0 con 0x7fb37c102aa0 2024-09-21T00:58:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.144+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3640b65d0 0x7fb3640b8ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb374005fd0 tx=0x7fb374009700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.144+0000 7fb386dcb740 1 -- 172.21.15.47:0/1255120880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 msgr2=0x562b8804b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.144+0000 7fb386dcb740 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b8804b440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0e63b0 tx=0x7fb36c0f15b0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 -- 172.21.15.47:0/1255120880 shutdown_connections 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 0x562b8804b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b8804b440 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 --2- 172.21.15.47:0/1255120880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b8804af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 -- 172.21.15.47:0/1255120880 >> 172.21.15.47:0/1255120880 conn(0x562b87c99350 msgr2=0x562b88048df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 -- 172.21.15.47:0/1255120880 shutdown_connections 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 -- 172.21.15.47:0/1255120880 wait complete. 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 -- start start 2024-09-21T00:58:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 Processor -- start 2024-09-21T00:58:22.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b88056750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.145+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 0x562b88056cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b880629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb386dcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562b87e135f0 con 0x562b87c7c0a0 2024-09-21T00:58:22.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb386dcb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562b87f4d010 con 0x562b87c84280 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb386dcb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b88059680 con 0x562b87ca4f60 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb386dcb740 10 client.0 _ll_register_callbacks cb 0x562b87fac340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b88056750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b88056750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58530/0 (socket says 172.21.15.47:58530) 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 -- 172.21.15.47:0/2990331688 learned_addr learned my addr 172.21.15.47:0/2990331688 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb379d9b640 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 0x562b88056cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b880629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 -- 172.21.15.47:0/2990331688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 msgr2=0x562b880629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b880629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 -- 172.21.15.47:0/2990331688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 msgr2=0x562b88056cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 0x562b88056cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 -- 172.21.15.47:0/2990331688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b87f7aa00 con 0x562b87c7c0a0 2024-09-21T00:58:22.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b880629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb37a59c640 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b88056750 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0ae690 tx=0x7fb36c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ec42bec673c3d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb361ffb640 1 -- 172.21.15.47:0/2990331688 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0ae4d0 con 0x562b87c7c0a0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb361ffb640 1 -- 172.21.15.47:0/2990331688 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb36c00a440 con 0x562b87c7c0a0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.146+0000 7fb386dcb740 1 -- 172.21.15.47:0/2990331688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb36c0fa070 con 0x562b87c7c0a0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb361ffb640 1 -- 172.21.15.47:0/2990331688 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb36c0ae6c0 con 0x562b87c7c0a0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb386dcb740 10 client.15207 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb386dcb740 1 -- 172.21.15.47:0/2990331688 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562b88065510 con 0x562b87c7c0a0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb361ffb640 1 -- 172.21.15.47:0/2990331688 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb36c0fa070 con 0x562b87c7c0a0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb361ffb640 1 -- 172.21.15.47:0/2990331688 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb36c014070 con 0x562b87c7c0a0 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb386dcb740 10 client.15207 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb386dcb740 10 client.15207 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:58:22.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb386dcb740 20 client.15207 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562b87c638e0 0x562b88066860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb386dcb740 4 client.15207 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb386dcb740 1 -- 172.21.15.47:0/2990331688 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b87fc4b60 con 0x562b87c638e0 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.147+0000 7fb379d9b640 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562b87c638e0 0x562b88066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.148+0000 7fb361ffb640 10 client.15207 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.148+0000 7fb379d9b640 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562b87c638e0 0x562b88066860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a1f5820f73c679 server_cookie=5828edf4ed9a88d9 in_seq=0 out_seq=0 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb361ffb640 1 -- 172.21.15.47:0/2990331688 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b87fc4b60 con 0x562b87c638e0 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb361ffb640 10 client.15207 handle_command_reply: tid=0 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 client.15207 shutdown 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 -- 172.21.15.47:0/2990331688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 msgr2=0x562b88056750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b88056750 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0ae690 tx=0x7fb36c007f90 comp rx=0 tx=0).stop 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 -- 172.21.15.47:0/2990331688 shutdown_connections 2024-09-21T00:58:22.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562b87c638e0 0x562b88066860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87ca4f60 0x562b880629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c84280 0x562b88056cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2990331688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c7c0a0 0x562b88056750 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb361ffb640 0 client.15207 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 -- 172.21.15.47:0/2990331688 >> 172.21.15.47:0/2990331688 conn(0x562b87c99350 msgr2=0x562b8804e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 -- 172.21.15.47:0/2990331688 shutdown_connections 2024-09-21T00:58:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 1 -- 172.21.15.47:0/2990331688 wait complete. 2024-09-21T00:58:22.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.149+0000 7fb386dcb740 20 client.15207 trim_cache size 0 max 16384 2024-09-21T00:58:22.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb386dcb740 1 Processor -- start 2024-09-21T00:58:22.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb386dcb740 1 -- start start 2024-09-21T00:58:22.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c7c0a0 0x562b88067cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c84280 0x562b88051020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87ca4f60 0x562b88062910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb386dcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562b88066db0 con 0x562b87ca4f60 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb386dcb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562b88067480 con 0x562b87c7c0a0 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb386dcb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b88067b50 con 0x562b87c84280 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87ca4f60 0x562b88062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87ca4f60 0x562b88062910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58540/0 (socket says 172.21.15.47:58540) 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37ad9d640 1 -- 172.21.15.47:0/2822741867 learned_addr learned my addr 172.21.15.47:0/2822741867 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37a59c640 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c7c0a0 0x562b88067cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb379d9b640 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c84280 0x562b88051020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37ad9d640 1 -- 172.21.15.47:0/2822741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c84280 msgr2=0x562b88051020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c84280 0x562b88051020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37ad9d640 1 -- 172.21.15.47:0/2822741867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c7c0a0 msgr2=0x562b88067cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c7c0a0 0x562b88067cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb37ad9d640 1 -- 172.21.15.47:0/2822741867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b88051fe0 con 0x562b87ca4f60 2024-09-21T00:58:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.168+0000 7fb379d9b640 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c84280 0x562b88051020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.169+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87ca4f60 0x562b88062910 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3740105c0 tx=0x7fb374015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5907268c66177d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.169+0000 7fb363fff640 1 -- 172.21.15.47:0/2822741867 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374028440 con 0x562b87ca4f60 2024-09-21T00:58:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.169+0000 7fb363fff640 1 -- 172.21.15.47:0/2822741867 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb37401e8c0 con 0x562b87ca4f60 2024-09-21T00:58:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.169+0000 7fb363fff640 1 -- 172.21.15.47:0/2822741867 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374027880 con 0x562b87ca4f60 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- 172.21.15.47:0/2822741867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87ca4f60 msgr2=0x562b88062910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87ca4f60 0x562b88062910 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3740105c0 tx=0x7fb374015000 comp rx=0 tx=0).stop 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- 172.21.15.47:0/2822741867 shutdown_connections 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87ca4f60 0x562b88062910 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c84280 0x562b88051020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 --2- 172.21.15.47:0/2822741867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87c7c0a0 0x562b88067cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- 172.21.15.47:0/2822741867 >> 172.21.15.47:0/2822741867 conn(0x562b87c99350 msgr2=0x562b88048750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- 172.21.15.47:0/2822741867 shutdown_connections 2024-09-21T00:58:22.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- 172.21.15.47:0/2822741867 wait complete. 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- start start 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 Processor -- start 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c7c0a0 0x562b88071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c84280 0x562b8806a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87ca4f60 0x562b8806ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562b880688f0 con 0x562b87c84280 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562b88068220 con 0x562b87ca4f60 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.170+0000 7fb386dcb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b88068fc0 con 0x562b87c7c0a0 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb386dcb740 10 client.0 _ll_register_callbacks cb 0x7fb370009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c84280 0x562b8806a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c84280 0x562b8806a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58542/0 (socket says 172.21.15.47:58542) 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 -- 172.21.15.47:0/3433197947 learned_addr learned my addr 172.21.15.47:0/3433197947 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:22.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb37ad9d640 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87ca4f60 0x562b8806ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb37a59c640 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c7c0a0 0x562b88071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 -- 172.21.15.47:0/3433197947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c7c0a0 msgr2=0x562b88071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c7c0a0 0x562b88071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 -- 172.21.15.47:0/3433197947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87ca4f60 msgr2=0x562b8806ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87ca4f60 0x562b8806ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 -- 172.21.15.47:0/3433197947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8806b160 con 0x562b87c84280 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb379d9b640 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c84280 0x562b8806a6e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb370034040 tx=0x7fb3700041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d91ae3e7851f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb361ffb640 1 -- 172.21.15.47:0/3433197947 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370048020 con 0x562b87c84280 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb386dcb740 1 -- 172.21.15.47:0/3433197947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb37401e8c0 con 0x562b87c84280 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb361ffb640 1 -- 172.21.15.47:0/3433197947 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb370004470 con 0x562b87c84280 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.171+0000 7fb361ffb640 1 -- 172.21.15.47:0/3433197947 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb370035040 con 0x562b87c84280 2024-09-21T00:58:22.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb386dcb740 10 client.15213 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb386dcb740 1 -- 172.21.15.47:0/3433197947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562b88070ae0 con 0x562b87c84280 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb361ffb640 1 -- 172.21.15.47:0/3433197947 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb37401e8c0 con 0x562b87c84280 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb361ffb640 1 -- 172.21.15.47:0/3433197947 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb370004c30 con 0x562b87c84280 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb386dcb740 10 client.15213 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb386dcb740 10 client.15213 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb386dcb740 20 client.15213 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb386dcb740 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562b87c38c90 0x562b880d73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb386dcb740 4 client.15213 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb386dcb740 1 -- 172.21.15.47:0/3433197947 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "status"}) -- 0x562b87fc0610 con 0x562b87c38c90 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.172+0000 7fb37a59c640 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562b87c38c90 0x562b880d73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb361ffb640 10 client.15213 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb37a59c640 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562b87c38c90 0x562b880d73c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1a5cde1524afd29 server_cookie=f8c1de621cda3fa0 in_seq=0 out_seq=0 2024-09-21T00:58:22.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb361ffb640 1 -- 172.21.15.47:0/3433197947 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562b87fc0610 con 0x562b87c38c90 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb361ffb640 10 client.15213 handle_command_reply: tid=0 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 client.15213 shutdown 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 -- 172.21.15.47:0/3433197947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c84280 msgr2=0x562b8806a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c84280 0x562b8806a6e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb370034040 tx=0x7fb3700041f0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 -- 172.21.15.47:0/3433197947 shutdown_connections 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562b87c38c90 0x562b880d73c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562b87ca4f60 0x562b8806ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b87c84280 0x562b8806a6e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb361ffb640 0 client.15213 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 --2- 172.21.15.47:0/3433197947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b87c7c0a0 0x562b88071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 -- 172.21.15.47:0/3433197947 >> 172.21.15.47:0/3433197947 conn(0x562b87c99350 msgr2=0x562b88056500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 -- 172.21.15.47:0/3433197947 shutdown_connections 2024-09-21T00:58:22.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 1 -- 172.21.15.47:0/3433197947 wait complete. 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.173+0000 7fb386dcb740 20 client.15213 trim_cache size 0 max 16384 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "1256112e-77b3-11ef-baf5-efdc52797490", 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24653, 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 92.525753690000002, 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 19, 2024-09-21T00:58:22.180 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 77, 2024-09-21T00:58:22.181 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T00:58:22.181 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 102.76409847399999 2024-09-21T00:58:22.181 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:58:22.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 -- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3640b65d0 msgr2=0x7fb3640b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3640b65d0 0x7fb3640b8ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb374005fd0 tx=0x7fb374009700 comp rx=0 tx=0).stop 2024-09-21T00:58:22.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 -- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c102aa0 msgr2=0x7fb37c1993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c102aa0 0x7fb37c1993a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb36c007b50 tx=0x7fb36c00e420 comp rx=0 tx=0).stop 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 -- 172.21.15.47:0/3060642065 shutdown_connections 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb3640b65d0 0x7fb3640b8ae0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb37c108d30 0x7fb37c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb37c1083e0 0x7fb37c199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 --2- 172.21.15.47:0/3060642065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb37c102aa0 0x7fb37c1993a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 -- 172.21.15.47:0/3060642065 >> 172.21.15.47:0/3060642065 conn(0x7fb37c079750 msgr2=0x7fb37c106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 -- 172.21.15.47:0/3060642065 shutdown_connections 2024-09-21T00:58:22.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:22.174+0000 7fb380857640 1 -- 172.21.15.47:0/3060642065 wait complete. 2024-09-21T00:58:22.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:22 smithi134 ceph-mon[34785]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:22.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:22 smithi114 ceph-mon[34309]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:22.934 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:22 smithi047 ceph-mon[30960]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:22.967 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T00:58:22.992 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T00:58:22.992 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T00:58:22.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:22.992 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-09-21T00:58:23.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:23.011 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-09-21T00:58:23.083 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-09-21T00:58:23.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:58:23.084 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T00:58:23.084 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T00:58:23.084 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:58:23.084 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T00:58:23.387 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 -- 172.21.15.47:0/129868463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 msgr2=0x7f7c4c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 --2- 172.21.15.47:0/129868463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 0x7f7c4c1087e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009900 tx=0x7f7c3c02a410 comp rx=0 tx=0).stop 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 -- 172.21.15.47:0/129868463 shutdown_connections 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 --2- 172.21.15.47:0/129868463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c4c108d20 0x7f7c4c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 --2- 172.21.15.47:0/129868463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 0x7f7c4c1087e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 --2- 172.21.15.47:0/129868463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c102ae0 0x7f7c4c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 -- 172.21.15.47:0/129868463 >> 172.21.15.47:0/129868463 conn(0x7f7c4c079760 msgr2=0x7f7c4c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 -- 172.21.15.47:0/129868463 shutdown_connections 2024-09-21T00:58:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.863+0000 7f7c5454a640 1 -- 172.21.15.47:0/129868463 wait complete. 2024-09-21T00:58:23.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c5454a640 1 Processor -- start 2024-09-21T00:58:23.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c5454a640 1 -- start start 2024-09-21T00:58:23.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c5454a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c4c102ae0 0x7f7c4c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:23.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c5454a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 0x7f7c4c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c5454a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c108d20 0x7f7c4c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c5454a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c113ae0 con 0x7f7c4c1083d0 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c5454a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c113960 con 0x7f7c4c102ae0 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c5454a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c113c60 con 0x7f7c4c108d20 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c51ae5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 0x7f7c4c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c51ae5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 0x7f7c4c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58562/0 (socket says 172.21.15.47:58562) 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c51ae5640 1 -- 172.21.15.47:0/2206841938 learned_addr learned my addr 172.21.15.47:0/2206841938 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c52ae7640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c108d20 0x7f7c4c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c522e6640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c4c102ae0 0x7f7c4c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c51ae5640 1 -- 172.21.15.47:0/2206841938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c108d20 msgr2=0x7f7c4c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c51ae5640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c108d20 0x7f7c4c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c51ae5640 1 -- 172.21.15.47:0/2206841938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c4c102ae0 msgr2=0x7f7c4c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c51ae5640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c4c102ae0 0x7f7c4c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c51ae5640 1 -- 172.21.15.47:0/2206841938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c1a0440 con 0x7f7c4c1083d0 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.864+0000 7f7c52ae7640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c108d20 0x7f7c4c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.865+0000 7f7c51ae5640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 0x7f7c4c19aa70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c031a90 tx=0x7f7c3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.865+0000 7f7c437fe640 1 -- 172.21.15.47:0/2206841938 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c03f030 con 0x7f7c4c1083d0 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.865+0000 7f7c437fe640 1 -- 172.21.15.47:0/2206841938 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c3c003cb0 con 0x7f7c4c1083d0 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.865+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c1a06d0 con 0x7f7c4c1083d0 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.865+0000 7f7c437fe640 1 -- 172.21.15.47:0/2206841938 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c035070 con 0x7f7c4c1083d0 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.865+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1a6e90 con 0x7f7c4c1083d0 2024-09-21T00:58:23.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.866+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c103d10 con 0x7f7c4c1083d0 2024-09-21T00:58:23.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.868+0000 7f7c437fe640 1 -- 172.21.15.47:0/2206841938 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f7c3c042030 con 0x7f7c4c1083d0 2024-09-21T00:58:23.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.868+0000 7f7c437fe640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c380b6620 0x7f7c380b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:23.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.869+0000 7f7c522e6640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c380b6620 0x7f7c380b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:23.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.869+0000 7f7c437fe640 1 -- 172.21.15.47:0/2206841938 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f7c3c107de0 con 0x7f7c4c1083d0 2024-09-21T00:58:23.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.869+0000 7f7c522e6640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c380b6620 0x7f7c380b8b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009890 tx=0x7f7c48008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:23.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:23.872+0000 7f7c437fe640 1 -- 172.21.15.47:0/2206841938 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c3c0ce610 con 0x7f7c4c1083d0 2024-09-21T00:58:24.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.101+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7c4c102ef0 con 0x7f7c4c1083d0 2024-09-21T00:58:24.103 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T00:58:24.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.101+0000 7f7c437fe640 1 -- 172.21.15.47:0/2206841938 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7f7c3c0d29f0 con 0x7f7c4c1083d0 2024-09-21T00:58:24.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c380b6620 msgr2=0x7f7c380b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c380b6620 0x7f7c380b8b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009890 tx=0x7f7c48008040 comp rx=0 tx=0).stop 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 msgr2=0x7f7c4c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 0x7f7c4c19aa70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c031a90 tx=0x7f7c3c004270 comp rx=0 tx=0).stop 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 shutdown_connections 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c380b6620 0x7f7c380b8b30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c108d20 0x7f7c4c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c4c1083d0 0x7f7c4c19aa70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 --2- 172.21.15.47:0/2206841938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c4c102ae0 0x7f7c4c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 >> 172.21.15.47:0/2206841938 conn(0x7f7c4c079760 msgr2=0x7f7c4c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 shutdown_connections 2024-09-21T00:58:24.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24.104+0000 7f7c5454a640 1 -- 172.21.15.47:0/2206841938 wait complete. 2024-09-21T00:58:24.791 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:24 smithi047 ceph-mon[30960]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:24.791 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:24 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2206841938' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T00:58:24.825 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:58:24.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:24.826 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-09-21T00:58:24.844 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T00:58:24.844 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T00:58:24.844 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T00:58:24.844 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42185sec preferred_lft 42185sec 2024-09-21T00:58:24.845 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-09-21T00:58:24.846 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-09-21T00:58:24.846 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T00:58:24.846 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-09-21T00:58:24.846 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-09-21T00:58:24.846 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T00:58:24.846 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:58:24.847 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-21T00:58:24.847 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-09-21T00:58:24.847 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-09-21T00:58:24.847 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-09-21T00:58:24.847 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T00:58:24.847 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-21T00:58:24.847 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:24 smithi134 ceph-mon[34785]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:24.848 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:24 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2206841938' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:58:24.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:24 smithi114 ceph-mon[34309]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T00:58:24.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:24 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2206841938' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T00:58:24.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:58:25.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:25.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:25.076 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T00:58:25.102 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-09-21T00:58:25.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:25.104 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-09-21T00:58:25.177 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-09-21T00:58:25.178 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T00:58:25.178 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T00:58:25.178 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T00:58:25.178 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T00:58:25.178 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:58:25.178 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-21T00:58:25.178 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T00:58:25.178 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T00:58:25.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T00:58:25.179 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-21T00:58:25.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:58:25.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:25.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:25.481 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-09-21T00:58:25.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:25.497 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-09-21T00:58:25.554 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:58:25.554 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-21T00:58:25.554 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T00:58:25.554 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T00:58:25.554 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-21T00:58:25.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:58:25.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:25.701 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T00:58:25.701 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:58:25.701 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-21T00:58:25.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T00:58:25.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T00:58:25.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T00:58:25.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T00:58:25.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T00:58:25.701 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-21T00:58:25.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:58:25.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:25.829 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T00:58:25.829 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-21T00:58:25.829 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-09-21T00:58:25.829 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T00:58:25.829 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-21T00:58:25.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:58:25.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:25.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:58:25.907 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T00:58:25.923 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T00:58:25.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T00:58:25.923 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:58:25.980 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T00:58:25.980 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T00:58:25.980 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/45519c2e-f169-4765-a889-8456142a55d7 2024-09-21T00:58:25.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:25.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/45519c2e-f169-4765-a889-8456142a55d7 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T00:58:26.094 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T00:58:26.094 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-21T00:58:26.228 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T00:58:26.228 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-21T00:58:26.229 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.114:3300,172.21.15.134:3300" 2024-09-21T00:58:26.229 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with new device syntax: 0@1256112e-77b3-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/45519c2e-f169-4765-a889-8456142a55d7 2024-09-21T00:58:26.229 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.47:3300/172.21.15.114:3300/172.21.15.134:3300" will pass to kernel 2024-09-21T00:58:26.229 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T00:58:26.229 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-09-21T00:58:26.229 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T00:58:26.230 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T00:58:26.230 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T00:58:26.231 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T00:58:26.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T00:58:26.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T00:58:26.258 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:58:26.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:58:26.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:26.358 INFO:teuthology.orchestra.run.smithi047.stdout:client15222 2024-09-21T00:58:26.358 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:58:26.358 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T00:58:26.376 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:58:26.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:58:26.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:26.475 INFO:teuthology.orchestra.run.smithi047.stdout:client15222 2024-09-21T00:58:26.476 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T00:58:26.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T00:58:26.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:26.535 INFO:teuthology.orchestra.run.smithi047.stdout:client15222 2024-09-21T00:58:26.535 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/1256112e-77b3-11ef-baf5-efdc52797490.client15222/status') 2024-09-21T00:58:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T00:58:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:26 smithi047 ceph-mon[30960]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:26.596 INFO:teuthology.orchestra.run.smithi047.stdout:instance: client.15222 (3)192.168.0.1:0/3401217669 2024-09-21T00:58:26.596 INFO:teuthology.orchestra.run.smithi047.stdout:blocklisted: false 2024-09-21T00:58:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records in 2024-09-21T00:58:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records out 2024-09-21T00:58:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:70 bytes copied, 2.4898e-05 s, 2.8 MB/s 2024-09-21T00:58:26.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T00:58:26.604 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T00:58:26.614 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T00:58:26.660 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T00:58:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.776+0000 7f746b59e640 1 -- 172.21.15.47:0/1543720103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 msgr2=0x7f746c108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.776+0000 7f746b59e640 1 --2- 172.21.15.47:0/1543720103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 0x7f746c108d40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7460009900 tx=0x7f746002a410 comp rx=0 tx=0).stop 2024-09-21T00:58:26.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.777+0000 7f746b59e640 1 -- 172.21.15.47:0/1543720103 shutdown_connections 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.777+0000 7f746b59e640 1 --2- 172.21.15.47:0/1543720103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746c109280 0x7f746c10b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.777+0000 7f746b59e640 1 --2- 172.21.15.47:0/1543720103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 0x7f746c108d40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.777+0000 7f746b59e640 1 --2- 172.21.15.47:0/1543720103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746c101890 0x7f746c101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.777+0000 7f746b59e640 1 -- 172.21.15.47:0/1543720103 >> 172.21.15.47:0/1543720103 conn(0x7f746c0fd490 msgr2=0x7f746c0ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.777+0000 7f746b59e640 1 -- 172.21.15.47:0/1543720103 shutdown_connections 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.777+0000 7f746b59e640 1 -- 172.21.15.47:0/1543720103 wait complete. 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.777+0000 7f746b59e640 1 Processor -- start 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746b59e640 1 -- start start 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746b59e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746c101890 0x7f746c103f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746b59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 0x7f746c102820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746c109280 0x7f746c102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746b59e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f746c10f110 con 0x7f746c106920 2024-09-21T00:58:26.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f746c10ef90 con 0x7f746c109280 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746b59e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f746c10f290 con 0x7f746c101890 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f7469d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 0x7f746c102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f7469d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 0x7f746c102820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58580/0 (socket says 172.21.15.47:58580) 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f7469d9b640 1 -- 172.21.15.47:0/2760089765 learned_addr learned my addr 172.21.15.47:0/2760089765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746a59c640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746c101890 0x7f746c103f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f746ad9d640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746c109280 0x7f746c102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f7469d9b640 1 -- 172.21.15.47:0/2760089765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746c101890 msgr2=0x7f746c103f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f7469d9b640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746c101890 0x7f746c103f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f7469d9b640 1 -- 172.21.15.47:0/2760089765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746c109280 msgr2=0x7f746c102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f7469d9b640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746c109280 0x7f746c102d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.778+0000 7f7469d9b640 1 -- 172.21.15.47:0/2760089765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c103490 con 0x7f746c106920 2024-09-21T00:58:26.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.779+0000 7f7469d9b640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 0x7f746c102820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7460006010 tx=0x7f7460004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:26.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.779+0000 7f745b7fe640 1 -- 172.21.15.47:0/2760089765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746003f030 con 0x7f746c106920 2024-09-21T00:58:26.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.779+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c1a3db0 con 0x7f746c106920 2024-09-21T00:58:26.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.779+0000 7f745b7fe640 1 -- 172.21.15.47:0/2760089765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7460003cb0 con 0x7f746c106920 2024-09-21T00:58:26.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.779+0000 7f745b7fe640 1 -- 172.21.15.47:0/2760089765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460035070 con 0x7f746c106920 2024-09-21T00:58:26.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.779+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c1a41c0 con 0x7f746c106920 2024-09-21T00:58:26.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.780+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c0fefb0 con 0x7f746c106920 2024-09-21T00:58:26.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.782+0000 7f745b7fe640 1 -- 172.21.15.47:0/2760089765 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f7460042030 con 0x7f746c106920 2024-09-21T00:58:26.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.782+0000 7f745b7fe640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74540b65a0 0x7f74540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:26.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.783+0000 7f746a59c640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74540b65a0 0x7f74540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:26.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.783+0000 7f745b7fe640 1 -- 172.21.15.47:0/2760089765 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f7460108090 con 0x7f746c106920 2024-09-21T00:58:26.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.783+0000 7f746a59c640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74540b65a0 0x7f74540b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f745c005d00 tx=0x7f745c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:26.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.790+0000 7f745b7fe640 1 -- 172.21.15.47:0/2760089765 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7460003e60 con 0x7f746c106920 2024-09-21T00:58:26.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:26 smithi134 ceph-mon[34785]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:26.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:26 smithi114 ceph-mon[34309]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.978+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f746c02e840 con 0x7f746c106920 2024-09-21T00:58:26.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.980+0000 7f745b7fe640 1 -- 172.21.15.47:0/2760089765 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22632 (secure 0 0 0) 0x7f74600d2ca0 con 0x7f746c106920 2024-09-21T00:58:26.981 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:26.981 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":77,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:57:26.756741+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:58:26.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74540b65a0 msgr2=0x7f74540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:26.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74540b65a0 0x7f74540b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f745c005d00 tx=0x7f745c00b410 comp rx=0 tx=0).stop 2024-09-21T00:58:26.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 msgr2=0x7f746c102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:26.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 0x7f746c102820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7460006010 tx=0x7f7460004340 comp rx=0 tx=0).stop 2024-09-21T00:58:26.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 shutdown_connections 2024-09-21T00:58:26.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f74540b65a0 0x7f74540b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746c109280 0x7f746c102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f746c106920 0x7f746c102820 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 --2- 172.21.15.47:0/2760089765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746c101890 0x7f746c103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:26.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 >> 172.21.15.47:0/2760089765 conn(0x7f746c0fd490 msgr2=0x7f746c1077f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:26.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 shutdown_connections 2024-09-21T00:58:26.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:26.982+0000 7f746b59e640 1 -- 172.21.15.47:0/2760089765 wait complete. 2024-09-21T00:58:26.999 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:52:17.628162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T00:56:45.468079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T00:56:47.230573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T00:58:27.000 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T00:58:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 -- 172.21.15.47:0/2298251743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103fa0 msgr2=0x7f58a410a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2298251743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103fa0 0x7f58a410a940 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f589c009ca0 tx=0x7f589c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 -- 172.21.15.47:0/2298251743 shutdown_connections 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2298251743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4103fa0 0x7f58a410a940 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2298251743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a4103600 0x7f58a4103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2298251743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a4102580 0x7f58a41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 -- 172.21.15.47:0/2298251743 >> 172.21.15.47:0/2298251743 conn(0x7f58a40fdee0 msgr2=0x7f58a4100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 -- 172.21.15.47:0/2298251743 shutdown_connections 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 -- 172.21.15.47:0/2298251743 wait complete. 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 Processor -- start 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.117+0000 7f58ab57b640 1 -- start start 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58ab57b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4102580 0x7f58a406af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58ab57b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a4103600 0x7f58a419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58ab57b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a4103fa0 0x7f58a41a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58ab57b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58a410e1e0 con 0x7f58a4102580 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58ab57b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58a410e060 con 0x7f58a4103600 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58ab57b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f58a410e360 con 0x7f58a4103fa0 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4102580 0x7f58a406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4102580 0x7f58a406af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58604/0 (socket says 172.21.15.47:58604) 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 -- 172.21.15.47:0/2574314243 learned_addr learned my addr 172.21.15.47:0/2574314243 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a8b16640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a4103600 0x7f58a419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9b18640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a4103fa0 0x7f58a41a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 -- 172.21.15.47:0/2574314243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a4103fa0 msgr2=0x7f58a41a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a4103fa0 0x7f58a41a1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 -- 172.21.15.47:0/2574314243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a4103600 msgr2=0x7f58a419ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a4103600 0x7f58a419ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 -- 172.21.15.47:0/2574314243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a41a1990 con 0x7f58a4102580 2024-09-21T00:58:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f58a9317640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4102580 0x7f58a406af70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f58a000d950 tx=0x7f58a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.118+0000 7f589a7fc640 1 -- 172.21.15.47:0/2574314243 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0017070 con 0x7f58a4102580 2024-09-21T00:58:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.119+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a41a1c80 con 0x7f58a4102580 2024-09-21T00:58:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.119+0000 7f589a7fc640 1 -- 172.21.15.47:0/2574314243 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58a0009c30 con 0x7f58a4102580 2024-09-21T00:58:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.119+0000 7f589a7fc640 1 -- 172.21.15.47:0/2574314243 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a000f620 con 0x7f58a4102580 2024-09-21T00:58:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.119+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a41a21d0 con 0x7f58a4102580 2024-09-21T00:58:27.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.120+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a4109730 con 0x7f58a4102580 2024-09-21T00:58:27.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.121+0000 7f589a7fc640 1 -- 172.21.15.47:0/2574314243 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f58a0010460 con 0x7f58a4102580 2024-09-21T00:58:27.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.122+0000 7f589a7fc640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f58900b65a0 0x7f58900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.122+0000 7f58a8b16640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f58900b65a0 0x7f58900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.122+0000 7f589a7fc640 1 -- 172.21.15.47:0/2574314243 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f58a00e7100 con 0x7f58a4102580 2024-09-21T00:58:27.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.122+0000 7f58a8b16640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f58900b65a0 0x7f58900b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5894005fd0 tx=0x7f589400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:27.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.125+0000 7f589a7fc640 1 -- 172.21.15.47:0/2574314243 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58a00ad830 con 0x7f58a4102580 2024-09-21T00:58:27.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.314+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f58a402e7d0 con 0x7f58a4102580 2024-09-21T00:58:27.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.315+0000 7f589a7fc640 1 -- 172.21.15.47:0/2574314243 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f58a0009de0 con 0x7f58a4102580 2024-09-21T00:58:27.315 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-09-21T00:58:27.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f58900b65a0 msgr2=0x7f58900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f58900b65a0 0x7f58900b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5894005fd0 tx=0x7f589400b390 comp rx=0 tx=0).stop 2024-09-21T00:58:27.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4102580 msgr2=0x7f58a406af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4102580 0x7f58a406af70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f58a000d950 tx=0x7f58a000de10 comp rx=0 tx=0).stop 2024-09-21T00:58:27.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 shutdown_connections 2024-09-21T00:58:27.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f58900b65a0 0x7f58900b8ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58a4103fa0 0x7f58a41a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58a4103600 0x7f58a419ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 --2- 172.21.15.47:0/2574314243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58a4102580 0x7f58a406af70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 >> 172.21.15.47:0/2574314243 conn(0x7f58a40fdee0 msgr2=0x7f58a4106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:27.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 shutdown_connections 2024-09-21T00:58:27.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.317+0000 7f58ab57b640 1 -- 172.21.15.47:0/2574314243 wait complete. 2024-09-21T00:58:27.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T00:58:27.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1472818083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81036a0 msgr2=0x7fc9e8103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1472818083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81036a0 0x7fc9e8103b10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8009ca0 tx=0x7fc9d802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1472818083 shutdown_connections 2024-09-21T00:58:27.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1472818083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e81050c0 0x7fc9e810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1472818083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e8104720 0x7fc9e8104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1472818083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81036a0 0x7fc9e8103b10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1472818083 >> 172.21.15.47:0/1472818083 conn(0x7fc9e80ff020 msgr2=0x7fc9e8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:27.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1472818083 shutdown_connections 2024-09-21T00:58:27.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.446+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1472818083 wait complete. 2024-09-21T00:58:27.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9ed7f1640 1 Processor -- start 2024-09-21T00:58:27.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9ed7f1640 1 -- start start 2024-09-21T00:58:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9ed7f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e81036a0 0x7fc9e8076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9ed7f1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e8104720 0x7fc9e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9ed7f1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81050c0 0x7fc9e8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9ed7f1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e810f2c0 con 0x7fc9e81050c0 2024-09-21T00:58:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9ed7f1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e810f140 con 0x7fc9e8104720 2024-09-21T00:58:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9ed7f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e810f440 con 0x7fc9e81036a0 2024-09-21T00:58:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81050c0 0x7fc9e8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81050c0 0x7fc9e8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58612/0 (socket says 172.21.15.47:58612) 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e77fe640 1 -- 172.21.15.47:0/1350070456 learned_addr learned my addr 172.21.15.47:0/1350070456 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e67fc640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e8104720 0x7fc9e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e6ffd640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e81036a0 0x7fc9e8076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e77fe640 1 -- 172.21.15.47:0/1350070456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e81036a0 msgr2=0x7fc9e8076e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e77fe640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e81036a0 0x7fc9e8076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e77fe640 1 -- 172.21.15.47:0/1350070456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e8104720 msgr2=0x7fc9e8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e77fe640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e8104720 0x7fc9e8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.447+0000 7fc9e77fe640 1 -- 172.21.15.47:0/1350070456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e8076380 con 0x7fc9e81050c0 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.448+0000 7fc9e67fc640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e8104720 0x7fc9e8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:27.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.448+0000 7fc9e77fe640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81050c0 0x7fc9e8075c50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000d750 tx=0x7fc9e000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.448+0000 7fc9cffff640 1 -- 172.21.15.47:0/1350070456 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0017070 con 0x7fc9e81050c0 2024-09-21T00:58:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.448+0000 7fc9cffff640 1 -- 172.21.15.47:0/1350070456 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e00054d0 con 0x7fc9e81050c0 2024-09-21T00:58:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.448+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e81a3f90 con 0x7fc9e81050c0 2024-09-21T00:58:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.448+0000 7fc9cffff640 1 -- 172.21.15.47:0/1350070456 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0004c60 con 0x7fc9e81050c0 2024-09-21T00:58:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.448+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e81a43a0 con 0x7fc9e81050c0 2024-09-21T00:58:27.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.449+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e8103b10 con 0x7fc9e81050c0 2024-09-21T00:58:27.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.450+0000 7fc9cffff640 1 -- 172.21.15.47:0/1350070456 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fc9e0009bd0 con 0x7fc9e81050c0 2024-09-21T00:58:27.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.451+0000 7fc9cffff640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9d00b65a0 0x7fc9d00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.451+0000 7fc9e6ffd640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9d00b65a0 0x7fc9d00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.451+0000 7fc9cffff640 1 -- 172.21.15.47:0/1350070456 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fc9e00e7240 con 0x7fc9e81050c0 2024-09-21T00:58:27.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.452+0000 7fc9e6ffd640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9d00b65a0 0x7fc9d00b8ab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc9d80094e0 tx=0x7fc9d8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:27.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.454+0000 7fc9cffff640 1 -- 172.21.15.47:0/1350070456 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9e00ada70 con 0x7fc9e81050c0 2024-09-21T00:58:27.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.548+0000 7fc9cffff640 1 -- 172.21.15.47:0/1350070456 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc9e00a95e0 con 0x7fc9e81050c0 2024-09-21T00:58:27.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.650+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc9e802e640 con 0x7fc9e81050c0 2024-09-21T00:58:27.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.651+0000 7fc9cffff640 1 -- 172.21.15.47:0/1350070456 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7fc9e00dda90 con 0x7fc9e81050c0 2024-09-21T00:58:27.652 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-09-21T00:58:27.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9d00b65a0 msgr2=0x7fc9d00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9d00b65a0 0x7fc9d00b8ab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc9d80094e0 tx=0x7fc9d8005fd0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81050c0 msgr2=0x7fc9e8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81050c0 0x7fc9e8075c50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000d750 tx=0x7fc9e000dc10 comp rx=0 tx=0).stop 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 shutdown_connections 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9d00b65a0 0x7fc9d00b8ab0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9e81050c0 0x7fc9e8075c50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9e8104720 0x7fc9e8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 --2- 172.21.15.47:0/1350070456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9e81036a0 0x7fc9e8076e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.653+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 >> 172.21.15.47:0/1350070456 conn(0x7fc9e80ff020 msgr2=0x7fc9e8107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.654+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 shutdown_connections 2024-09-21T00:58:27.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.654+0000 7fc9ed7f1640 1 -- 172.21.15.47:0/1350070456 wait complete. 2024-09-21T00:58:27.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:27 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2760089765' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:27.664 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:27 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2574314243' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:58:27.665 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T00:58:27.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 -- 172.21.15.47:0/376731973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3728102c70 msgr2=0x7f3728105090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 --2- 172.21.15.47:0/376731973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3728102c70 0x7f3728105090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3724009900 tx=0x7f372402a410 comp rx=0 tx=0).stop 2024-09-21T00:58:27.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 -- 172.21.15.47:0/376731973 shutdown_connections 2024-09-21T00:58:27.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 --2- 172.21.15.47:0/376731973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37281082d0 0x7f372810a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 --2- 172.21.15.47:0/376731973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37281056b0 0x7f3728107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 --2- 172.21.15.47:0/376731973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3728102c70 0x7f3728105090 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 -- 172.21.15.47:0/376731973 >> 172.21.15.47:0/376731973 conn(0x7f37280fd660 msgr2=0x7f37280ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 -- 172.21.15.47:0/376731973 shutdown_connections 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.781+0000 7f372fb33640 1 -- 172.21.15.47:0/376731973 wait complete. 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372fb33640 1 Processor -- start 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372fb33640 1 -- start start 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372fb33640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3728102c70 0x7f37281048e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372fb33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37281056b0 0x7f37281031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372fb33640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37281082d0 0x7f37281036e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372fb33640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f372810e1e0 con 0x7f37281082d0 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372fb33640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f372810e060 con 0x7f3728102c70 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372fb33640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f372810e360 con 0x7f37281056b0 2024-09-21T00:58:27.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372e0d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37281082d0 0x7f37281036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372e0d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37281082d0 0x7f37281036e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58622/0 (socket says 172.21.15.47:58622) 2024-09-21T00:58:27.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.782+0000 7f372e0d0640 1 -- 172.21.15.47:0/132733717 learned_addr learned my addr 172.21.15.47:0/132733717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:27.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372d8cf640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3728102c70 0x7f37281048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372d0ce640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37281056b0 0x7f37281031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372e0d0640 1 -- 172.21.15.47:0/132733717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37281056b0 msgr2=0x7f37281031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372e0d0640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37281056b0 0x7f37281031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372e0d0640 1 -- 172.21.15.47:0/132733717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3728102c70 msgr2=0x7f37281048e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372e0d0640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3728102c70 0x7f37281048e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372e0d0640 1 -- 172.21.15.47:0/132733717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3728103e10 con 0x7f37281082d0 2024-09-21T00:58:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372d0ce640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37281056b0 0x7f37281031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372d8cf640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3728102c70 0x7f37281048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372e0d0640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37281082d0 0x7f37281036e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f372000eaa0 tx=0x7f372000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f371effd640 1 -- 172.21.15.47:0/132733717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372000cdb0 con 0x7f37281082d0 2024-09-21T00:58:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f371effd640 1 -- 172.21.15.47:0/132733717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3720005020 con 0x7f37281082d0 2024-09-21T00:58:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37281a3f90 con 0x7f37281082d0 2024-09-21T00:58:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f371effd640 1 -- 172.21.15.47:0/132733717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37200116d0 con 0x7f37281082d0 2024-09-21T00:58:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.783+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37281a43a0 con 0x7f37281082d0 2024-09-21T00:58:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.784+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37281a4660 con 0x7f37281082d0 2024-09-21T00:58:27.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.786+0000 7f371effd640 1 -- 172.21.15.47:0/132733717 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f37200051d0 con 0x7f37281082d0 2024-09-21T00:58:27.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.786+0000 7f371effd640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37140b6590 0x7f37140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:27.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.787+0000 7f372d8cf640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37140b6590 0x7f37140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:27.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.787+0000 7f371effd640 1 -- 172.21.15.47:0/132733717 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f37200e7490 con 0x7f37281082d0 2024-09-21T00:58:27.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.787+0000 7f372d8cf640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37140b6590 0x7f37140b8aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3724031440 tx=0x7f3724005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:27.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.791+0000 7f371effd640 1 -- 172.21.15.47:0/132733717 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3720016030 con 0x7f37281082d0 2024-09-21T00:58:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:27 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2760089765' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:27.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:27 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2574314243' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:58:27.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:27 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2760089765' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:27.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:27 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2574314243' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T00:58:27.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.980+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f37281a4830 con 0x7f37281082d0 2024-09-21T00:58:27.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.981+0000 7f371effd640 1 -- 172.21.15.47:0/132733717 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7f37200addc0 con 0x7f37281082d0 2024-09-21T00:58:27.982 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-09-21T00:58:27.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37140b6590 msgr2=0x7f37140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37140b6590 0x7f37140b8aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3724031440 tx=0x7f3724005d50 comp rx=0 tx=0).stop 2024-09-21T00:58:27.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37281082d0 msgr2=0x7f37281036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:27.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37281082d0 0x7f37281036e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f372000eaa0 tx=0x7f372000ef60 comp rx=0 tx=0).stop 2024-09-21T00:58:27.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 shutdown_connections 2024-09-21T00:58:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f37140b6590 0x7f37140b8aa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37281082d0 0x7f37281036e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37281056b0 0x7f37281031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 --2- 172.21.15.47:0/132733717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3728102c70 0x7f37281048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 >> 172.21.15.47:0/132733717 conn(0x7f37280fd660 msgr2=0x7f3728107890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 shutdown_connections 2024-09-21T00:58:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:27.983+0000 7f372fb33640 1 -- 172.21.15.47:0/132733717 wait complete. 2024-09-21T00:58:27.995 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T00:58:27.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:58:28.253 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:28.656 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:28 smithi047 ceph-mon[30960]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T00:58:28.656 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:28 smithi047 ceph-mon[30960]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:58:28.656 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:28 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1350070456' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:58:28.656 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:28 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/132733717' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:58:28.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 -- 172.21.15.47:0/627576074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc81094a0 msgr2=0x7fdfc81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/627576074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc81094a0 0x7fdfc81098b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009900 tx=0x7fdfb802a410 comp rx=0 tx=0).stop 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 -- 172.21.15.47:0/627576074 shutdown_connections 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/627576074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc8109df0 0x7fdfc8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/627576074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc81094a0 0x7fdfc81098b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/627576074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc8103b60 0x7fdfc8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 -- 172.21.15.47:0/627576074 >> 172.21.15.47:0/627576074 conn(0x7fdfc807b850 msgr2=0x7fdfc807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 -- 172.21.15.47:0/627576074 shutdown_connections 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.749+0000 7fdfd05bf640 1 -- 172.21.15.47:0/627576074 wait complete. 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfd05bf640 1 Processor -- start 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfd05bf640 1 -- start start 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfd05bf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc8103b60 0x7fdfc819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfd05bf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc81094a0 0x7fdfc819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:28.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfd05bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc8109df0 0x7fdfc819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfd05bf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8113ab0 con 0x7fdfc8103b60 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfd05bf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8113930 con 0x7fdfc81094a0 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfd05bf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8113c30 con 0x7fdfc8109df0 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.750+0000 7fdfce35b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc8103b60 0x7fdfc819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfce35b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc8103b60 0x7fdfc819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58636/0 (socket says 172.21.15.47:58636) 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfce35b640 1 -- 172.21.15.47:0/3905494088 learned_addr learned my addr 172.21.15.47:0/3905494088 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfceb5c640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc8109df0 0x7fdfc819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfcdb5a640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc81094a0 0x7fdfc819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfce35b640 1 -- 172.21.15.47:0/3905494088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc8109df0 msgr2=0x7fdfc819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfce35b640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc8109df0 0x7fdfc819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfce35b640 1 -- 172.21.15.47:0/3905494088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc81094a0 msgr2=0x7fdfc819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfce35b640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc81094a0 0x7fdfc819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfce35b640 1 -- 172.21.15.47:0/3905494088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc81a0330 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfcdb5a640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc81094a0 0x7fdfc819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfce35b640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc8103b60 0x7fdfc819a480 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400c920 tx=0x7fdfc400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfbf7fe640 1 -- 172.21.15.47:0/3905494088 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4007c70 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfbf7fe640 1 -- 172.21.15.47:0/3905494088 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfc4007e10 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc81a0620 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfbf7fe640 1 -- 172.21.15.47:0/3905494088 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4018820 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.751+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc81a6e40 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.753+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8103f70 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.754+0000 7fdfbf7fe640 1 -- 172.21.15.47:0/3905494088 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdfc400f450 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.755+0000 7fdfbf7fe640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdfb40b65c0 0x7fdfb40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.755+0000 7fdfcdb5a640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdfb40b65c0 0x7fdfb40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.755+0000 7fdfbf7fe640 1 -- 172.21.15.47:0/3905494088 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fdfc40e73d0 con 0x7fdfc8103b60 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.756+0000 7fdfcdb5a640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdfb40b65c0 0x7fdfb40b8ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8000c00 tx=0x7fdfb8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.760+0000 7fdfbf7fe640 1 -- 172.21.15.47:0/3905494088 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfc4014030 con 0x7fdfc8103b60 2024-09-21T00:58:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:28 smithi134 ceph-mon[34785]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T00:58:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:28 smithi134 ceph-mon[34785]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:58:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:28 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1350070456' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:58:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:28 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/132733717' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:58:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:28 smithi114 ceph-mon[34309]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T00:58:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:28 smithi114 ceph-mon[34309]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T00:58:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:28 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1350070456' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T00:58:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:28 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/132733717' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T00:58:28.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.986+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc819b5b0 con 0x7fdfc8103b60 2024-09-21T00:58:28.988 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:28.988 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:58:28.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.987+0000 7fdfbf7fe640 1 -- 172.21.15.47:0/3905494088 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7fdfc40add00 con 0x7fdfc8103b60 2024-09-21T00:58:28.988 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:58:28.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdfb40b65c0 msgr2=0x7fdfb40b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:28.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdfb40b65c0 0x7fdfb40b8ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8000c00 tx=0x7fdfb8031400 comp rx=0 tx=0).stop 2024-09-21T00:58:28.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc8103b60 msgr2=0x7fdfc819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc8103b60 0x7fdfc819a480 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400c920 tx=0x7fdfc400cde0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 shutdown_connections 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdfb40b65c0 0x7fdfb40b8ad0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc8109df0 0x7fdfc819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc81094a0 0x7fdfc819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 --2- 172.21.15.47:0/3905494088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfc8103b60 0x7fdfc819a480 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.989+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 >> 172.21.15.47:0/3905494088 conn(0x7fdfc807b850 msgr2=0x7fdfc8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.990+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 shutdown_connections 2024-09-21T00:58:28.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:28.990+0000 7fdfd05bf640 1 -- 172.21.15.47:0/3905494088 wait complete. 2024-09-21T00:58:29.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:29 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3905494088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:29.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:29 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3905494088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:29.853 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T00:58:29.853 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T00:58:29.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:58:29.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:29 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3905494088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:29.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 -- 172.21.15.47:0/628510969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3441025a0 msgr2=0x7fc344102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:29.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 --2- 172.21.15.47:0/628510969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3441025a0 0x7fc344102a10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc340009900 tx=0x7fc34002a410 comp rx=0 tx=0).stop 2024-09-21T00:58:29.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 -- 172.21.15.47:0/628510969 shutdown_connections 2024-09-21T00:58:29.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 --2- 172.21.15.47:0/628510969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344103fc0 0x7fc34410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:29.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 --2- 172.21.15.47:0/628510969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc344103620 0x7fc344103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:29.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 --2- 172.21.15.47:0/628510969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3441025a0 0x7fc344102a10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:29.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 -- 172.21.15.47:0/628510969 >> 172.21.15.47:0/628510969 conn(0x7fc3440fdee0 msgr2=0x7fc344100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:29.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 -- 172.21.15.47:0/628510969 shutdown_connections 2024-09-21T00:58:29.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.973+0000 7fc34b070640 1 -- 172.21.15.47:0/628510969 wait complete. 2024-09-21T00:58:29.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34b070640 1 Processor -- start 2024-09-21T00:58:29.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34b070640 1 -- start start 2024-09-21T00:58:29.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34b070640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3441025a0 0x7fc344199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:29.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34b070640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc344103620 0x7fc34419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:29.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34b070640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344103fc0 0x7fc34419b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:29.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34b070640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc34410e1d0 con 0x7fc344103620 2024-09-21T00:58:29.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34b070640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc34410e050 con 0x7fc344103fc0 2024-09-21T00:58:29.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34b070640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc34410e350 con 0x7fc3441025a0 2024-09-21T00:58:29.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc344103620 0x7fc34419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:29.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc344103620 0x7fc34419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58650/0 (socket says 172.21.15.47:58650) 2024-09-21T00:58:29.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc33bfff640 1 -- 172.21.15.47:0/3031148161 learned_addr learned my addr 172.21.15.47:0/3031148161 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:29.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc348e0c640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3441025a0 0x7fc344199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:29.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc34960d640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344103fc0 0x7fc34419b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:29.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc33bfff640 1 -- 172.21.15.47:0/3031148161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3441025a0 msgr2=0x7fc344199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc33bfff640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3441025a0 0x7fc344199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.974+0000 7fc33bfff640 1 -- 172.21.15.47:0/3031148161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344103fc0 msgr2=0x7fc34419b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.975+0000 7fc33bfff640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344103fc0 0x7fc34419b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.975+0000 7fc33bfff640 1 -- 172.21.15.47:0/3031148161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34419b970 con 0x7fc344103620 2024-09-21T00:58:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.975+0000 7fc33bfff640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc344103620 0x7fc34419a5a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d950 tx=0x7fc33400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:29.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.975+0000 7fc339ffb640 1 -- 172.21.15.47:0/3031148161 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334017070 con 0x7fc344103620 2024-09-21T00:58:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.975+0000 7fc339ffb640 1 -- 172.21.15.47:0/3031148161 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc334009c30 con 0x7fc344103620 2024-09-21T00:58:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.975+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34419bc60 con 0x7fc344103620 2024-09-21T00:58:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.975+0000 7fc339ffb640 1 -- 172.21.15.47:0/3031148161 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33400f620 con 0x7fc344103620 2024-09-21T00:58:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.975+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3441a2350 con 0x7fc344103620 2024-09-21T00:58:29.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.976+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3441a2520 con 0x7fc344103620 2024-09-21T00:58:29.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.977+0000 7fc339ffb640 1 -- 172.21.15.47:0/3031148161 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc334010460 con 0x7fc344103620 2024-09-21T00:58:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.979+0000 7fc339ffb640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc32c0b6510 0x7fc32c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.979+0000 7fc348e0c640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc32c0b6510 0x7fc32c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.979+0000 7fc339ffb640 1 -- 172.21.15.47:0/3031148161 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fc3340e6f40 con 0x7fc344103620 2024-09-21T00:58:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.979+0000 7fc348e0c640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc32c0b6510 0x7fc32c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc340031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:29.983+0000 7fc339ffb640 1 -- 172.21.15.47:0/3031148161 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3340ad7d0 con 0x7fc344103620 2024-09-21T00:58:30.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.168+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3440ffe80 con 0x7fc32c0b6510 2024-09-21T00:58:30.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.173+0000 7fc339ffb640 1 -- 172.21.15.47:0/3031148161 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258882 (secure 0 0 0) 0x7fc3440ffe80 con 0x7fc32c0b6510 2024-09-21T00:58:30.176 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:30.177 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-21T00:58:30.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc32c0b6510 msgr2=0x7fc32c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc32c0b6510 0x7fc32c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc340031400 comp rx=0 tx=0).stop 2024-09-21T00:58:30.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc344103620 msgr2=0x7fc34419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc344103620 0x7fc34419a5a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d950 tx=0x7fc33400de10 comp rx=0 tx=0).stop 2024-09-21T00:58:30.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 shutdown_connections 2024-09-21T00:58:30.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc32c0b6510 0x7fc32c0b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc344103fc0 0x7fc34419b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc344103620 0x7fc34419a5a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 --2- 172.21.15.47:0/3031148161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3441025a0 0x7fc344199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 >> 172.21.15.47:0/3031148161 conn(0x7fc3440fdee0 msgr2=0x7fc3440ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:30.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 shutdown_connections 2024-09-21T00:58:30.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.176+0000 7fc34b070640 1 -- 172.21.15.47:0/3031148161 wait complete. 2024-09-21T00:58:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-21T00:58:29.281141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658914,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":273,"num_read_kb":230,"num_write":216,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":608,"ondisk_log_size":608,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381772,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560052,"statfs":{"total":1151940427776,"available":1151549493248,"internally_reserved":0,"allocated":11980800,"data_stored":6801181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":557,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003699"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671519+0000","last_change":"2024-09-21T00:56:48.655444+0000","last_active":"2024-09-21T00:58:25.671519+0000","last_peered":"2024-09-21T00:58:25.671519+0000","last_clean":"2024-09-21T00:58:25.671519+0000","last_became_active":"2024-09-21T00:56:48.655083+0000","last_became_peered":"2024-09-21T00:56:48.655083+0000","last_unstale":"2024-09-21T00:58:25.671519+0000","last_undegraded":"2024-09-21T00:58:25.671519+0000","last_fullsized":"2024-09-21T00:58:25.671519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:07.300682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664410+0000","last_change":"2024-09-21T00:56:48.655066+0000","last_active":"2024-09-21T00:58:25.664410+0000","last_peered":"2024-09-21T00:58:25.664410+0000","last_clean":"2024-09-21T00:58:25.664410+0000","last_became_active":"2024-09-21T00:56:48.654679+0000","last_became_peered":"2024-09-21T00:56:48.654679+0000","last_unstale":"2024-09-21T00:58:25.664410+0000","last_undegraded":"2024-09-21T00:58:25.664410+0000","last_fullsized":"2024-09-21T00:58:25.664410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671983+0000","last_change":"2024-09-21T00:56:48.648770+0000","last_active":"2024-09-21T00:58:25.671983+0000","last_peered":"2024-09-21T00:58:25.671983+0000","last_clean":"2024-09-21T00:58:25.671983+0000","last_became_active":"2024-09-21T00:56:48.648383+0000","last_became_peered":"2024-09-21T00:56:48.648383+0000","last_unstale":"2024-09-21T00:58:25.671983+0000","last_undegraded":"2024-09-21T00:58:25.671983+0000","last_fullsized":"2024-09-21T00:58:25.671983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.616648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658516+0000","last_change":"2024-09-21T00:57:26.767724+0000","last_active":"2024-09-21T00:58:25.658516+0000","last_peered":"2024-09-21T00:58:25.658516+0000","last_clean":"2024-09-21T00:58:25.658516+0000","last_became_active":"2024-09-21T00:57:26.767233+0000","last_became_peered":"2024-09-21T00:57:26.767233+0000","last_unstale":"2024-09-21T00:58:25.658516+0000","last_undegraded":"2024-09-21T00:58:25.658516+0000","last_fullsized":"2024-09-21T00:58:25.658516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:41.905543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661493+0000","last_change":"2024-09-21T00:56:48.654307+0000","last_active":"2024-09-21T00:58:25.661493+0000","last_peered":"2024-09-21T00:58:25.661493+0000","last_clean":"2024-09-21T00:58:25.661493+0000","last_became_active":"2024-09-21T00:56:48.653898+0000","last_became_peered":"2024-09-21T00:56:48.653898+0000","last_unstale":"2024-09-21T00:58:25.661493+0000","last_undegraded":"2024-09-21T00:58:25.661493+0000","last_fullsized":"2024-09-21T00:58:25.661493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.663654+0000","last_change":"2024-09-21T00:56:48.649950+0000","last_active":"2024-09-21T00:58:25.663654+0000","last_peered":"2024-09-21T00:58:25.663654+0000","last_clean":"2024-09-21T00:58:25.663654+0000","last_became_active":"2024-09-21T00:56:48.649305+0000","last_became_peered":"2024-09-21T00:56:48.649305+0000","last_unstale":"2024-09-21T00:58:25.663654+0000","last_undegraded":"2024-09-21T00:58:25.663654+0000","last_fullsized":"2024-09-21T00:58:25.663654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:56.456377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.656095+0000","last_change":"2024-09-21T00:56:48.656109+0000","last_active":"2024-09-21T00:58:25.656095+0000","last_peered":"2024-09-21T00:58:25.656095+0000","last_clean":"2024-09-21T00:58:25.656095+0000","last_became_active":"2024-09-21T00:56:48.654465+0000","last_became_peered":"2024-09-21T00:56:48.654465+0000","last_unstale":"2024-09-21T00:58:25.656095+0000","last_undegraded":"2024-09-21T00:58:25.656095+0000","last_fullsized":"2024-09-21T00:58:25.656095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:05.779845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667128+0000","last_change":"2024-09-21T00:56:48.656351+0000","last_active":"2024-09-21T00:58:25.667128+0000","last_peered":"2024-09-21T00:58:25.667128+0000","last_clean":"2024-09-21T00:58:25.667128+0000","last_became_active":"2024-09-21T00:56:48.654388+0000","last_became_peered":"2024-09-21T00:56:48.654388+0000","last_unstale":"2024-09-21T00:58:25.667128+0000","last_undegraded":"2024-09-21T00:58:25.667128+0000","last_fullsized":"2024-09-21T00:58:25.667128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:39.441882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764916+0000","last_change":"2024-09-21T00:56:48.661083+0000","last_active":"2024-09-21T00:57:26.764916+0000","last_peered":"2024-09-21T00:57:26.764916+0000","last_clean":"2024-09-21T00:57:26.764916+0000","last_became_active":"2024-09-21T00:56:48.660418+0000","last_became_peered":"2024-09-21T00:56:48.660418+0000","last_unstale":"2024-09-21T00:57:26.764916+0000","last_undegraded":"2024-09-21T00:57:26.764916+0000","last_fullsized":"2024-09-21T00:57:26.764916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:02.494368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664867+0000","last_change":"2024-09-21T00:56:48.660257+0000","last_active":"2024-09-21T00:58:25.664867+0000","last_peered":"2024-09-21T00:58:25.664867+0000","last_clean":"2024-09-21T00:58:25.664867+0000","last_became_active":"2024-09-21T00:56:48.659894+0000","last_became_peered":"2024-09-21T00:56:48.659894+0000","last_unstale":"2024-09-21T00:58:25.664867+0000","last_undegraded":"2024-09-21T00:58:25.664867+0000","last_fullsized":"2024-09-21T00:58:25.664867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.012107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665538+0000","last_change":"2024-09-21T00:56:48.653146+0000","last_active":"2024-09-21T00:58:25.665538+0000","last_peered":"2024-09-21T00:58:25.665538+0000","last_clean":"2024-09-21T00:58:25.665538+0000","last_became_active":"2024-09-21T00:56:48.652599+0000","last_became_peered":"2024-09-21T00:56:48.652599+0000","last_unstale":"2024-09-21T00:58:25.665538+0000","last_undegraded":"2024-09-21T00:58:25.665538+0000","last_fullsized":"2024-09-21T00:58:25.665538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:16.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655296+0000","last_change":"2024-09-21T00:56:48.659521+0000","last_active":"2024-09-21T00:58:25.655296+0000","last_peered":"2024-09-21T00:58:25.655296+0000","last_clean":"2024-09-21T00:58:25.655296+0000","last_became_active":"2024-09-21T00:56:48.658168+0000","last_became_peered":"2024-09-21T00:56:48.658168+0000","last_unstale":"2024-09-21T00:58:25.655296+0000","last_undegraded":"2024-09-21T00:58:25.655296+0000","last_fullsized":"2024-09-21T00:58:25.655296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:51.910450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665640+0000","last_change":"2024-09-21T00:56:48.652163+0000","last_active":"2024-09-21T00:58:25.665640+0000","last_peered":"2024-09-21T00:58:25.665640+0000","last_clean":"2024-09-21T00:58:25.665640+0000","last_became_active":"2024-09-21T00:56:48.651839+0000","last_became_peered":"2024-09-21T00:56:48.651839+0000","last_unstale":"2024-09-21T00:58:25.665640+0000","last_undegraded":"2024-09-21T00:58:25.665640+0000","last_fullsized":"2024-09-21T00:58:25.665640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:50.682747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.663614+0000","last_change":"2024-09-21T00:56:48.655106+0000","last_active":"2024-09-21T00:58:25.663614+0000","last_peered":"2024-09-21T00:58:25.663614+0000","last_clean":"2024-09-21T00:58:25.663614+0000","last_became_active":"2024-09-21T00:56:48.654722+0000","last_became_peered":"2024-09-21T00:56:48.654722+0000","last_unstale":"2024-09-21T00:58:25.663614+0000","last_undegraded":"2024-09-21T00:58:25.663614+0000","last_fullsized":"2024-09-21T00:58:25.663614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:36.023960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658630+0000","last_change":"2024-09-21T00:56:48.648935+0000","last_active":"2024-09-21T00:58:25.658630+0000","last_peered":"2024-09-21T00:58:25.658630+0000","last_clean":"2024-09-21T00:58:25.658630+0000","last_became_active":"2024-09-21T00:56:48.648557+0000","last_became_peered":"2024-09-21T00:56:48.648557+0000","last_unstale":"2024-09-21T00:58:25.658630+0000","last_undegraded":"2024-09-21T00:58:25.658630+0000","last_fullsized":"2024-09-21T00:58:25.658630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:17.791401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764496+0000","last_change":"2024-09-21T00:56:48.651338+0000","last_active":"2024-09-21T00:57:26.764496+0000","last_peered":"2024-09-21T00:57:26.764496+0000","last_clean":"2024-09-21T00:57:26.764496+0000","last_became_active":"2024-09-21T00:56:48.650940+0000","last_became_peered":"2024-09-21T00:56:48.650940+0000","last_unstale":"2024-09-21T00:57:26.764496+0000","last_undegraded":"2024-09-21T00:57:26.764496+0000","last_fullsized":"2024-09-21T00:57:26.764496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671778+0000","last_change":"2024-09-21T00:56:48.655091+0000","last_active":"2024-09-21T00:58:25.671778+0000","last_peered":"2024-09-21T00:58:25.671778+0000","last_clean":"2024-09-21T00:58:25.671778+0000","last_became_active":"2024-09-21T00:56:48.654534+0000","last_became_peered":"2024-09-21T00:56:48.654534+0000","last_unstale":"2024-09-21T00:58:25.671778+0000","last_undegraded":"2024-09-21T00:58:25.671778+0000","last_fullsized":"2024-09-21T00:58:25.671778+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:44.007171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.674445+0000","last_change":"2024-09-21T00:56:48.654933+0000","last_active":"2024-09-21T00:58:25.674445+0000","last_peered":"2024-09-21T00:58:25.674445+0000","last_clean":"2024-09-21T00:58:25.674445+0000","last_became_active":"2024-09-21T00:56:48.654523+0000","last_became_peered":"2024-09-21T00:56:48.654523+0000","last_unstale":"2024-09-21T00:58:25.674445+0000","last_undegraded":"2024-09-21T00:58:25.674445+0000","last_fullsized":"2024-09-21T00:58:25.674445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:58.190118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658456+0000","last_change":"2024-09-21T00:56:48.645166+0000","last_active":"2024-09-21T00:58:25.658456+0000","last_peered":"2024-09-21T00:58:25.658456+0000","last_clean":"2024-09-21T00:58:25.658456+0000","last_became_active":"2024-09-21T00:56:48.644695+0000","last_became_peered":"2024-09-21T00:56:48.644695+0000","last_unstale":"2024-09-21T00:58:25.658456+0000","last_undegraded":"2024-09-21T00:58:25.658456+0000","last_fullsized":"2024-09-21T00:58:25.658456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:07.564405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.662258+0000","last_change":"2024-09-21T00:56:48.659215+0000","last_active":"2024-09-21T00:58:25.662258+0000","last_peered":"2024-09-21T00:58:25.662258+0000","last_clean":"2024-09-21T00:58:25.662258+0000","last_became_active":"2024-09-21T00:56:48.658783+0000","last_became_peered":"2024-09-21T00:56:48.658783+0000","last_unstale":"2024-09-21T00:58:25.662258+0000","last_undegraded":"2024-09-21T00:58:25.662258+0000","last_fullsized":"2024-09-21T00:58:25.662258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:08:58.663963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.674676+0000","last_change":"2024-09-21T00:56:48.644461+0000","last_active":"2024-09-21T00:58:25.674676+0000","last_peered":"2024-09-21T00:58:25.674676+0000","last_clean":"2024-09-21T00:58:25.674676+0000","last_became_active":"2024-09-21T00:56:48.643842+0000","last_became_peered":"2024-09-21T00:56:48.643842+0000","last_unstale":"2024-09-21T00:58:25.674676+0000","last_undegraded":"2024-09-21T00:58:25.674676+0000","last_fullsized":"2024-09-21T00:58:25.674676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:12.673501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764701+0000","last_change":"2024-09-21T00:56:48.651212+0000","last_active":"2024-09-21T00:57:26.764701+0000","last_peered":"2024-09-21T00:57:26.764701+0000","last_clean":"2024-09-21T00:57:26.764701+0000","last_became_active":"2024-09-21T00:56:48.650802+0000","last_became_peered":"2024-09-21T00:56:48.650802+0000","last_unstale":"2024-09-21T00:57:26.764701+0000","last_undegraded":"2024-09-21T00:57:26.764701+0000","last_fullsized":"2024-09-21T00:57:26.764701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:06.310898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661035+0000","last_change":"2024-09-21T00:56:48.647772+0000","last_active":"2024-09-21T00:58:25.661035+0000","last_peered":"2024-09-21T00:58:25.661035+0000","last_clean":"2024-09-21T00:58:25.661035+0000","last_became_active":"2024-09-21T00:56:48.647379+0000","last_became_peered":"2024-09-21T00:56:48.647379+0000","last_unstale":"2024-09-21T00:58:25.661035+0000","last_undegraded":"2024-09-21T00:58:25.661035+0000","last_fullsized":"2024-09-21T00:58:25.661035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:06.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660811+0000","last_change":"2024-09-21T00:56:48.655841+0000","last_active":"2024-09-21T00:58:25.660811+0000","last_peered":"2024-09-21T00:58:25.660811+0000","last_clean":"2024-09-21T00:58:25.660811+0000","last_became_active":"2024-09-21T00:56:48.655270+0000","last_became_peered":"2024-09-21T00:56:48.655270+0000","last_unstale":"2024-09-21T00:58:25.660811+0000","last_undegraded":"2024-09-21T00:58:25.660811+0000","last_fullsized":"2024-09-21T00:58:25.660811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:28.350627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661443+0000","last_change":"2024-09-21T00:56:48.659457+0000","last_active":"2024-09-21T00:58:25.661443+0000","last_peered":"2024-09-21T00:58:25.661443+0000","last_clean":"2024-09-21T00:58:25.661443+0000","last_became_active":"2024-09-21T00:56:48.658999+0000","last_became_peered":"2024-09-21T00:56:48.658999+0000","last_unstale":"2024-09-21T00:58:25.661443+0000","last_undegraded":"2024-09-21T00:58:25.661443+0000","last_fullsized":"2024-09-21T00:58:25.661443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:56.196167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655752+0000","last_change":"2024-09-21T00:56:48.656361+0000","last_active":"2024-09-21T00:58:25.655752+0000","last_peered":"2024-09-21T00:58:25.655752+0000","last_clean":"2024-09-21T00:58:25.655752+0000","last_became_active":"2024-09-21T00:56:48.655999+0000","last_became_peered":"2024-09-21T00:56:48.655999+0000","last_unstale":"2024-09-21T00:58:25.655752+0000","last_undegraded":"2024-09-21T00:58:25.655752+0000","last_fullsized":"2024-09-21T00:58:25.655752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:46.533280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659095+0000","last_change":"2024-09-21T00:56:48.656549+0000","last_active":"2024-09-21T00:58:25.659095+0000","last_peered":"2024-09-21T00:58:25.659095+0000","last_clean":"2024-09-21T00:58:25.659095+0000","last_became_active":"2024-09-21T00:56:48.656154+0000","last_became_peered":"2024-09-21T00:56:48.656154+0000","last_unstale":"2024-09-21T00:58:25.659095+0000","last_undegraded":"2024-09-21T00:58:25.659095+0000","last_fullsized":"2024-09-21T00:58:25.659095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:37.244726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665129+0000","last_change":"2024-09-21T00:56:48.645857+0000","last_active":"2024-09-21T00:58:25.665129+0000","last_peered":"2024-09-21T00:58:25.665129+0000","last_clean":"2024-09-21T00:58:25.665129+0000","last_became_active":"2024-09-21T00:56:48.644462+0000","last_became_peered":"2024-09-21T00:56:48.644462+0000","last_unstale":"2024-09-21T00:58:25.665129+0000","last_undegraded":"2024-09-21T00:58:25.665129+0000","last_fullsized":"2024-09-21T00:58:25.665129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:11.690074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661786+0000","last_change":"2024-09-21T00:56:48.649937+0000","last_active":"2024-09-21T00:58:25.661786+0000","last_peered":"2024-09-21T00:58:25.661786+0000","last_clean":"2024-09-21T00:58:25.661786+0000","last_became_active":"2024-09-21T00:56:48.649233+0000","last_became_peered":"2024-09-21T00:56:48.649233+0000","last_unstale":"2024-09-21T00:58:25.661786+0000","last_undegraded":"2024-09-21T00:58:25.661786+0000","last_fullsized":"2024-09-21T00:58:25.661786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:00.529143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658465+0000","last_change":"2024-09-21T00:56:48.645824+0000","last_active":"2024-09-21T00:58:25.658465+0000","last_peered":"2024-09-21T00:58:25.658465+0000","last_clean":"2024-09-21T00:58:25.658465+0000","last_became_active":"2024-09-21T00:56:48.645452+0000","last_became_peered":"2024-09-21T00:56:48.645452+0000","last_unstale":"2024-09-21T00:58:25.658465+0000","last_undegraded":"2024-09-21T00:58:25.658465+0000","last_fullsized":"2024-09-21T00:58:25.658465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:40.228469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658560+0000","last_change":"2024-09-21T00:57:26.769121+0000","last_active":"2024-09-21T00:58:25.658560+0000","last_peered":"2024-09-21T00:58:25.658560+0000","last_clean":"2024-09-21T00:58:25.658560+0000","last_became_active":"2024-09-21T00:57:26.768532+0000","last_became_peered":"2024-09-21T00:57:26.768532+0000","last_unstale":"2024-09-21T00:58:25.658560+0000","last_undegraded":"2024-09-21T00:58:25.658560+0000","last_fullsized":"2024-09-21T00:58:25.658560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:57.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658300+0000","last_change":"2024-09-21T00:56:48.656431+0000","last_active":"2024-09-21T00:58:25.658300+0000","last_peered":"2024-09-21T00:58:25.658300+0000","last_clean":"2024-09-21T00:58:25.658300+0000","last_became_active":"2024-09-21T00:56:48.656080+0000","last_became_peered":"2024-09-21T00:56:48.656080+0000","last_unstale":"2024-09-21T00:58:25.658300+0000","last_undegraded":"2024-09-21T00:58:25.658300+0000","last_fullsized":"2024-09-21T00:58:25.658300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:00.068094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655004+0000","last_change":"2024-09-21T00:56:48.653355+0000","last_active":"2024-09-21T00:58:25.655004+0000","last_peered":"2024-09-21T00:58:25.655004+0000","last_clean":"2024-09-21T00:58:25.655004+0000","last_became_active":"2024-09-21T00:56:48.652959+0000","last_became_peered":"2024-09-21T00:56:48.652959+0000","last_unstale":"2024-09-21T00:58:25.655004+0000","last_undegraded":"2024-09-21T00:58:25.655004+0000","last_fullsized":"2024-09-21T00:58:25.655004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:16.462806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770600+0000","last_change":"2024-09-21T00:56:46.634744+0000","last_active":"2024-09-21T00:57:26.770600+0000","last_peered":"2024-09-21T00:57:26.770600+0000","last_clean":"2024-09-21T00:57:26.770600+0000","last_became_active":"2024-09-21T00:56:46.634367+0000","last_became_peered":"2024-09-21T00:56:46.634367+0000","last_unstale":"2024-09-21T00:57:26.770600+0000","last_undegraded":"2024-09-21T00:57:26.770600+0000","last_fullsized":"2024-09-21T00:57:26.770600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:40.923450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661063+0000","last_change":"2024-09-21T00:56:48.660277+0000","last_active":"2024-09-21T00:58:25.661063+0000","last_peered":"2024-09-21T00:58:25.661063+0000","last_clean":"2024-09-21T00:58:25.661063+0000","last_became_active":"2024-09-21T00:56:48.659491+0000","last_became_peered":"2024-09-21T00:56:48.659491+0000","last_unstale":"2024-09-21T00:58:25.661063+0000","last_undegraded":"2024-09-21T00:58:25.661063+0000","last_fullsized":"2024-09-21T00:58:25.661063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:39.032704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858813+0000","last_change":"2024-09-21T00:56:46.634466+0000","last_active":"2024-09-21T00:57:26.858813+0000","last_peered":"2024-09-21T00:57:26.858813+0000","last_clean":"2024-09-21T00:57:26.858813+0000","last_became_active":"2024-09-21T00:56:46.634031+0000","last_became_peered":"2024-09-21T00:56:46.634031+0000","last_unstale":"2024-09-21T00:57:26.858813+0000","last_undegraded":"2024-09-21T00:57:26.858813+0000","last_fullsized":"2024-09-21T00:57:26.858813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:49.691014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858552+0000","last_change":"2024-09-21T00:56:46.628156+0000","last_active":"2024-09-21T00:57:26.858552+0000","last_peered":"2024-09-21T00:57:26.858552+0000","last_clean":"2024-09-21T00:57:26.858552+0000","last_became_active":"2024-09-21T00:56:46.627735+0000","last_became_peered":"2024-09-21T00:56:46.627735+0000","last_unstale":"2024-09-21T00:57:26.858552+0000","last_undegraded":"2024-09-21T00:57:26.858552+0000","last_fullsized":"2024-09-21T00:57:26.858552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:55.188016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660845+0000","last_change":"2024-09-21T00:56:48.649571+0000","last_active":"2024-09-21T00:58:25.660845+0000","last_peered":"2024-09-21T00:58:25.660845+0000","last_clean":"2024-09-21T00:58:25.660845+0000","last_became_active":"2024-09-21T00:56:48.647345+0000","last_became_peered":"2024-09-21T00:56:48.647345+0000","last_unstale":"2024-09-21T00:58:25.660845+0000","last_undegraded":"2024-09-21T00:58:25.660845+0000","last_fullsized":"2024-09-21T00:58:25.660845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:43.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770076+0000","last_change":"2024-09-21T00:56:46.634886+0000","last_active":"2024-09-21T00:57:26.770076+0000","last_peered":"2024-09-21T00:57:26.770076+0000","last_clean":"2024-09-21T00:57:26.770076+0000","last_became_active":"2024-09-21T00:56:46.634481+0000","last_became_peered":"2024-09-21T00:56:46.634481+0000","last_unstale":"2024-09-21T00:57:26.770076+0000","last_undegraded":"2024-09-21T00:57:26.770076+0000","last_fullsized":"2024-09-21T00:57:26.770076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:15.062776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.666669+0000","last_change":"2024-09-21T00:56:48.655740+0000","last_active":"2024-09-21T00:58:25.666669+0000","last_peered":"2024-09-21T00:58:25.666669+0000","last_clean":"2024-09-21T00:58:25.666669+0000","last_became_active":"2024-09-21T00:56:48.655312+0000","last_became_peered":"2024-09-21T00:56:48.655312+0000","last_unstale":"2024-09-21T00:58:25.666669+0000","last_undegraded":"2024-09-21T00:58:25.666669+0000","last_fullsized":"2024-09-21T00:58:25.666669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.815954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859165+0000","last_change":"2024-09-21T00:56:46.636212+0000","last_active":"2024-09-21T00:57:26.859165+0000","last_peered":"2024-09-21T00:57:26.859165+0000","last_clean":"2024-09-21T00:57:26.859165+0000","last_became_active":"2024-09-21T00:56:46.635702+0000","last_became_peered":"2024-09-21T00:56:46.635702+0000","last_unstale":"2024-09-21T00:57:26.859165+0000","last_undegraded":"2024-09-21T00:57:26.859165+0000","last_fullsized":"2024-09-21T00:57:26.859165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:11.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765366+0000","last_change":"2024-09-21T00:56:48.646300+0000","last_active":"2024-09-21T00:57:26.765366+0000","last_peered":"2024-09-21T00:57:26.765366+0000","last_clean":"2024-09-21T00:57:26.765366+0000","last_became_active":"2024-09-21T00:56:48.645906+0000","last_became_peered":"2024-09-21T00:56:48.645906+0000","last_unstale":"2024-09-21T00:57:26.765366+0000","last_undegraded":"2024-09-21T00:57:26.765366+0000","last_fullsized":"2024-09-21T00:57:26.765366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:47.593609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766522+0000","last_change":"2024-09-21T00:56:46.639405+0000","last_active":"2024-09-21T00:57:26.766522+0000","last_peered":"2024-09-21T00:57:26.766522+0000","last_clean":"2024-09-21T00:57:26.766522+0000","last_became_active":"2024-09-21T00:56:46.638659+0000","last_became_peered":"2024-09-21T00:56:46.638659+0000","last_unstale":"2024-09-21T00:57:26.766522+0000","last_undegraded":"2024-09-21T00:57:26.766522+0000","last_fullsized":"2024-09-21T00:57:26.766522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:19.718585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.651971+0000","last_change":"2024-09-21T00:56:48.657572+0000","last_active":"2024-09-21T00:58:25.651971+0000","last_peered":"2024-09-21T00:58:25.651971+0000","last_clean":"2024-09-21T00:58:25.651971+0000","last_became_active":"2024-09-21T00:56:48.657219+0000","last_became_peered":"2024-09-21T00:56:48.657219+0000","last_unstale":"2024-09-21T00:58:25.651971+0000","last_undegraded":"2024-09-21T00:58:25.651971+0000","last_fullsized":"2024-09-21T00:58:25.651971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:48.870835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770265+0000","last_change":"2024-09-21T00:56:46.642710+0000","last_active":"2024-09-21T00:57:26.770265+0000","last_peered":"2024-09-21T00:57:26.770265+0000","last_clean":"2024-09-21T00:57:26.770265+0000","last_became_active":"2024-09-21T00:56:46.642273+0000","last_became_peered":"2024-09-21T00:56:46.642273+0000","last_unstale":"2024-09-21T00:57:26.770265+0000","last_undegraded":"2024-09-21T00:57:26.770265+0000","last_fullsized":"2024-09-21T00:57:26.770265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.751651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.860956+0000","last_change":"2024-09-21T00:57:26.860826+0000","last_active":"2024-09-21T00:57:26.860956+0000","last_peered":"2024-09-21T00:57:26.860956+0000","last_clean":"2024-09-21T00:57:26.860956+0000","last_became_active":"2024-09-21T00:57:26.860389+0000","last_became_peered":"2024-09-21T00:57:26.860389+0000","last_unstale":"2024-09-21T00:57:26.860956+0000","last_undegraded":"2024-09-21T00:57:26.860956+0000","last_fullsized":"2024-09-21T00:57:26.860956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:52.229655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'31","reported_seq":247,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:26.675080+0000","last_change":"2024-09-21T00:56:46.639555+0000","last_active":"2024-09-21T00:58:26.675080+0000","last_peered":"2024-09-21T00:58:26.675080+0000","last_clean":"2024-09-21T00:58:26.675080+0000","last_became_active":"2024-09-21T00:56:46.639200+0000","last_became_peered":"2024-09-21T00:56:46.639200+0000","last_unstale":"2024-09-21T00:58:26.675080+0000","last_undegraded":"2024-09-21T00:58:26.675080+0000","last_fullsized":"2024-09-21T00:58:26.675080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:49.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67514,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":193,"num_read_kb":162,"num_write":31,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659583+0000","last_change":"2024-09-21T00:56:48.653950+0000","last_active":"2024-09-21T00:58:25.659583+0000","last_peered":"2024-09-21T00:58:25.659583+0000","last_clean":"2024-09-21T00:58:25.659583+0000","last_became_active":"2024-09-21T00:56:48.653570+0000","last_became_peered":"2024-09-21T00:56:48.653570+0000","last_unstale":"2024-09-21T00:58:25.659583+0000","last_undegraded":"2024-09-21T00:58:25.659583+0000","last_fullsized":"2024-09-21T00:58:25.659583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:43.708982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766728+0000","last_change":"2024-09-21T00:56:46.635861+0000","last_active":"2024-09-21T00:57:26.766728+0000","last_peered":"2024-09-21T00:57:26.766728+0000","last_clean":"2024-09-21T00:57:26.766728+0000","last_became_active":"2024-09-21T00:56:46.635452+0000","last_became_peered":"2024-09-21T00:56:46.635452+0000","last_unstale":"2024-09-21T00:57:26.766728+0000","last_undegraded":"2024-09-21T00:57:26.766728+0000","last_fullsized":"2024-09-21T00:57:26.766728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:15.591100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.670846+0000","last_change":"2024-09-21T00:56:48.645567+0000","last_active":"2024-09-21T00:58:25.670846+0000","last_peered":"2024-09-21T00:58:25.670846+0000","last_clean":"2024-09-21T00:58:25.670846+0000","last_became_active":"2024-09-21T00:56:48.644499+0000","last_became_peered":"2024-09-21T00:56:48.644499+0000","last_unstale":"2024-09-21T00:58:25.670846+0000","last_undegraded":"2024-09-21T00:58:25.670846+0000","last_fullsized":"2024-09-21T00:58:25.670846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:08.655065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770242+0000","last_change":"2024-09-21T00:56:46.633014+0000","last_active":"2024-09-21T00:57:26.770242+0000","last_peered":"2024-09-21T00:57:26.770242+0000","last_clean":"2024-09-21T00:57:26.770242+0000","last_became_active":"2024-09-21T00:56:46.632656+0000","last_became_peered":"2024-09-21T00:56:46.632656+0000","last_unstale":"2024-09-21T00:57:26.770242+0000","last_undegraded":"2024-09-21T00:57:26.770242+0000","last_fullsized":"2024-09-21T00:57:26.770242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:46.270469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.673476+0000","last_change":"2024-09-21T00:56:48.659797+0000","last_active":"2024-09-21T00:58:25.673476+0000","last_peered":"2024-09-21T00:58:25.673476+0000","last_clean":"2024-09-21T00:58:25.673476+0000","last_became_active":"2024-09-21T00:56:48.659430+0000","last_became_peered":"2024-09-21T00:56:48.659430+0000","last_unstale":"2024-09-21T00:58:25.673476+0000","last_undegraded":"2024-09-21T00:58:25.673476+0000","last_fullsized":"2024-09-21T00:58:25.673476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:45.006414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766061+0000","last_change":"2024-09-21T00:56:46.636792+0000","last_active":"2024-09-21T00:57:26.766061+0000","last_peered":"2024-09-21T00:57:26.766061+0000","last_clean":"2024-09-21T00:57:26.766061+0000","last_became_active":"2024-09-21T00:56:46.636383+0000","last_became_peered":"2024-09-21T00:56:46.636383+0000","last_unstale":"2024-09-21T00:57:26.766061+0000","last_undegraded":"2024-09-21T00:57:26.766061+0000","last_fullsized":"2024-09-21T00:57:26.766061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:37.078166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655806+0000","last_change":"2024-09-21T00:56:48.657065+0000","last_active":"2024-09-21T00:58:25.655806+0000","last_peered":"2024-09-21T00:58:25.655806+0000","last_clean":"2024-09-21T00:58:25.655806+0000","last_became_active":"2024-09-21T00:56:48.656658+0000","last_became_peered":"2024-09-21T00:56:48.656658+0000","last_unstale":"2024-09-21T00:58:25.655806+0000","last_undegraded":"2024-09-21T00:58:25.655806+0000","last_fullsized":"2024-09-21T00:58:25.655806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:31.713457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761028+0000","last_change":"2024-09-21T00:56:46.642099+0000","last_active":"2024-09-21T00:57:26.761028+0000","last_peered":"2024-09-21T00:57:26.761028+0000","last_clean":"2024-09-21T00:57:26.761028+0000","last_became_active":"2024-09-21T00:56:46.641526+0000","last_became_peered":"2024-09-21T00:56:46.641526+0000","last_unstale":"2024-09-21T00:57:26.761028+0000","last_undegraded":"2024-09-21T00:57:26.761028+0000","last_fullsized":"2024-09-21T00:57:26.761028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:12.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665383+0000","last_change":"2024-09-21T00:56:48.660991+0000","last_active":"2024-09-21T00:58:25.665383+0000","last_peered":"2024-09-21T00:58:25.665383+0000","last_clean":"2024-09-21T00:58:25.665383+0000","last_became_active":"2024-09-21T00:56:48.660623+0000","last_became_peered":"2024-09-21T00:56:48.660623+0000","last_unstale":"2024-09-21T00:58:25.665383+0000","last_undegraded":"2024-09-21T00:58:25.665383+0000","last_fullsized":"2024-09-21T00:58:25.665383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:34.291977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761592+0000","last_change":"2024-09-21T00:56:46.637482+0000","last_active":"2024-09-21T00:57:26.761592+0000","last_peered":"2024-09-21T00:57:26.761592+0000","last_clean":"2024-09-21T00:57:26.761592+0000","last_became_active":"2024-09-21T00:56:46.634812+0000","last_became_peered":"2024-09-21T00:56:46.634812+0000","last_unstale":"2024-09-21T00:57:26.761592+0000","last_undegraded":"2024-09-21T00:57:26.761592+0000","last_fullsized":"2024-09-21T00:57:26.761592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:30.990625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659724+0000","last_change":"2024-09-21T00:56:48.658930+0000","last_active":"2024-09-21T00:58:25.659724+0000","last_peered":"2024-09-21T00:58:25.659724+0000","last_clean":"2024-09-21T00:58:25.659724+0000","last_became_active":"2024-09-21T00:56:48.658545+0000","last_became_peered":"2024-09-21T00:56:48.658545+0000","last_unstale":"2024-09-21T00:58:25.659724+0000","last_undegraded":"2024-09-21T00:58:25.659724+0000","last_fullsized":"2024-09-21T00:58:25.659724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:30:57.850371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859892+0000","last_change":"2024-09-21T00:56:46.628768+0000","last_active":"2024-09-21T00:57:26.859892+0000","last_peered":"2024-09-21T00:57:26.859892+0000","last_clean":"2024-09-21T00:57:26.859892+0000","last_became_active":"2024-09-21T00:56:46.628374+0000","last_became_peered":"2024-09-21T00:56:46.628374+0000","last_unstale":"2024-09-21T00:57:26.859892+0000","last_undegraded":"2024-09-21T00:57:26.859892+0000","last_fullsized":"2024-09-21T00:57:26.859892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:58:15.133651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664902+0000","last_change":"2024-09-21T00:56:48.648097+0000","last_active":"2024-09-21T00:58:25.664902+0000","last_peered":"2024-09-21T00:58:25.664902+0000","last_clean":"2024-09-21T00:58:25.664902+0000","last_became_active":"2024-09-21T00:56:48.647619+0000","last_became_peered":"2024-09-21T00:56:48.647619+0000","last_unstale":"2024-09-21T00:58:25.664902+0000","last_undegraded":"2024-09-21T00:58:25.664902+0000","last_fullsized":"2024-09-21T00:58:25.664902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:08.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770460+0000","last_change":"2024-09-21T00:56:46.636947+0000","last_active":"2024-09-21T00:57:26.770460+0000","last_peered":"2024-09-21T00:57:26.770460+0000","last_clean":"2024-09-21T00:57:26.770460+0000","last_became_active":"2024-09-21T00:56:46.636469+0000","last_became_peered":"2024-09-21T00:56:46.636469+0000","last_unstale":"2024-09-21T00:57:26.770460+0000","last_undegraded":"2024-09-21T00:57:26.770460+0000","last_fullsized":"2024-09-21T00:57:26.770460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:31.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655895+0000","last_change":"2024-09-21T00:57:26.774145+0000","last_active":"2024-09-21T00:58:25.655895+0000","last_peered":"2024-09-21T00:58:25.655895+0000","last_clean":"2024-09-21T00:58:25.655895+0000","last_became_active":"2024-09-21T00:57:26.770919+0000","last_became_peered":"2024-09-21T00:57:26.770919+0000","last_unstale":"2024-09-21T00:58:25.655895+0000","last_undegraded":"2024-09-21T00:58:25.655895+0000","last_fullsized":"2024-09-21T00:58:25.655895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:21.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766495+0000","last_change":"2024-09-21T00:56:47.391206+0000","last_active":"2024-09-21T00:57:26.766495+0000","last_peered":"2024-09-21T00:57:26.766495+0000","last_clean":"2024-09-21T00:57:26.766495+0000","last_became_active":"2024-09-21T00:56:47.390708+0000","last_became_peered":"2024-09-21T00:56:47.390708+0000","last_unstale":"2024-09-21T00:57:26.766495+0000","last_undegraded":"2024-09-21T00:57:26.766495+0000","last_fullsized":"2024-09-21T00:57:26.766495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:59.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665899+0000","last_change":"2024-09-21T00:56:48.648452+0000","last_active":"2024-09-21T00:58:25.665899+0000","last_peered":"2024-09-21T00:58:25.665899+0000","last_clean":"2024-09-21T00:58:25.665899+0000","last_became_active":"2024-09-21T00:56:48.647682+0000","last_became_peered":"2024-09-21T00:56:48.647682+0000","last_unstale":"2024-09-21T00:58:25.665899+0000","last_undegraded":"2024-09-21T00:58:25.665899+0000","last_fullsized":"2024-09-21T00:58:25.665899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:45.844596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767189+0000","last_change":"2024-09-21T00:55:37.551147+0000","last_active":"2024-09-21T00:57:26.767189+0000","last_peered":"2024-09-21T00:57:26.767189+0000","last_clean":"2024-09-21T00:57:26.767189+0000","last_became_active":"2024-09-21T00:55:37.545124+0000","last_became_peered":"2024-09-21T00:55:37.545124+0000","last_unstale":"2024-09-21T00:57:26.767189+0000","last_undegraded":"2024-09-21T00:57:26.767189+0000","last_fullsized":"2024-09-21T00:57:26.767189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_clean_scrub_stamp":"2024-09-21T00:52:17.996374+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:20.205607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766410+0000","last_change":"2024-09-21T00:56:46.637264+0000","last_active":"2024-09-21T00:57:26.766410+0000","last_peered":"2024-09-21T00:57:26.766410+0000","last_clean":"2024-09-21T00:57:26.766410+0000","last_became_active":"2024-09-21T00:56:46.636320+0000","last_became_peered":"2024-09-21T00:56:46.636320+0000","last_unstale":"2024-09-21T00:57:26.766410+0000","last_undegraded":"2024-09-21T00:57:26.766410+0000","last_fullsized":"2024-09-21T00:57:26.766410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:42.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.666605+0000","last_change":"2024-09-21T00:56:48.651051+0000","last_active":"2024-09-21T00:58:25.666605+0000","last_peered":"2024-09-21T00:58:25.666605+0000","last_clean":"2024-09-21T00:58:25.666605+0000","last_became_active":"2024-09-21T00:56:48.650693+0000","last_became_peered":"2024-09-21T00:56:48.650693+0000","last_unstale":"2024-09-21T00:58:25.666605+0000","last_undegraded":"2024-09-21T00:58:25.666605+0000","last_fullsized":"2024-09-21T00:58:25.666605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:49.575213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767099+0000","last_change":"2024-09-21T00:56:46.634826+0000","last_active":"2024-09-21T00:57:26.767099+0000","last_peered":"2024-09-21T00:57:26.767099+0000","last_clean":"2024-09-21T00:57:26.767099+0000","last_became_active":"2024-09-21T00:56:46.634370+0000","last_became_peered":"2024-09-21T00:56:46.634370+0000","last_unstale":"2024-09-21T00:57:26.767099+0000","last_undegraded":"2024-09-21T00:57:26.767099+0000","last_fullsized":"2024-09-21T00:57:26.767099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:29.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659724+0000","last_change":"2024-09-21T00:56:48.646296+0000","last_active":"2024-09-21T00:58:25.659724+0000","last_peered":"2024-09-21T00:58:25.659724+0000","last_clean":"2024-09-21T00:58:25.659724+0000","last_became_active":"2024-09-21T00:56:48.644271+0000","last_became_peered":"2024-09-21T00:56:48.644271+0000","last_unstale":"2024-09-21T00:58:25.659724+0000","last_undegraded":"2024-09-21T00:58:25.659724+0000","last_fullsized":"2024-09-21T00:58:25.659724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:27.609714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858660+0000","last_change":"2024-09-21T00:56:46.641852+0000","last_active":"2024-09-21T00:57:26.858660+0000","last_peered":"2024-09-21T00:57:26.858660+0000","last_clean":"2024-09-21T00:57:26.858660+0000","last_became_active":"2024-09-21T00:56:46.641449+0000","last_became_peered":"2024-09-21T00:56:46.641449+0000","last_unstale":"2024-09-21T00:57:26.858660+0000","last_undegraded":"2024-09-21T00:57:26.858660+0000","last_fullsized":"2024-09-21T00:57:26.858660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:51.086321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.651867+0000","last_change":"2024-09-21T00:56:48.660295+0000","last_active":"2024-09-21T00:58:25.651867+0000","last_peered":"2024-09-21T00:58:25.651867+0000","last_clean":"2024-09-21T00:58:25.651867+0000","last_became_active":"2024-09-21T00:56:48.659638+0000","last_became_peered":"2024-09-21T00:56:48.659638+0000","last_unstale":"2024-09-21T00:58:25.651867+0000","last_undegraded":"2024-09-21T00:58:25.651867+0000","last_fullsized":"2024-09-21T00:58:25.651867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:34.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767333+0000","last_change":"2024-09-21T00:56:46.639317+0000","last_active":"2024-09-21T00:57:26.767333+0000","last_peered":"2024-09-21T00:57:26.767333+0000","last_clean":"2024-09-21T00:57:26.767333+0000","last_became_active":"2024-09-21T00:56:46.638732+0000","last_became_peered":"2024-09-21T00:56:46.638732+0000","last_unstale":"2024-09-21T00:57:26.767333+0000","last_undegraded":"2024-09-21T00:57:26.767333+0000","last_fullsized":"2024-09-21T00:57:26.767333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.653953+0000","last_change":"2024-09-21T00:56:48.651038+0000","last_active":"2024-09-21T00:58:25.653953+0000","last_peered":"2024-09-21T00:58:25.653953+0000","last_clean":"2024-09-21T00:58:25.653953+0000","last_became_active":"2024-09-21T00:56:48.650682+0000","last_became_peered":"2024-09-21T00:56:48.650682+0000","last_unstale":"2024-09-21T00:58:25.653953+0000","last_undegraded":"2024-09-21T00:58:25.653953+0000","last_fullsized":"2024-09-21T00:58:25.653953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.015768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760268+0000","last_change":"2024-09-21T00:56:46.641993+0000","last_active":"2024-09-21T00:57:26.760268+0000","last_peered":"2024-09-21T00:57:26.760268+0000","last_clean":"2024-09-21T00:57:26.760268+0000","last_became_active":"2024-09-21T00:56:46.641631+0000","last_became_peered":"2024-09-21T00:56:46.641631+0000","last_unstale":"2024-09-21T00:57:26.760268+0000","last_undegraded":"2024-09-21T00:57:26.760268+0000","last_fullsized":"2024-09-21T00:57:26.760268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:12.986551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671123+0000","last_change":"2024-09-21T00:56:48.649620+0000","last_active":"2024-09-21T00:58:25.671123+0000","last_peered":"2024-09-21T00:58:25.671123+0000","last_clean":"2024-09-21T00:58:25.671123+0000","last_became_active":"2024-09-21T00:56:48.645757+0000","last_became_peered":"2024-09-21T00:56:48.645757+0000","last_unstale":"2024-09-21T00:58:25.671123+0000","last_undegraded":"2024-09-21T00:58:25.671123+0000","last_fullsized":"2024-09-21T00:58:25.671123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:12.802042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761384+0000","last_change":"2024-09-21T00:56:46.641723+0000","last_active":"2024-09-21T00:57:26.761384+0000","last_peered":"2024-09-21T00:57:26.761384+0000","last_clean":"2024-09-21T00:57:26.761384+0000","last_became_active":"2024-09-21T00:56:46.641219+0000","last_became_peered":"2024-09-21T00:56:46.641219+0000","last_unstale":"2024-09-21T00:57:26.761384+0000","last_undegraded":"2024-09-21T00:57:26.761384+0000","last_fullsized":"2024-09-21T00:57:26.761384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:47.676869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.657190+0000","last_change":"2024-09-21T00:56:48.641940+0000","last_active":"2024-09-21T00:58:25.657190+0000","last_peered":"2024-09-21T00:58:25.657190+0000","last_clean":"2024-09-21T00:58:25.657190+0000","last_became_active":"2024-09-21T00:56:48.641521+0000","last_became_peered":"2024-09-21T00:56:48.641521+0000","last_unstale":"2024-09-21T00:58:25.657190+0000","last_undegraded":"2024-09-21T00:58:25.657190+0000","last_fullsized":"2024-09-21T00:58:25.657190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:38.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'11","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.669776+0000","last_change":"2024-09-21T00:56:46.631037+0000","last_active":"2024-09-21T00:58:25.669776+0000","last_peered":"2024-09-21T00:58:25.669776+0000","last_clean":"2024-09-21T00:58:25.669776+0000","last_became_active":"2024-09-21T00:56:46.630612+0000","last_became_peered":"2024-09-21T00:56:46.630612+0000","last_unstale":"2024-09-21T00:58:25.669776+0000","last_undegraded":"2024-09-21T00:58:25.669776+0000","last_fullsized":"2024-09-21T00:58:25.669776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.390614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667871+0000","last_change":"2024-09-21T00:56:48.649774+0000","last_active":"2024-09-21T00:58:25.667871+0000","last_peered":"2024-09-21T00:58:25.667871+0000","last_clean":"2024-09-21T00:58:25.667871+0000","last_became_active":"2024-09-21T00:56:48.649380+0000","last_became_peered":"2024-09-21T00:56:48.649380+0000","last_unstale":"2024-09-21T00:58:25.667871+0000","last_undegraded":"2024-09-21T00:58:25.667871+0000","last_fullsized":"2024-09-21T00:58:25.667871+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:12.595820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766611+0000","last_change":"2024-09-21T00:56:47.391328+0000","last_active":"2024-09-21T00:57:26.766611+0000","last_peered":"2024-09-21T00:57:26.766611+0000","last_clean":"2024-09-21T00:57:26.766611+0000","last_became_active":"2024-09-21T00:56:47.390860+0000","last_became_peered":"2024-09-21T00:56:47.390860+0000","last_unstale":"2024-09-21T00:57:26.766611+0000","last_undegraded":"2024-09-21T00:57:26.766611+0000","last_fullsized":"2024-09-21T00:57:26.766611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:24.267908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.668870+0000","last_change":"2024-09-21T00:56:48.657644+0000","last_active":"2024-09-21T00:58:25.668870+0000","last_peered":"2024-09-21T00:58:25.668870+0000","last_clean":"2024-09-21T00:58:25.668870+0000","last_became_active":"2024-09-21T00:56:48.657263+0000","last_became_peered":"2024-09-21T00:56:48.657263+0000","last_unstale":"2024-09-21T00:58:25.668870+0000","last_undegraded":"2024-09-21T00:58:25.668870+0000","last_fullsized":"2024-09-21T00:58:25.668870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:20.635667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.861164+0000","last_change":"2024-09-21T00:57:26.861046+0000","last_active":"2024-09-21T00:57:26.861164+0000","last_peered":"2024-09-21T00:57:26.861164+0000","last_clean":"2024-09-21T00:57:26.861164+0000","last_became_active":"2024-09-21T00:57:26.860555+0000","last_became_peered":"2024-09-21T00:57:26.860555+0000","last_unstale":"2024-09-21T00:57:26.861164+0000","last_undegraded":"2024-09-21T00:57:26.861164+0000","last_fullsized":"2024-09-21T00:57:26.861164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.786618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.619200+0000","last_change":"2024-09-21T00:56:48.656028+0000","last_active":"2024-09-21T00:58:25.619200+0000","last_peered":"2024-09-21T00:58:25.619200+0000","last_clean":"2024-09-21T00:58:25.619200+0000","last_became_active":"2024-09-21T00:56:48.655380+0000","last_became_peered":"2024-09-21T00:56:48.655380+0000","last_unstale":"2024-09-21T00:58:25.619200+0000","last_undegraded":"2024-09-21T00:58:25.619200+0000","last_fullsized":"2024-09-21T00:58:25.619200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:37.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769373+0000","last_change":"2024-09-21T00:56:46.635884+0000","last_active":"2024-09-21T00:57:26.769373+0000","last_peered":"2024-09-21T00:57:26.769373+0000","last_clean":"2024-09-21T00:57:26.769373+0000","last_became_active":"2024-09-21T00:56:46.635545+0000","last_became_peered":"2024-09-21T00:56:46.635545+0000","last_unstale":"2024-09-21T00:57:26.769373+0000","last_undegraded":"2024-09-21T00:57:26.769373+0000","last_fullsized":"2024-09-21T00:57:26.769373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:03.170611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658287+0000","last_change":"2024-09-21T00:56:48.649548+0000","last_active":"2024-09-21T00:58:25.658287+0000","last_peered":"2024-09-21T00:58:25.658287+0000","last_clean":"2024-09-21T00:58:25.658287+0000","last_became_active":"2024-09-21T00:56:48.649157+0000","last_became_peered":"2024-09-21T00:56:48.649157+0000","last_unstale":"2024-09-21T00:58:25.658287+0000","last_undegraded":"2024-09-21T00:58:25.658287+0000","last_fullsized":"2024-09-21T00:58:25.658287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:46.794274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766443+0000","last_change":"2024-09-21T00:56:46.632139+0000","last_active":"2024-09-21T00:57:26.766443+0000","last_peered":"2024-09-21T00:57:26.766443+0000","last_clean":"2024-09-21T00:57:26.766443+0000","last_became_active":"2024-09-21T00:56:46.631680+0000","last_became_peered":"2024-09-21T00:56:46.631680+0000","last_unstale":"2024-09-21T00:57:26.766443+0000","last_undegraded":"2024-09-21T00:57:26.766443+0000","last_fullsized":"2024-09-21T00:57:26.766443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:21:17.909161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667922+0000","last_change":"2024-09-21T00:56:48.654956+0000","last_active":"2024-09-21T00:58:25.667922+0000","last_peered":"2024-09-21T00:58:25.667922+0000","last_clean":"2024-09-21T00:58:25.667922+0000","last_became_active":"2024-09-21T00:56:48.654354+0000","last_became_peered":"2024-09-21T00:56:48.654354+0000","last_unstale":"2024-09-21T00:58:25.667922+0000","last_undegraded":"2024-09-21T00:58:25.667922+0000","last_fullsized":"2024-09-21T00:58:25.667922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:56.540664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.773409+0000","last_change":"2024-09-21T00:57:26.773289+0000","last_active":"2024-09-21T00:57:26.773409+0000","last_peered":"2024-09-21T00:57:26.773409+0000","last_clean":"2024-09-21T00:57:26.773409+0000","last_became_active":"2024-09-21T00:57:26.768686+0000","last_became_peered":"2024-09-21T00:57:26.768686+0000","last_unstale":"2024-09-21T00:57:26.773409+0000","last_undegraded":"2024-09-21T00:57:26.773409+0000","last_fullsized":"2024-09-21T00:57:26.773409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:04.247758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.673751+0000","last_change":"2024-09-21T00:56:48.647881+0000","last_active":"2024-09-21T00:58:25.673751+0000","last_peered":"2024-09-21T00:58:25.673751+0000","last_clean":"2024-09-21T00:58:25.673751+0000","last_became_active":"2024-09-21T00:56:48.647391+0000","last_became_peered":"2024-09-21T00:56:48.647391+0000","last_unstale":"2024-09-21T00:58:25.673751+0000","last_undegraded":"2024-09-21T00:58:25.673751+0000","last_fullsized":"2024-09-21T00:58:25.673751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:57.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665664+0000","last_change":"2024-09-21T00:56:48.662093+0000","last_active":"2024-09-21T00:58:25.665664+0000","last_peered":"2024-09-21T00:58:25.665664+0000","last_clean":"2024-09-21T00:58:25.665664+0000","last_became_active":"2024-09-21T00:56:48.661652+0000","last_became_peered":"2024-09-21T00:56:48.661652+0000","last_unstale":"2024-09-21T00:58:25.665664+0000","last_undegraded":"2024-09-21T00:58:25.665664+0000","last_fullsized":"2024-09-21T00:58:25.665664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:42:29.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761597+0000","last_change":"2024-09-21T00:56:46.633958+0000","last_active":"2024-09-21T00:57:26.761597+0000","last_peered":"2024-09-21T00:57:26.761597+0000","last_clean":"2024-09-21T00:57:26.761597+0000","last_became_active":"2024-09-21T00:56:46.633473+0000","last_became_peered":"2024-09-21T00:56:46.633473+0000","last_unstale":"2024-09-21T00:57:26.761597+0000","last_undegraded":"2024-09-21T00:57:26.761597+0000","last_fullsized":"2024-09-21T00:57:26.761597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:03:41.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764943+0000","last_change":"2024-09-21T00:56:48.647961+0000","last_active":"2024-09-21T00:57:26.764943+0000","last_peered":"2024-09-21T00:57:26.764943+0000","last_clean":"2024-09-21T00:57:26.764943+0000","last_became_active":"2024-09-21T00:56:48.647301+0000","last_became_peered":"2024-09-21T00:56:48.647301+0000","last_unstale":"2024-09-21T00:57:26.764943+0000","last_undegraded":"2024-09-21T00:57:26.764943+0000","last_fullsized":"2024-09-21T00:57:26.764943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:21.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761236+0000","last_change":"2024-09-21T00:56:46.637114+0000","last_active":"2024-09-21T00:57:26.761236+0000","last_peered":"2024-09-21T00:57:26.761236+0000","last_clean":"2024-09-21T00:57:26.761236+0000","last_became_active":"2024-09-21T00:56:46.636244+0000","last_became_peered":"2024-09-21T00:56:46.636244+0000","last_unstale":"2024-09-21T00:57:26.761236+0000","last_undegraded":"2024-09-21T00:57:26.761236+0000","last_fullsized":"2024-09-21T00:57:26.761236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:36.374016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.672155+0000","last_change":"2024-09-21T00:56:48.647249+0000","last_active":"2024-09-21T00:58:25.672155+0000","last_peered":"2024-09-21T00:58:25.672155+0000","last_clean":"2024-09-21T00:58:25.672155+0000","last_became_active":"2024-09-21T00:56:48.646888+0000","last_became_peered":"2024-09-21T00:56:48.646888+0000","last_unstale":"2024-09-21T00:58:25.672155+0000","last_undegraded":"2024-09-21T00:58:25.672155+0000","last_fullsized":"2024-09-21T00:58:25.672155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:02.997909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770241+0000","last_change":"2024-09-21T00:56:46.642781+0000","last_active":"2024-09-21T00:57:26.770241+0000","last_peered":"2024-09-21T00:57:26.770241+0000","last_clean":"2024-09-21T00:57:26.770241+0000","last_became_active":"2024-09-21T00:56:46.642346+0000","last_became_peered":"2024-09-21T00:56:46.642346+0000","last_unstale":"2024-09-21T00:57:26.770241+0000","last_undegraded":"2024-09-21T00:57:26.770241+0000","last_fullsized":"2024-09-21T00:57:26.770241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.050014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660933+0000","last_change":"2024-09-21T00:56:48.651942+0000","last_active":"2024-09-21T00:58:25.660933+0000","last_peered":"2024-09-21T00:58:25.660933+0000","last_clean":"2024-09-21T00:58:25.660933+0000","last_became_active":"2024-09-21T00:56:48.650577+0000","last_became_peered":"2024-09-21T00:56:48.650577+0000","last_unstale":"2024-09-21T00:58:25.660933+0000","last_undegraded":"2024-09-21T00:58:25.660933+0000","last_fullsized":"2024-09-21T00:58:25.660933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:44.176473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760475+0000","last_change":"2024-09-21T00:56:46.634428+0000","last_active":"2024-09-21T00:57:26.760475+0000","last_peered":"2024-09-21T00:57:26.760475+0000","last_clean":"2024-09-21T00:57:26.760475+0000","last_became_active":"2024-09-21T00:56:46.634037+0000","last_became_peered":"2024-09-21T00:56:46.634037+0000","last_unstale":"2024-09-21T00:57:26.760475+0000","last_undegraded":"2024-09-21T00:57:26.760475+0000","last_fullsized":"2024-09-21T00:57:26.760475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:25.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68312,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":197,"num_read_kb":166,"num_write":91,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":204379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743455,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":402083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939685,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1060276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":402782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":402687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495668,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":993150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40312,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704840,"statfs":{"total":95995035648,"available":95953756160,"internally_reserved":0,"allocated":827392,"data_stored":402200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":992750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":402105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":402304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":469631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":469040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":402173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:58:30.193 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:58:30.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 -- 172.21.15.47:0/3030000604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b701050a0 msgr2=0x7f0b7010ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 --2- 172.21.15.47:0/3030000604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b701050a0 0x7f0b7010ba40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009ca0 tx=0x7f0b6802a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 -- 172.21.15.47:0/3030000604 shutdown_connections 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 --2- 172.21.15.47:0/3030000604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b701050a0 0x7f0b7010ba40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 --2- 172.21.15.47:0/3030000604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b70104700 0x7f0b70104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 --2- 172.21.15.47:0/3030000604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b70103680 0x7f0b70103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 -- 172.21.15.47:0/3030000604 >> 172.21.15.47:0/3030000604 conn(0x7f0b700fefe0 msgr2=0x7f0b70101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 -- 172.21.15.47:0/3030000604 shutdown_connections 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.341+0000 7f0b77952640 1 -- 172.21.15.47:0/3030000604 wait complete. 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b77952640 1 Processor -- start 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b77952640 1 -- start start 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b77952640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b70103680 0x7f0b70199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b77952640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b70104700 0x7f0b7019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b77952640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b701050a0 0x7f0b7019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b77952640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7010f2d0 con 0x7f0b70103680 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b77952640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7010f150 con 0x7f0b70104700 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b77952640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7010f450 con 0x7f0b701050a0 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b756ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b70103680 0x7f0b70199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b756ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b70103680 0x7f0b70199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58660/0 (socket says 172.21.15.47:58660) 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.342+0000 7f0b756ee640 1 -- 172.21.15.47:0/2416680689 learned_addr learned my addr 172.21.15.47:0/2416680689 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b75eef640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b701050a0 0x7f0b7019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b74eed640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b70104700 0x7f0b7019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b756ee640 1 -- 172.21.15.47:0/2416680689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b701050a0 msgr2=0x7f0b7019b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b756ee640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b701050a0 0x7f0b7019b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b756ee640 1 -- 172.21.15.47:0/2416680689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b70104700 msgr2=0x7f0b7019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b756ee640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b70104700 0x7f0b7019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b756ee640 1 -- 172.21.15.47:0/2416680689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7019b900 con 0x7f0b70103680 2024-09-21T00:58:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b74eed640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b70104700 0x7f0b7019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b756ee640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b70103680 0x7f0b70199ec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00d770 tx=0x7f0b6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b627fc640 1 -- 172.21.15.47:0/2416680689 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c017070 con 0x7f0b70103680 2024-09-21T00:58:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b627fc640 1 -- 172.21.15.47:0/2416680689 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b6c0054d0 con 0x7f0b70103680 2024-09-21T00:58:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7019bbf0 con 0x7f0b70103680 2024-09-21T00:58:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b627fc640 1 -- 172.21.15.47:0/2416680689 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c004c30 con 0x7f0b70103680 2024-09-21T00:58:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.343+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b701a22e0 con 0x7f0b70103680 2024-09-21T00:58:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.344+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7010a850 con 0x7f0b70103680 2024-09-21T00:58:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.346+0000 7f0b627fc640 1 -- 172.21.15.47:0/2416680689 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f0b6c004dd0 con 0x7f0b70103680 2024-09-21T00:58:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.347+0000 7f0b627fc640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0b5c0b6510 0x7f0b5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.347+0000 7f0b74eed640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0b5c0b6510 0x7f0b5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.347+0000 7f0b627fc640 1 -- 172.21.15.47:0/2416680689 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f0b6c0e72a0 con 0x7f0b70103680 2024-09-21T00:58:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.347+0000 7f0b74eed640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0b5c0b6510 0x7f0b5c0b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009b50 tx=0x7f0b64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:30.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.350+0000 7f0b627fc640 1 -- 172.21.15.47:0/2416680689 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b6c0adb30 con 0x7f0b70103680 2024-09-21T00:58:30.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.534+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b70063800 con 0x7f0b5c0b6510 2024-09-21T00:58:30.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.538+0000 7f0b627fc640 1 -- 172.21.15.47:0/2416680689 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258882 (secure 0 0 0) 0x7f0b70063800 con 0x7f0b5c0b6510 2024-09-21T00:58:30.542 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:30.543 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0b5c0b6510 msgr2=0x7f0b5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0b5c0b6510 0x7f0b5c0b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009b50 tx=0x7f0b64005f90 comp rx=0 tx=0).stop 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b70103680 msgr2=0x7f0b70199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b70103680 0x7f0b70199ec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00d770 tx=0x7f0b6c00dc30 comp rx=0 tx=0).stop 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 shutdown_connections 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0b5c0b6510 0x7f0b5c0b8a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b701050a0 0x7f0b7019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b70104700 0x7f0b7019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 --2- 172.21.15.47:0/2416680689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b70103680 0x7f0b70199ec0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 >> 172.21.15.47:0/2416680689 conn(0x7f0b700fefe0 msgr2=0x7f0b70107a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 shutdown_connections 2024-09-21T00:58:30.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.542+0000 7f0b77952640 1 -- 172.21.15.47:0/2416680689 wait complete. 2024-09-21T00:58:30.554 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-21T00:58:29.281141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658914,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":273,"num_read_kb":230,"num_write":216,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":608,"ondisk_log_size":608,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381772,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560052,"statfs":{"total":1151940427776,"available":1151549493248,"internally_reserved":0,"allocated":11980800,"data_stored":6801181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":557,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003699"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671519+0000","last_change":"2024-09-21T00:56:48.655444+0000","last_active":"2024-09-21T00:58:25.671519+0000","last_peered":"2024-09-21T00:58:25.671519+0000","last_clean":"2024-09-21T00:58:25.671519+0000","last_became_active":"2024-09-21T00:56:48.655083+0000","last_became_peered":"2024-09-21T00:56:48.655083+0000","last_unstale":"2024-09-21T00:58:25.671519+0000","last_undegraded":"2024-09-21T00:58:25.671519+0000","last_fullsized":"2024-09-21T00:58:25.671519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:07.300682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664410+0000","last_change":"2024-09-21T00:56:48.655066+0000","last_active":"2024-09-21T00:58:25.664410+0000","last_peered":"2024-09-21T00:58:25.664410+0000","last_clean":"2024-09-21T00:58:25.664410+0000","last_became_active":"2024-09-21T00:56:48.654679+0000","last_became_peered":"2024-09-21T00:56:48.654679+0000","last_unstale":"2024-09-21T00:58:25.664410+0000","last_undegraded":"2024-09-21T00:58:25.664410+0000","last_fullsized":"2024-09-21T00:58:25.664410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671983+0000","last_change":"2024-09-21T00:56:48.648770+0000","last_active":"2024-09-21T00:58:25.671983+0000","last_peered":"2024-09-21T00:58:25.671983+0000","last_clean":"2024-09-21T00:58:25.671983+0000","last_became_active":"2024-09-21T00:56:48.648383+0000","last_became_peered":"2024-09-21T00:56:48.648383+0000","last_unstale":"2024-09-21T00:58:25.671983+0000","last_undegraded":"2024-09-21T00:58:25.671983+0000","last_fullsized":"2024-09-21T00:58:25.671983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.616648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658516+0000","last_change":"2024-09-21T00:57:26.767724+0000","last_active":"2024-09-21T00:58:25.658516+0000","last_peered":"2024-09-21T00:58:25.658516+0000","last_clean":"2024-09-21T00:58:25.658516+0000","last_became_active":"2024-09-21T00:57:26.767233+0000","last_became_peered":"2024-09-21T00:57:26.767233+0000","last_unstale":"2024-09-21T00:58:25.658516+0000","last_undegraded":"2024-09-21T00:58:25.658516+0000","last_fullsized":"2024-09-21T00:58:25.658516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:41.905543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661493+0000","last_change":"2024-09-21T00:56:48.654307+0000","last_active":"2024-09-21T00:58:25.661493+0000","last_peered":"2024-09-21T00:58:25.661493+0000","last_clean":"2024-09-21T00:58:25.661493+0000","last_became_active":"2024-09-21T00:56:48.653898+0000","last_became_peered":"2024-09-21T00:56:48.653898+0000","last_unstale":"2024-09-21T00:58:25.661493+0000","last_undegraded":"2024-09-21T00:58:25.661493+0000","last_fullsized":"2024-09-21T00:58:25.661493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.663654+0000","last_change":"2024-09-21T00:56:48.649950+0000","last_active":"2024-09-21T00:58:25.663654+0000","last_peered":"2024-09-21T00:58:25.663654+0000","last_clean":"2024-09-21T00:58:25.663654+0000","last_became_active":"2024-09-21T00:56:48.649305+0000","last_became_peered":"2024-09-21T00:56:48.649305+0000","last_unstale":"2024-09-21T00:58:25.663654+0000","last_undegraded":"2024-09-21T00:58:25.663654+0000","last_fullsized":"2024-09-21T00:58:25.663654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:56.456377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.656095+0000","last_change":"2024-09-21T00:56:48.656109+0000","last_active":"2024-09-21T00:58:25.656095+0000","last_peered":"2024-09-21T00:58:25.656095+0000","last_clean":"2024-09-21T00:58:25.656095+0000","last_became_active":"2024-09-21T00:56:48.654465+0000","last_became_peered":"2024-09-21T00:56:48.654465+0000","last_unstale":"2024-09-21T00:58:25.656095+0000","last_undegraded":"2024-09-21T00:58:25.656095+0000","last_fullsized":"2024-09-21T00:58:25.656095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:05.779845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667128+0000","last_change":"2024-09-21T00:56:48.656351+0000","last_active":"2024-09-21T00:58:25.667128+0000","last_peered":"2024-09-21T00:58:25.667128+0000","last_clean":"2024-09-21T00:58:25.667128+0000","last_became_active":"2024-09-21T00:56:48.654388+0000","last_became_peered":"2024-09-21T00:56:48.654388+0000","last_unstale":"2024-09-21T00:58:25.667128+0000","last_undegraded":"2024-09-21T00:58:25.667128+0000","last_fullsized":"2024-09-21T00:58:25.667128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:39.441882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764916+0000","last_change":"2024-09-21T00:56:48.661083+0000","last_active":"2024-09-21T00:57:26.764916+0000","last_peered":"2024-09-21T00:57:26.764916+0000","last_clean":"2024-09-21T00:57:26.764916+0000","last_became_active":"2024-09-21T00:56:48.660418+0000","last_became_peered":"2024-09-21T00:56:48.660418+0000","last_unstale":"2024-09-21T00:57:26.764916+0000","last_undegraded":"2024-09-21T00:57:26.764916+0000","last_fullsized":"2024-09-21T00:57:26.764916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:02.494368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664867+0000","last_change":"2024-09-21T00:56:48.660257+0000","last_active":"2024-09-21T00:58:25.664867+0000","last_peered":"2024-09-21T00:58:25.664867+0000","last_clean":"2024-09-21T00:58:25.664867+0000","last_became_active":"2024-09-21T00:56:48.659894+0000","last_became_peered":"2024-09-21T00:56:48.659894+0000","last_unstale":"2024-09-21T00:58:25.664867+0000","last_undegraded":"2024-09-21T00:58:25.664867+0000","last_fullsized":"2024-09-21T00:58:25.664867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.012107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665538+0000","last_change":"2024-09-21T00:56:48.653146+0000","last_active":"2024-09-21T00:58:25.665538+0000","last_peered":"2024-09-21T00:58:25.665538+0000","last_clean":"2024-09-21T00:58:25.665538+0000","last_became_active":"2024-09-21T00:56:48.652599+0000","last_became_peered":"2024-09-21T00:56:48.652599+0000","last_unstale":"2024-09-21T00:58:25.665538+0000","last_undegraded":"2024-09-21T00:58:25.665538+0000","last_fullsized":"2024-09-21T00:58:25.665538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:16.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655296+0000","last_change":"2024-09-21T00:56:48.659521+0000","last_active":"2024-09-21T00:58:25.655296+0000","last_peered":"2024-09-21T00:58:25.655296+0000","last_clean":"2024-09-21T00:58:25.655296+0000","last_became_active":"2024-09-21T00:56:48.658168+0000","last_became_peered":"2024-09-21T00:56:48.658168+0000","last_unstale":"2024-09-21T00:58:25.655296+0000","last_undegraded":"2024-09-21T00:58:25.655296+0000","last_fullsized":"2024-09-21T00:58:25.655296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:51.910450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665640+0000","last_change":"2024-09-21T00:56:48.652163+0000","last_active":"2024-09-21T00:58:25.665640+0000","last_peered":"2024-09-21T00:58:25.665640+0000","last_clean":"2024-09-21T00:58:25.665640+0000","last_became_active":"2024-09-21T00:56:48.651839+0000","last_became_peered":"2024-09-21T00:56:48.651839+0000","last_unstale":"2024-09-21T00:58:25.665640+0000","last_undegraded":"2024-09-21T00:58:25.665640+0000","last_fullsized":"2024-09-21T00:58:25.665640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:50.682747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.663614+0000","last_change":"2024-09-21T00:56:48.655106+0000","last_active":"2024-09-21T00:58:25.663614+0000","last_peered":"2024-09-21T00:58:25.663614+0000","last_clean":"2024-09-21T00:58:25.663614+0000","last_became_active":"2024-09-21T00:56:48.654722+0000","last_became_peered":"2024-09-21T00:56:48.654722+0000","last_unstale":"2024-09-21T00:58:25.663614+0000","last_undegraded":"2024-09-21T00:58:25.663614+0000","last_fullsized":"2024-09-21T00:58:25.663614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:36.023960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658630+0000","last_change":"2024-09-21T00:56:48.648935+0000","last_active":"2024-09-21T00:58:25.658630+0000","last_peered":"2024-09-21T00:58:25.658630+0000","last_clean":"2024-09-21T00:58:25.658630+0000","last_became_active":"2024-09-21T00:56:48.648557+0000","last_became_peered":"2024-09-21T00:56:48.648557+0000","last_unstale":"2024-09-21T00:58:25.658630+0000","last_undegraded":"2024-09-21T00:58:25.658630+0000","last_fullsized":"2024-09-21T00:58:25.658630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:17.791401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764496+0000","last_change":"2024-09-21T00:56:48.651338+0000","last_active":"2024-09-21T00:57:26.764496+0000","last_peered":"2024-09-21T00:57:26.764496+0000","last_clean":"2024-09-21T00:57:26.764496+0000","last_became_active":"2024-09-21T00:56:48.650940+0000","last_became_peered":"2024-09-21T00:56:48.650940+0000","last_unstale":"2024-09-21T00:57:26.764496+0000","last_undegraded":"2024-09-21T00:57:26.764496+0000","last_fullsized":"2024-09-21T00:57:26.764496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671778+0000","last_change":"2024-09-21T00:56:48.655091+0000","last_active":"2024-09-21T00:58:25.671778+0000","last_peered":"2024-09-21T00:58:25.671778+0000","last_clean":"2024-09-21T00:58:25.671778+0000","last_became_active":"2024-09-21T00:56:48.654534+0000","last_became_peered":"2024-09-21T00:56:48.654534+0000","last_unstale":"2024-09-21T00:58:25.671778+0000","last_undegraded":"2024-09-21T00:58:25.671778+0000","last_fullsized":"2024-09-21T00:58:25.671778+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:44.007171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.674445+0000","last_change":"2024-09-21T00:56:48.654933+0000","last_active":"2024-09-21T00:58:25.674445+0000","last_peered":"2024-09-21T00:58:25.674445+0000","last_clean":"2024-09-21T00:58:25.674445+0000","last_became_active":"2024-09-21T00:56:48.654523+0000","last_became_peered":"2024-09-21T00:56:48.654523+0000","last_unstale":"2024-09-21T00:58:25.674445+0000","last_undegraded":"2024-09-21T00:58:25.674445+0000","last_fullsized":"2024-09-21T00:58:25.674445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:58.190118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658456+0000","last_change":"2024-09-21T00:56:48.645166+0000","last_active":"2024-09-21T00:58:25.658456+0000","last_peered":"2024-09-21T00:58:25.658456+0000","last_clean":"2024-09-21T00:58:25.658456+0000","last_became_active":"2024-09-21T00:56:48.644695+0000","last_became_peered":"2024-09-21T00:56:48.644695+0000","last_unstale":"2024-09-21T00:58:25.658456+0000","last_undegraded":"2024-09-21T00:58:25.658456+0000","last_fullsized":"2024-09-21T00:58:25.658456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:07.564405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.662258+0000","last_change":"2024-09-21T00:56:48.659215+0000","last_active":"2024-09-21T00:58:25.662258+0000","last_peered":"2024-09-21T00:58:25.662258+0000","last_clean":"2024-09-21T00:58:25.662258+0000","last_became_active":"2024-09-21T00:56:48.658783+0000","last_became_peered":"2024-09-21T00:56:48.658783+0000","last_unstale":"2024-09-21T00:58:25.662258+0000","last_undegraded":"2024-09-21T00:58:25.662258+0000","last_fullsized":"2024-09-21T00:58:25.662258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:08:58.663963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.674676+0000","last_change":"2024-09-21T00:56:48.644461+0000","last_active":"2024-09-21T00:58:25.674676+0000","last_peered":"2024-09-21T00:58:25.674676+0000","last_clean":"2024-09-21T00:58:25.674676+0000","last_became_active":"2024-09-21T00:56:48.643842+0000","last_became_peered":"2024-09-21T00:56:48.643842+0000","last_unstale":"2024-09-21T00:58:25.674676+0000","last_undegraded":"2024-09-21T00:58:25.674676+0000","last_fullsized":"2024-09-21T00:58:25.674676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:12.673501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764701+0000","last_change":"2024-09-21T00:56:48.651212+0000","last_active":"2024-09-21T00:57:26.764701+0000","last_peered":"2024-09-21T00:57:26.764701+0000","last_clean":"2024-09-21T00:57:26.764701+0000","last_became_active":"2024-09-21T00:56:48.650802+0000","last_became_peered":"2024-09-21T00:56:48.650802+0000","last_unstale":"2024-09-21T00:57:26.764701+0000","last_undegraded":"2024-09-21T00:57:26.764701+0000","last_fullsized":"2024-09-21T00:57:26.764701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:06.310898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661035+0000","last_change":"2024-09-21T00:56:48.647772+0000","last_active":"2024-09-21T00:58:25.661035+0000","last_peered":"2024-09-21T00:58:25.661035+0000","last_clean":"2024-09-21T00:58:25.661035+0000","last_became_active":"2024-09-21T00:56:48.647379+0000","last_became_peered":"2024-09-21T00:56:48.647379+0000","last_unstale":"2024-09-21T00:58:25.661035+0000","last_undegraded":"2024-09-21T00:58:25.661035+0000","last_fullsized":"2024-09-21T00:58:25.661035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:06.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660811+0000","last_change":"2024-09-21T00:56:48.655841+0000","last_active":"2024-09-21T00:58:25.660811+0000","last_peered":"2024-09-21T00:58:25.660811+0000","last_clean":"2024-09-21T00:58:25.660811+0000","last_became_active":"2024-09-21T00:56:48.655270+0000","last_became_peered":"2024-09-21T00:56:48.655270+0000","last_unstale":"2024-09-21T00:58:25.660811+0000","last_undegraded":"2024-09-21T00:58:25.660811+0000","last_fullsized":"2024-09-21T00:58:25.660811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:28.350627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661443+0000","last_change":"2024-09-21T00:56:48.659457+0000","last_active":"2024-09-21T00:58:25.661443+0000","last_peered":"2024-09-21T00:58:25.661443+0000","last_clean":"2024-09-21T00:58:25.661443+0000","last_became_active":"2024-09-21T00:56:48.658999+0000","last_became_peered":"2024-09-21T00:56:48.658999+0000","last_unstale":"2024-09-21T00:58:25.661443+0000","last_undegraded":"2024-09-21T00:58:25.661443+0000","last_fullsized":"2024-09-21T00:58:25.661443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:56.196167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655752+0000","last_change":"2024-09-21T00:56:48.656361+0000","last_active":"2024-09-21T00:58:25.655752+0000","last_peered":"2024-09-21T00:58:25.655752+0000","last_clean":"2024-09-21T00:58:25.655752+0000","last_became_active":"2024-09-21T00:56:48.655999+0000","last_became_peered":"2024-09-21T00:56:48.655999+0000","last_unstale":"2024-09-21T00:58:25.655752+0000","last_undegraded":"2024-09-21T00:58:25.655752+0000","last_fullsized":"2024-09-21T00:58:25.655752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:46.533280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659095+0000","last_change":"2024-09-21T00:56:48.656549+0000","last_active":"2024-09-21T00:58:25.659095+0000","last_peered":"2024-09-21T00:58:25.659095+0000","last_clean":"2024-09-21T00:58:25.659095+0000","last_became_active":"2024-09-21T00:56:48.656154+0000","last_became_peered":"2024-09-21T00:56:48.656154+0000","last_unstale":"2024-09-21T00:58:25.659095+0000","last_undegraded":"2024-09-21T00:58:25.659095+0000","last_fullsized":"2024-09-21T00:58:25.659095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:37.244726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665129+0000","last_change":"2024-09-21T00:56:48.645857+0000","last_active":"2024-09-21T00:58:25.665129+0000","last_peered":"2024-09-21T00:58:25.665129+0000","last_clean":"2024-09-21T00:58:25.665129+0000","last_became_active":"2024-09-21T00:56:48.644462+0000","last_became_peered":"2024-09-21T00:56:48.644462+0000","last_unstale":"2024-09-21T00:58:25.665129+0000","last_undegraded":"2024-09-21T00:58:25.665129+0000","last_fullsized":"2024-09-21T00:58:25.665129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:11.690074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661786+0000","last_change":"2024-09-21T00:56:48.649937+0000","last_active":"2024-09-21T00:58:25.661786+0000","last_peered":"2024-09-21T00:58:25.661786+0000","last_clean":"2024-09-21T00:58:25.661786+0000","last_became_active":"2024-09-21T00:56:48.649233+0000","last_became_peered":"2024-09-21T00:56:48.649233+0000","last_unstale":"2024-09-21T00:58:25.661786+0000","last_undegraded":"2024-09-21T00:58:25.661786+0000","last_fullsized":"2024-09-21T00:58:25.661786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:00.529143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658465+0000","last_change":"2024-09-21T00:56:48.645824+0000","last_active":"2024-09-21T00:58:25.658465+0000","last_peered":"2024-09-21T00:58:25.658465+0000","last_clean":"2024-09-21T00:58:25.658465+0000","last_became_active":"2024-09-21T00:56:48.645452+0000","last_became_peered":"2024-09-21T00:56:48.645452+0000","last_unstale":"2024-09-21T00:58:25.658465+0000","last_undegraded":"2024-09-21T00:58:25.658465+0000","last_fullsized":"2024-09-21T00:58:25.658465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:40.228469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658560+0000","last_change":"2024-09-21T00:57:26.769121+0000","last_active":"2024-09-21T00:58:25.658560+0000","last_peered":"2024-09-21T00:58:25.658560+0000","last_clean":"2024-09-21T00:58:25.658560+0000","last_became_active":"2024-09-21T00:57:26.768532+0000","last_became_peered":"2024-09-21T00:57:26.768532+0000","last_unstale":"2024-09-21T00:58:25.658560+0000","last_undegraded":"2024-09-21T00:58:25.658560+0000","last_fullsized":"2024-09-21T00:58:25.658560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:57.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658300+0000","last_change":"2024-09-21T00:56:48.656431+0000","last_active":"2024-09-21T00:58:25.658300+0000","last_peered":"2024-09-21T00:58:25.658300+0000","last_clean":"2024-09-21T00:58:25.658300+0000","last_became_active":"2024-09-21T00:56:48.656080+0000","last_became_peered":"2024-09-21T00:56:48.656080+0000","last_unstale":"2024-09-21T00:58:25.658300+0000","last_undegraded":"2024-09-21T00:58:25.658300+0000","last_fullsized":"2024-09-21T00:58:25.658300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:00.068094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655004+0000","last_change":"2024-09-21T00:56:48.653355+0000","last_active":"2024-09-21T00:58:25.655004+0000","last_peered":"2024-09-21T00:58:25.655004+0000","last_clean":"2024-09-21T00:58:25.655004+0000","last_became_active":"2024-09-21T00:56:48.652959+0000","last_became_peered":"2024-09-21T00:56:48.652959+0000","last_unstale":"2024-09-21T00:58:25.655004+0000","last_undegraded":"2024-09-21T00:58:25.655004+0000","last_fullsized":"2024-09-21T00:58:25.655004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:16.462806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770600+0000","last_change":"2024-09-21T00:56:46.634744+0000","last_active":"2024-09-21T00:57:26.770600+0000","last_peered":"2024-09-21T00:57:26.770600+0000","last_clean":"2024-09-21T00:57:26.770600+0000","last_became_active":"2024-09-21T00:56:46.634367+0000","last_became_peered":"2024-09-21T00:56:46.634367+0000","last_unstale":"2024-09-21T00:57:26.770600+0000","last_undegraded":"2024-09-21T00:57:26.770600+0000","last_fullsized":"2024-09-21T00:57:26.770600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:40.923450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661063+0000","last_change":"2024-09-21T00:56:48.660277+0000","last_active":"2024-09-21T00:58:25.661063+0000","last_peered":"2024-09-21T00:58:25.661063+0000","last_clean":"2024-09-21T00:58:25.661063+0000","last_became_active":"2024-09-21T00:56:48.659491+0000","last_became_peered":"2024-09-21T00:56:48.659491+0000","last_unstale":"2024-09-21T00:58:25.661063+0000","last_undegraded":"2024-09-21T00:58:25.661063+0000","last_fullsized":"2024-09-21T00:58:25.661063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:39.032704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858813+0000","last_change":"2024-09-21T00:56:46.634466+0000","last_active":"2024-09-21T00:57:26.858813+0000","last_peered":"2024-09-21T00:57:26.858813+0000","last_clean":"2024-09-21T00:57:26.858813+0000","last_became_active":"2024-09-21T00:56:46.634031+0000","last_became_peered":"2024-09-21T00:56:46.634031+0000","last_unstale":"2024-09-21T00:57:26.858813+0000","last_undegraded":"2024-09-21T00:57:26.858813+0000","last_fullsized":"2024-09-21T00:57:26.858813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:49.691014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858552+0000","last_change":"2024-09-21T00:56:46.628156+0000","last_active":"2024-09-21T00:57:26.858552+0000","last_peered":"2024-09-21T00:57:26.858552+0000","last_clean":"2024-09-21T00:57:26.858552+0000","last_became_active":"2024-09-21T00:56:46.627735+0000","last_became_peered":"2024-09-21T00:56:46.627735+0000","last_unstale":"2024-09-21T00:57:26.858552+0000","last_undegraded":"2024-09-21T00:57:26.858552+0000","last_fullsized":"2024-09-21T00:57:26.858552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:55.188016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660845+0000","last_change":"2024-09-21T00:56:48.649571+0000","last_active":"2024-09-21T00:58:25.660845+0000","last_peered":"2024-09-21T00:58:25.660845+0000","last_clean":"2024-09-21T00:58:25.660845+0000","last_became_active":"2024-09-21T00:56:48.647345+0000","last_became_peered":"2024-09-21T00:56:48.647345+0000","last_unstale":"2024-09-21T00:58:25.660845+0000","last_undegraded":"2024-09-21T00:58:25.660845+0000","last_fullsized":"2024-09-21T00:58:25.660845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:43.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770076+0000","last_change":"2024-09-21T00:56:46.634886+0000","last_active":"2024-09-21T00:57:26.770076+0000","last_peered":"2024-09-21T00:57:26.770076+0000","last_clean":"2024-09-21T00:57:26.770076+0000","last_became_active":"2024-09-21T00:56:46.634481+0000","last_became_peered":"2024-09-21T00:56:46.634481+0000","last_unstale":"2024-09-21T00:57:26.770076+0000","last_undegraded":"2024-09-21T00:57:26.770076+0000","last_fullsized":"2024-09-21T00:57:26.770076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:15.062776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.666669+0000","last_change":"2024-09-21T00:56:48.655740+0000","last_active":"2024-09-21T00:58:25.666669+0000","last_peered":"2024-09-21T00:58:25.666669+0000","last_clean":"2024-09-21T00:58:25.666669+0000","last_became_active":"2024-09-21T00:56:48.655312+0000","last_became_peered":"2024-09-21T00:56:48.655312+0000","last_unstale":"2024-09-21T00:58:25.666669+0000","last_undegraded":"2024-09-21T00:58:25.666669+0000","last_fullsized":"2024-09-21T00:58:25.666669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.815954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859165+0000","last_change":"2024-09-21T00:56:46.636212+0000","last_active":"2024-09-21T00:57:26.859165+0000","last_peered":"2024-09-21T00:57:26.859165+0000","last_clean":"2024-09-21T00:57:26.859165+0000","last_became_active":"2024-09-21T00:56:46.635702+0000","last_became_peered":"2024-09-21T00:56:46.635702+0000","last_unstale":"2024-09-21T00:57:26.859165+0000","last_undegraded":"2024-09-21T00:57:26.859165+0000","last_fullsized":"2024-09-21T00:57:26.859165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:11.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765366+0000","last_change":"2024-09-21T00:56:48.646300+0000","last_active":"2024-09-21T00:57:26.765366+0000","last_peered":"2024-09-21T00:57:26.765366+0000","last_clean":"2024-09-21T00:57:26.765366+0000","last_became_active":"2024-09-21T00:56:48.645906+0000","last_became_peered":"2024-09-21T00:56:48.645906+0000","last_unstale":"2024-09-21T00:57:26.765366+0000","last_undegraded":"2024-09-21T00:57:26.765366+0000","last_fullsized":"2024-09-21T00:57:26.765366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:47.593609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766522+0000","last_change":"2024-09-21T00:56:46.639405+0000","last_active":"2024-09-21T00:57:26.766522+0000","last_peered":"2024-09-21T00:57:26.766522+0000","last_clean":"2024-09-21T00:57:26.766522+0000","last_became_active":"2024-09-21T00:56:46.638659+0000","last_became_peered":"2024-09-21T00:56:46.638659+0000","last_unstale":"2024-09-21T00:57:26.766522+0000","last_undegraded":"2024-09-21T00:57:26.766522+0000","last_fullsized":"2024-09-21T00:57:26.766522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:19.718585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.651971+0000","last_change":"2024-09-21T00:56:48.657572+0000","last_active":"2024-09-21T00:58:25.651971+0000","last_peered":"2024-09-21T00:58:25.651971+0000","last_clean":"2024-09-21T00:58:25.651971+0000","last_became_active":"2024-09-21T00:56:48.657219+0000","last_became_peered":"2024-09-21T00:56:48.657219+0000","last_unstale":"2024-09-21T00:58:25.651971+0000","last_undegraded":"2024-09-21T00:58:25.651971+0000","last_fullsized":"2024-09-21T00:58:25.651971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:48.870835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770265+0000","last_change":"2024-09-21T00:56:46.642710+0000","last_active":"2024-09-21T00:57:26.770265+0000","last_peered":"2024-09-21T00:57:26.770265+0000","last_clean":"2024-09-21T00:57:26.770265+0000","last_became_active":"2024-09-21T00:56:46.642273+0000","last_became_peered":"2024-09-21T00:56:46.642273+0000","last_unstale":"2024-09-21T00:57:26.770265+0000","last_undegraded":"2024-09-21T00:57:26.770265+0000","last_fullsized":"2024-09-21T00:57:26.770265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.751651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.860956+0000","last_change":"2024-09-21T00:57:26.860826+0000","last_active":"2024-09-21T00:57:26.860956+0000","last_peered":"2024-09-21T00:57:26.860956+0000","last_clean":"2024-09-21T00:57:26.860956+0000","last_became_active":"2024-09-21T00:57:26.860389+0000","last_became_peered":"2024-09-21T00:57:26.860389+0000","last_unstale":"2024-09-21T00:57:26.860956+0000","last_undegraded":"2024-09-21T00:57:26.860956+0000","last_fullsized":"2024-09-21T00:57:26.860956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:52.229655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'31","reported_seq":247,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:26.675080+0000","last_change":"2024-09-21T00:56:46.639555+0000","last_active":"2024-09-21T00:58:26.675080+0000","last_peered":"2024-09-21T00:58:26.675080+0000","last_clean":"2024-09-21T00:58:26.675080+0000","last_became_active":"2024-09-21T00:56:46.639200+0000","last_became_peered":"2024-09-21T00:56:46.639200+0000","last_unstale":"2024-09-21T00:58:26.675080+0000","last_undegraded":"2024-09-21T00:58:26.675080+0000","last_fullsized":"2024-09-21T00:58:26.675080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:49.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67514,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":193,"num_read_kb":162,"num_write":31,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659583+0000","last_change":"2024-09-21T00:56:48.653950+0000","last_active":"2024-09-21T00:58:25.659583+0000","last_peered":"2024-09-21T00:58:25.659583+0000","last_clean":"2024-09-21T00:58:25.659583+0000","last_became_active":"2024-09-21T00:56:48.653570+0000","last_became_peered":"2024-09-21T00:56:48.653570+0000","last_unstale":"2024-09-21T00:58:25.659583+0000","last_undegraded":"2024-09-21T00:58:25.659583+0000","last_fullsized":"2024-09-21T00:58:25.659583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:43.708982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766728+0000","last_change":"2024-09-21T00:56:46.635861+0000","last_active":"2024-09-21T00:57:26.766728+0000","last_peered":"2024-09-21T00:57:26.766728+0000","last_clean":"2024-09-21T00:57:26.766728+0000","last_became_active":"2024-09-21T00:56:46.635452+0000","last_became_peered":"2024-09-21T00:56:46.635452+0000","last_unstale":"2024-09-21T00:57:26.766728+0000","last_undegraded":"2024-09-21T00:57:26.766728+0000","last_fullsized":"2024-09-21T00:57:26.766728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:15.591100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.670846+0000","last_change":"2024-09-21T00:56:48.645567+0000","last_active":"2024-09-21T00:58:25.670846+0000","last_peered":"2024-09-21T00:58:25.670846+0000","last_clean":"2024-09-21T00:58:25.670846+0000","last_became_active":"2024-09-21T00:56:48.644499+0000","last_became_peered":"2024-09-21T00:56:48.644499+0000","last_unstale":"2024-09-21T00:58:25.670846+0000","last_undegraded":"2024-09-21T00:58:25.670846+0000","last_fullsized":"2024-09-21T00:58:25.670846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:08.655065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770242+0000","last_change":"2024-09-21T00:56:46.633014+0000","last_active":"2024-09-21T00:57:26.770242+0000","last_peered":"2024-09-21T00:57:26.770242+0000","last_clean":"2024-09-21T00:57:26.770242+0000","last_became_active":"2024-09-21T00:56:46.632656+0000","last_became_peered":"2024-09-21T00:56:46.632656+0000","last_unstale":"2024-09-21T00:57:26.770242+0000","last_undegraded":"2024-09-21T00:57:26.770242+0000","last_fullsized":"2024-09-21T00:57:26.770242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:46.270469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.673476+0000","last_change":"2024-09-21T00:56:48.659797+0000","last_active":"2024-09-21T00:58:25.673476+0000","last_peered":"2024-09-21T00:58:25.673476+0000","last_clean":"2024-09-21T00:58:25.673476+0000","last_became_active":"2024-09-21T00:56:48.659430+0000","last_became_peered":"2024-09-21T00:56:48.659430+0000","last_unstale":"2024-09-21T00:58:25.673476+0000","last_undegraded":"2024-09-21T00:58:25.673476+0000","last_fullsized":"2024-09-21T00:58:25.673476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:45.006414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766061+0000","last_change":"2024-09-21T00:56:46.636792+0000","last_active":"2024-09-21T00:57:26.766061+0000","last_peered":"2024-09-21T00:57:26.766061+0000","last_clean":"2024-09-21T00:57:26.766061+0000","last_became_active":"2024-09-21T00:56:46.636383+0000","last_became_peered":"2024-09-21T00:56:46.636383+0000","last_unstale":"2024-09-21T00:57:26.766061+0000","last_undegraded":"2024-09-21T00:57:26.766061+0000","last_fullsized":"2024-09-21T00:57:26.766061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:37.078166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655806+0000","last_change":"2024-09-21T00:56:48.657065+0000","last_active":"2024-09-21T00:58:25.655806+0000","last_peered":"2024-09-21T00:58:25.655806+0000","last_clean":"2024-09-21T00:58:25.655806+0000","last_became_active":"2024-09-21T00:56:48.656658+0000","last_became_peered":"2024-09-21T00:56:48.656658+0000","last_unstale":"2024-09-21T00:58:25.655806+0000","last_undegraded":"2024-09-21T00:58:25.655806+0000","last_fullsized":"2024-09-21T00:58:25.655806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:31.713457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761028+0000","last_change":"2024-09-21T00:56:46.642099+0000","last_active":"2024-09-21T00:57:26.761028+0000","last_peered":"2024-09-21T00:57:26.761028+0000","last_clean":"2024-09-21T00:57:26.761028+0000","last_became_active":"2024-09-21T00:56:46.641526+0000","last_became_peered":"2024-09-21T00:56:46.641526+0000","last_unstale":"2024-09-21T00:57:26.761028+0000","last_undegraded":"2024-09-21T00:57:26.761028+0000","last_fullsized":"2024-09-21T00:57:26.761028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:12.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665383+0000","last_change":"2024-09-21T00:56:48.660991+0000","last_active":"2024-09-21T00:58:25.665383+0000","last_peered":"2024-09-21T00:58:25.665383+0000","last_clean":"2024-09-21T00:58:25.665383+0000","last_became_active":"2024-09-21T00:56:48.660623+0000","last_became_peered":"2024-09-21T00:56:48.660623+0000","last_unstale":"2024-09-21T00:58:25.665383+0000","last_undegraded":"2024-09-21T00:58:25.665383+0000","last_fullsized":"2024-09-21T00:58:25.665383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:34.291977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761592+0000","last_change":"2024-09-21T00:56:46.637482+0000","last_active":"2024-09-21T00:57:26.761592+0000","last_peered":"2024-09-21T00:57:26.761592+0000","last_clean":"2024-09-21T00:57:26.761592+0000","last_became_active":"2024-09-21T00:56:46.634812+0000","last_became_peered":"2024-09-21T00:56:46.634812+0000","last_unstale":"2024-09-21T00:57:26.761592+0000","last_undegraded":"2024-09-21T00:57:26.761592+0000","last_fullsized":"2024-09-21T00:57:26.761592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:30.990625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659724+0000","last_change":"2024-09-21T00:56:48.658930+0000","last_active":"2024-09-21T00:58:25.659724+0000","last_peered":"2024-09-21T00:58:25.659724+0000","last_clean":"2024-09-21T00:58:25.659724+0000","last_became_active":"2024-09-21T00:56:48.658545+0000","last_became_peered":"2024-09-21T00:56:48.658545+0000","last_unstale":"2024-09-21T00:58:25.659724+0000","last_undegraded":"2024-09-21T00:58:25.659724+0000","last_fullsized":"2024-09-21T00:58:25.659724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:30:57.850371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859892+0000","last_change":"2024-09-21T00:56:46.628768+0000","last_active":"2024-09-21T00:57:26.859892+0000","last_peered":"2024-09-21T00:57:26.859892+0000","last_clean":"2024-09-21T00:57:26.859892+0000","last_became_active":"2024-09-21T00:56:46.628374+0000","last_became_peered":"2024-09-21T00:56:46.628374+0000","last_unstale":"2024-09-21T00:57:26.859892+0000","last_undegraded":"2024-09-21T00:57:26.859892+0000","last_fullsized":"2024-09-21T00:57:26.859892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:58:15.133651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664902+0000","last_change":"2024-09-21T00:56:48.648097+0000","last_active":"2024-09-21T00:58:25.664902+0000","last_peered":"2024-09-21T00:58:25.664902+0000","last_clean":"2024-09-21T00:58:25.664902+0000","last_became_active":"2024-09-21T00:56:48.647619+0000","last_became_peered":"2024-09-21T00:56:48.647619+0000","last_unstale":"2024-09-21T00:58:25.664902+0000","last_undegraded":"2024-09-21T00:58:25.664902+0000","last_fullsized":"2024-09-21T00:58:25.664902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:08.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770460+0000","last_change":"2024-09-21T00:56:46.636947+0000","last_active":"2024-09-21T00:57:26.770460+0000","last_peered":"2024-09-21T00:57:26.770460+0000","last_clean":"2024-09-21T00:57:26.770460+0000","last_became_active":"2024-09-21T00:56:46.636469+0000","last_became_peered":"2024-09-21T00:56:46.636469+0000","last_unstale":"2024-09-21T00:57:26.770460+0000","last_undegraded":"2024-09-21T00:57:26.770460+0000","last_fullsized":"2024-09-21T00:57:26.770460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:31.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655895+0000","last_change":"2024-09-21T00:57:26.774145+0000","last_active":"2024-09-21T00:58:25.655895+0000","last_peered":"2024-09-21T00:58:25.655895+0000","last_clean":"2024-09-21T00:58:25.655895+0000","last_became_active":"2024-09-21T00:57:26.770919+0000","last_became_peered":"2024-09-21T00:57:26.770919+0000","last_unstale":"2024-09-21T00:58:25.655895+0000","last_undegraded":"2024-09-21T00:58:25.655895+0000","last_fullsized":"2024-09-21T00:58:25.655895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:21.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766495+0000","last_change":"2024-09-21T00:56:47.391206+0000","last_active":"2024-09-21T00:57:26.766495+0000","last_peered":"2024-09-21T00:57:26.766495+0000","last_clean":"2024-09-21T00:57:26.766495+0000","last_became_active":"2024-09-21T00:56:47.390708+0000","last_became_peered":"2024-09-21T00:56:47.390708+0000","last_unstale":"2024-09-21T00:57:26.766495+0000","last_undegraded":"2024-09-21T00:57:26.766495+0000","last_fullsized":"2024-09-21T00:57:26.766495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:59.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665899+0000","last_change":"2024-09-21T00:56:48.648452+0000","last_active":"2024-09-21T00:58:25.665899+0000","last_peered":"2024-09-21T00:58:25.665899+0000","last_clean":"2024-09-21T00:58:25.665899+0000","last_became_active":"2024-09-21T00:56:48.647682+0000","last_became_peered":"2024-09-21T00:56:48.647682+0000","last_unstale":"2024-09-21T00:58:25.665899+0000","last_undegraded":"2024-09-21T00:58:25.665899+0000","last_fullsized":"2024-09-21T00:58:25.665899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:45.844596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767189+0000","last_change":"2024-09-21T00:55:37.551147+0000","last_active":"2024-09-21T00:57:26.767189+0000","last_peered":"2024-09-21T00:57:26.767189+0000","last_clean":"2024-09-21T00:57:26.767189+0000","last_became_active":"2024-09-21T00:55:37.545124+0000","last_became_peered":"2024-09-21T00:55:37.545124+0000","last_unstale":"2024-09-21T00:57:26.767189+0000","last_undegraded":"2024-09-21T00:57:26.767189+0000","last_fullsized":"2024-09-21T00:57:26.767189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_clean_scrub_stamp":"2024-09-21T00:52:17.996374+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:20.205607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766410+0000","last_change":"2024-09-21T00:56:46.637264+0000","last_active":"2024-09-21T00:57:26.766410+0000","last_peered":"2024-09-21T00:57:26.766410+0000","last_clean":"2024-09-21T00:57:26.766410+0000","last_became_active":"2024-09-21T00:56:46.636320+0000","last_became_peered":"2024-09-21T00:56:46.636320+0000","last_unstale":"2024-09-21T00:57:26.766410+0000","last_undegraded":"2024-09-21T00:57:26.766410+0000","last_fullsized":"2024-09-21T00:57:26.766410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:42.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.666605+0000","last_change":"2024-09-21T00:56:48.651051+0000","last_active":"2024-09-21T00:58:25.666605+0000","last_peered":"2024-09-21T00:58:25.666605+0000","last_clean":"2024-09-21T00:58:25.666605+0000","last_became_active":"2024-09-21T00:56:48.650693+0000","last_became_peered":"2024-09-21T00:56:48.650693+0000","last_unstale":"2024-09-21T00:58:25.666605+0000","last_undegraded":"2024-09-21T00:58:25.666605+0000","last_fullsized":"2024-09-21T00:58:25.666605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:49.575213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767099+0000","last_change":"2024-09-21T00:56:46.634826+0000","last_active":"2024-09-21T00:57:26.767099+0000","last_peered":"2024-09-21T00:57:26.767099+0000","last_clean":"2024-09-21T00:57:26.767099+0000","last_became_active":"2024-09-21T00:56:46.634370+0000","last_became_peered":"2024-09-21T00:56:46.634370+0000","last_unstale":"2024-09-21T00:57:26.767099+0000","last_undegraded":"2024-09-21T00:57:26.767099+0000","last_fullsized":"2024-09-21T00:57:26.767099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:29.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659724+0000","last_change":"2024-09-21T00:56:48.646296+0000","last_active":"2024-09-21T00:58:25.659724+0000","last_peered":"2024-09-21T00:58:25.659724+0000","last_clean":"2024-09-21T00:58:25.659724+0000","last_became_active":"2024-09-21T00:56:48.644271+0000","last_became_peered":"2024-09-21T00:56:48.644271+0000","last_unstale":"2024-09-21T00:58:25.659724+0000","last_undegraded":"2024-09-21T00:58:25.659724+0000","last_fullsized":"2024-09-21T00:58:25.659724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:27.609714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858660+0000","last_change":"2024-09-21T00:56:46.641852+0000","last_active":"2024-09-21T00:57:26.858660+0000","last_peered":"2024-09-21T00:57:26.858660+0000","last_clean":"2024-09-21T00:57:26.858660+0000","last_became_active":"2024-09-21T00:56:46.641449+0000","last_became_peered":"2024-09-21T00:56:46.641449+0000","last_unstale":"2024-09-21T00:57:26.858660+0000","last_undegraded":"2024-09-21T00:57:26.858660+0000","last_fullsized":"2024-09-21T00:57:26.858660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:51.086321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.651867+0000","last_change":"2024-09-21T00:56:48.660295+0000","last_active":"2024-09-21T00:58:25.651867+0000","last_peered":"2024-09-21T00:58:25.651867+0000","last_clean":"2024-09-21T00:58:25.651867+0000","last_became_active":"2024-09-21T00:56:48.659638+0000","last_became_peered":"2024-09-21T00:56:48.659638+0000","last_unstale":"2024-09-21T00:58:25.651867+0000","last_undegraded":"2024-09-21T00:58:25.651867+0000","last_fullsized":"2024-09-21T00:58:25.651867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:34.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767333+0000","last_change":"2024-09-21T00:56:46.639317+0000","last_active":"2024-09-21T00:57:26.767333+0000","last_peered":"2024-09-21T00:57:26.767333+0000","last_clean":"2024-09-21T00:57:26.767333+0000","last_became_active":"2024-09-21T00:56:46.638732+0000","last_became_peered":"2024-09-21T00:56:46.638732+0000","last_unstale":"2024-09-21T00:57:26.767333+0000","last_undegraded":"2024-09-21T00:57:26.767333+0000","last_fullsized":"2024-09-21T00:57:26.767333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.653953+0000","last_change":"2024-09-21T00:56:48.651038+0000","last_active":"2024-09-21T00:58:25.653953+0000","last_peered":"2024-09-21T00:58:25.653953+0000","last_clean":"2024-09-21T00:58:25.653953+0000","last_became_active":"2024-09-21T00:56:48.650682+0000","last_became_peered":"2024-09-21T00:56:48.650682+0000","last_unstale":"2024-09-21T00:58:25.653953+0000","last_undegraded":"2024-09-21T00:58:25.653953+0000","last_fullsized":"2024-09-21T00:58:25.653953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.015768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760268+0000","last_change":"2024-09-21T00:56:46.641993+0000","last_active":"2024-09-21T00:57:26.760268+0000","last_peered":"2024-09-21T00:57:26.760268+0000","last_clean":"2024-09-21T00:57:26.760268+0000","last_became_active":"2024-09-21T00:56:46.641631+0000","last_became_peered":"2024-09-21T00:56:46.641631+0000","last_unstale":"2024-09-21T00:57:26.760268+0000","last_undegraded":"2024-09-21T00:57:26.760268+0000","last_fullsized":"2024-09-21T00:57:26.760268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:12.986551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671123+0000","last_change":"2024-09-21T00:56:48.649620+0000","last_active":"2024-09-21T00:58:25.671123+0000","last_peered":"2024-09-21T00:58:25.671123+0000","last_clean":"2024-09-21T00:58:25.671123+0000","last_became_active":"2024-09-21T00:56:48.645757+0000","last_became_peered":"2024-09-21T00:56:48.645757+0000","last_unstale":"2024-09-21T00:58:25.671123+0000","last_undegraded":"2024-09-21T00:58:25.671123+0000","last_fullsized":"2024-09-21T00:58:25.671123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:12.802042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761384+0000","last_change":"2024-09-21T00:56:46.641723+0000","last_active":"2024-09-21T00:57:26.761384+0000","last_peered":"2024-09-21T00:57:26.761384+0000","last_clean":"2024-09-21T00:57:26.761384+0000","last_became_active":"2024-09-21T00:56:46.641219+0000","last_became_peered":"2024-09-21T00:56:46.641219+0000","last_unstale":"2024-09-21T00:57:26.761384+0000","last_undegraded":"2024-09-21T00:57:26.761384+0000","last_fullsized":"2024-09-21T00:57:26.761384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:47.676869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.657190+0000","last_change":"2024-09-21T00:56:48.641940+0000","last_active":"2024-09-21T00:58:25.657190+0000","last_peered":"2024-09-21T00:58:25.657190+0000","last_clean":"2024-09-21T00:58:25.657190+0000","last_became_active":"2024-09-21T00:56:48.641521+0000","last_became_peered":"2024-09-21T00:56:48.641521+0000","last_unstale":"2024-09-21T00:58:25.657190+0000","last_undegraded":"2024-09-21T00:58:25.657190+0000","last_fullsized":"2024-09-21T00:58:25.657190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:38.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'11","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.669776+0000","last_change":"2024-09-21T00:56:46.631037+0000","last_active":"2024-09-21T00:58:25.669776+0000","last_peered":"2024-09-21T00:58:25.669776+0000","last_clean":"2024-09-21T00:58:25.669776+0000","last_became_active":"2024-09-21T00:56:46.630612+0000","last_became_peered":"2024-09-21T00:56:46.630612+0000","last_unstale":"2024-09-21T00:58:25.669776+0000","last_undegraded":"2024-09-21T00:58:25.669776+0000","last_fullsized":"2024-09-21T00:58:25.669776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.390614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667871+0000","last_change":"2024-09-21T00:56:48.649774+0000","last_active":"2024-09-21T00:58:25.667871+0000","last_peered":"2024-09-21T00:58:25.667871+0000","last_clean":"2024-09-21T00:58:25.667871+0000","last_became_active":"2024-09-21T00:56:48.649380+0000","last_became_peered":"2024-09-21T00:56:48.649380+0000","last_unstale":"2024-09-21T00:58:25.667871+0000","last_undegraded":"2024-09-21T00:58:25.667871+0000","last_fullsized":"2024-09-21T00:58:25.667871+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:12.595820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766611+0000","last_change":"2024-09-21T00:56:47.391328+0000","last_active":"2024-09-21T00:57:26.766611+0000","last_peered":"2024-09-21T00:57:26.766611+0000","last_clean":"2024-09-21T00:57:26.766611+0000","last_became_active":"2024-09-21T00:56:47.390860+0000","last_became_peered":"2024-09-21T00:56:47.390860+0000","last_unstale":"2024-09-21T00:57:26.766611+0000","last_undegraded":"2024-09-21T00:57:26.766611+0000","last_fullsized":"2024-09-21T00:57:26.766611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:24.267908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.668870+0000","last_change":"2024-09-21T00:56:48.657644+0000","last_active":"2024-09-21T00:58:25.668870+0000","last_peered":"2024-09-21T00:58:25.668870+0000","last_clean":"2024-09-21T00:58:25.668870+0000","last_became_active":"2024-09-21T00:56:48.657263+0000","last_became_peered":"2024-09-21T00:56:48.657263+0000","last_unstale":"2024-09-21T00:58:25.668870+0000","last_undegraded":"2024-09-21T00:58:25.668870+0000","last_fullsized":"2024-09-21T00:58:25.668870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:20.635667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.861164+0000","last_change":"2024-09-21T00:57:26.861046+0000","last_active":"2024-09-21T00:57:26.861164+0000","last_peered":"2024-09-21T00:57:26.861164+0000","last_clean":"2024-09-21T00:57:26.861164+0000","last_became_active":"2024-09-21T00:57:26.860555+0000","last_became_peered":"2024-09-21T00:57:26.860555+0000","last_unstale":"2024-09-21T00:57:26.861164+0000","last_undegraded":"2024-09-21T00:57:26.861164+0000","last_fullsized":"2024-09-21T00:57:26.861164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.786618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.619200+0000","last_change":"2024-09-21T00:56:48.656028+0000","last_active":"2024-09-21T00:58:25.619200+0000","last_peered":"2024-09-21T00:58:25.619200+0000","last_clean":"2024-09-21T00:58:25.619200+0000","last_became_active":"2024-09-21T00:56:48.655380+0000","last_became_peered":"2024-09-21T00:56:48.655380+0000","last_unstale":"2024-09-21T00:58:25.619200+0000","last_undegraded":"2024-09-21T00:58:25.619200+0000","last_fullsized":"2024-09-21T00:58:25.619200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:37.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769373+0000","last_change":"2024-09-21T00:56:46.635884+0000","last_active":"2024-09-21T00:57:26.769373+0000","last_peered":"2024-09-21T00:57:26.769373+0000","last_clean":"2024-09-21T00:57:26.769373+0000","last_became_active":"2024-09-21T00:56:46.635545+0000","last_became_peered":"2024-09-21T00:56:46.635545+0000","last_unstale":"2024-09-21T00:57:26.769373+0000","last_undegraded":"2024-09-21T00:57:26.769373+0000","last_fullsized":"2024-09-21T00:57:26.769373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:03.170611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658287+0000","last_change":"2024-09-21T00:56:48.649548+0000","last_active":"2024-09-21T00:58:25.658287+0000","last_peered":"2024-09-21T00:58:25.658287+0000","last_clean":"2024-09-21T00:58:25.658287+0000","last_became_active":"2024-09-21T00:56:48.649157+0000","last_became_peered":"2024-09-21T00:56:48.649157+0000","last_unstale":"2024-09-21T00:58:25.658287+0000","last_undegraded":"2024-09-21T00:58:25.658287+0000","last_fullsized":"2024-09-21T00:58:25.658287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:46.794274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766443+0000","last_change":"2024-09-21T00:56:46.632139+0000","last_active":"2024-09-21T00:57:26.766443+0000","last_peered":"2024-09-21T00:57:26.766443+0000","last_clean":"2024-09-21T00:57:26.766443+0000","last_became_active":"2024-09-21T00:56:46.631680+0000","last_became_peered":"2024-09-21T00:56:46.631680+0000","last_unstale":"2024-09-21T00:57:26.766443+0000","last_undegraded":"2024-09-21T00:57:26.766443+0000","last_fullsized":"2024-09-21T00:57:26.766443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:21:17.909161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667922+0000","last_change":"2024-09-21T00:56:48.654956+0000","last_active":"2024-09-21T00:58:25.667922+0000","last_peered":"2024-09-21T00:58:25.667922+0000","last_clean":"2024-09-21T00:58:25.667922+0000","last_became_active":"2024-09-21T00:56:48.654354+0000","last_became_peered":"2024-09-21T00:56:48.654354+0000","last_unstale":"2024-09-21T00:58:25.667922+0000","last_undegraded":"2024-09-21T00:58:25.667922+0000","last_fullsized":"2024-09-21T00:58:25.667922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:56.540664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.773409+0000","last_change":"2024-09-21T00:57:26.773289+0000","last_active":"2024-09-21T00:57:26.773409+0000","last_peered":"2024-09-21T00:57:26.773409+0000","last_clean":"2024-09-21T00:57:26.773409+0000","last_became_active":"2024-09-21T00:57:26.768686+0000","last_became_peered":"2024-09-21T00:57:26.768686+0000","last_unstale":"2024-09-21T00:57:26.773409+0000","last_undegraded":"2024-09-21T00:57:26.773409+0000","last_fullsized":"2024-09-21T00:57:26.773409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:04.247758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.673751+0000","last_change":"2024-09-21T00:56:48.647881+0000","last_active":"2024-09-21T00:58:25.673751+0000","last_peered":"2024-09-21T00:58:25.673751+0000","last_clean":"2024-09-21T00:58:25.673751+0000","last_became_active":"2024-09-21T00:56:48.647391+0000","last_became_peered":"2024-09-21T00:56:48.647391+0000","last_unstale":"2024-09-21T00:58:25.673751+0000","last_undegraded":"2024-09-21T00:58:25.673751+0000","last_fullsized":"2024-09-21T00:58:25.673751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:57.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665664+0000","last_change":"2024-09-21T00:56:48.662093+0000","last_active":"2024-09-21T00:58:25.665664+0000","last_peered":"2024-09-21T00:58:25.665664+0000","last_clean":"2024-09-21T00:58:25.665664+0000","last_became_active":"2024-09-21T00:56:48.661652+0000","last_became_peered":"2024-09-21T00:56:48.661652+0000","last_unstale":"2024-09-21T00:58:25.665664+0000","last_undegraded":"2024-09-21T00:58:25.665664+0000","last_fullsized":"2024-09-21T00:58:25.665664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:42:29.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761597+0000","last_change":"2024-09-21T00:56:46.633958+0000","last_active":"2024-09-21T00:57:26.761597+0000","last_peered":"2024-09-21T00:57:26.761597+0000","last_clean":"2024-09-21T00:57:26.761597+0000","last_became_active":"2024-09-21T00:56:46.633473+0000","last_became_peered":"2024-09-21T00:56:46.633473+0000","last_unstale":"2024-09-21T00:57:26.761597+0000","last_undegraded":"2024-09-21T00:57:26.761597+0000","last_fullsized":"2024-09-21T00:57:26.761597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:03:41.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764943+0000","last_change":"2024-09-21T00:56:48.647961+0000","last_active":"2024-09-21T00:57:26.764943+0000","last_peered":"2024-09-21T00:57:26.764943+0000","last_clean":"2024-09-21T00:57:26.764943+0000","last_became_active":"2024-09-21T00:56:48.647301+0000","last_became_peered":"2024-09-21T00:56:48.647301+0000","last_unstale":"2024-09-21T00:57:26.764943+0000","last_undegraded":"2024-09-21T00:57:26.764943+0000","last_fullsized":"2024-09-21T00:57:26.764943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:21.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761236+0000","last_change":"2024-09-21T00:56:46.637114+0000","last_active":"2024-09-21T00:57:26.761236+0000","last_peered":"2024-09-21T00:57:26.761236+0000","last_clean":"2024-09-21T00:57:26.761236+0000","last_became_active":"2024-09-21T00:56:46.636244+0000","last_became_peered":"2024-09-21T00:56:46.636244+0000","last_unstale":"2024-09-21T00:57:26.761236+0000","last_undegraded":"2024-09-21T00:57:26.761236+0000","last_fullsized":"2024-09-21T00:57:26.761236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:36.374016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.672155+0000","last_change":"2024-09-21T00:56:48.647249+0000","last_active":"2024-09-21T00:58:25.672155+0000","last_peered":"2024-09-21T00:58:25.672155+0000","last_clean":"2024-09-21T00:58:25.672155+0000","last_became_active":"2024-09-21T00:56:48.646888+0000","last_became_peered":"2024-09-21T00:56:48.646888+0000","last_unstale":"2024-09-21T00:58:25.672155+0000","last_undegraded":"2024-09-21T00:58:25.672155+0000","last_fullsized":"2024-09-21T00:58:25.672155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:02.997909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770241+0000","last_change":"2024-09-21T00:56:46.642781+0000","last_active":"2024-09-21T00:57:26.770241+0000","last_peered":"2024-09-21T00:57:26.770241+0000","last_clean":"2024-09-21T00:57:26.770241+0000","last_became_active":"2024-09-21T00:56:46.642346+0000","last_became_peered":"2024-09-21T00:56:46.642346+0000","last_unstale":"2024-09-21T00:57:26.770241+0000","last_undegraded":"2024-09-21T00:57:26.770241+0000","last_fullsized":"2024-09-21T00:57:26.770241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.050014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660933+0000","last_change":"2024-09-21T00:56:48.651942+0000","last_active":"2024-09-21T00:58:25.660933+0000","last_peered":"2024-09-21T00:58:25.660933+0000","last_clean":"2024-09-21T00:58:25.660933+0000","last_became_active":"2024-09-21T00:56:48.650577+0000","last_became_peered":"2024-09-21T00:56:48.650577+0000","last_unstale":"2024-09-21T00:58:25.660933+0000","last_undegraded":"2024-09-21T00:58:25.660933+0000","last_fullsized":"2024-09-21T00:58:25.660933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:44.176473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760475+0000","last_change":"2024-09-21T00:56:46.634428+0000","last_active":"2024-09-21T00:57:26.760475+0000","last_peered":"2024-09-21T00:57:26.760475+0000","last_clean":"2024-09-21T00:57:26.760475+0000","last_became_active":"2024-09-21T00:56:46.634037+0000","last_became_peered":"2024-09-21T00:56:46.634037+0000","last_unstale":"2024-09-21T00:57:26.760475+0000","last_undegraded":"2024-09-21T00:57:26.760475+0000","last_fullsized":"2024-09-21T00:57:26.760475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:25.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68312,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":197,"num_read_kb":166,"num_write":91,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":204379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743455,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":402083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939685,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1060276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":402782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":402687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495668,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":993150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40312,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704840,"statfs":{"total":95995035648,"available":95953756160,"internally_reserved":0,"allocated":827392,"data_stored":402200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":992750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":402105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":402304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":469631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":469040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":402173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:58:30.558 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T00:58:30.558 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T00:58:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 -- 172.21.15.47:0/3795486891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec102570 msgr2=0x7f71ec1029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 --2- 172.21.15.47:0/3795486891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec102570 0x7f71ec1029e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009900 tx=0x7f71dc02a410 comp rx=0 tx=0).stop 2024-09-21T00:58:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 -- 172.21.15.47:0/3795486891 shutdown_connections 2024-09-21T00:58:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 --2- 172.21.15.47:0/3795486891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71ec103f90 0x7f71ec10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 --2- 172.21.15.47:0/3795486891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec1035f0 0x7f71ec103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 --2- 172.21.15.47:0/3795486891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec102570 0x7f71ec1029e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 -- 172.21.15.47:0/3795486891 >> 172.21.15.47:0/3795486891 conn(0x7f71ec0fdeb0 msgr2=0x7f71ec100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:30.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 -- 172.21.15.47:0/3795486891 shutdown_connections 2024-09-21T00:58:30.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 -- 172.21.15.47:0/3795486891 wait complete. 2024-09-21T00:58:30.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.707+0000 7f71f12bd640 1 Processor -- start 2024-09-21T00:58:30.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71f12bd640 1 -- start start 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71f12bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71ec102570 0x7f71ec199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71f12bd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec1035f0 0x7f71ec19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71f12bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec103f90 0x7f71ec19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71f12bd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec10e1c0 con 0x7f71ec103f90 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71f12bd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec10e040 con 0x7f71ec102570 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71f12bd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec10e340 con 0x7f71ec1035f0 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec103f90 0x7f71ec19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec103f90 0x7f71ec19b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58678/0 (socket says 172.21.15.47:58678) 2024-09-21T00:58:30.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eb7fe640 1 -- 172.21.15.47:0/153319188 learned_addr learned my addr 172.21.15.47:0/153319188 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eaffd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71ec102570 0x7f71ec199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71ea7fc640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec1035f0 0x7f71ec19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eb7fe640 1 -- 172.21.15.47:0/153319188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec1035f0 msgr2=0x7f71ec19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eb7fe640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec1035f0 0x7f71ec19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eb7fe640 1 -- 172.21.15.47:0/153319188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71ec102570 msgr2=0x7f71ec199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eb7fe640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71ec102570 0x7f71ec199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71eb7fe640 1 -- 172.21.15.47:0/153319188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec19b960 con 0x7f71ec103f90 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.708+0000 7f71ea7fc640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec1035f0 0x7f71ec19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.709+0000 7f71eb7fe640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec103f90 0x7f71ec19b140 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f71e400eaa0 tx=0x7f71e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.709+0000 7f71d3fff640 1 -- 172.21.15.47:0/153319188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e400cdb0 con 0x7f71ec103f90 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.709+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ec19bc50 con 0x7f71ec103f90 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.709+0000 7f71d3fff640 1 -- 172.21.15.47:0/153319188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e4005020 con 0x7f71ec103f90 2024-09-21T00:58:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.709+0000 7f71d3fff640 1 -- 172.21.15.47:0/153319188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e40116d0 con 0x7f71ec103f90 2024-09-21T00:58:30.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.709+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ec1a2340 con 0x7f71ec103f90 2024-09-21T00:58:30.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.710+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ec1a2510 con 0x7f71ec103f90 2024-09-21T00:58:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.711+0000 7f71d3fff640 1 -- 172.21.15.47:0/153319188 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f71e40051d0 con 0x7f71ec103f90 2024-09-21T00:58:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.712+0000 7f71d3fff640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f71d40b6510 0x7f71d40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.713+0000 7f71eaffd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f71d40b6510 0x7f71d40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.713+0000 7f71d3fff640 1 -- 172.21.15.47:0/153319188 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f71e40e78a0 con 0x7f71ec103f90 2024-09-21T00:58:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.713+0000 7f71eaffd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f71d40b6510 0x7f71d40b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f71dc000c00 tx=0x7f71dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.716+0000 7f71d3fff640 1 -- 172.21.15.47:0/153319188 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71e4016030 con 0x7f71ec103f90 2024-09-21T00:58:30.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:30 smithi134 ceph-mon[34785]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-09-21T00:58:30.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.900+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 --> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71ec0ffe70 con 0x7f71d40b6510 2024-09-21T00:58:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.904+0000 7f71d3fff640 1 -- 172.21.15.47:0/153319188 <== mgr.14152 v2:172.21.15.47:6800/2364161608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258882 (secure 0 0 0) 0x7f71ec0ffe70 con 0x7f71d40b6510 2024-09-21T00:58:30.908 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:30.909 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-21T00:58:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f71d40b6510 msgr2=0x7f71d40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f71d40b6510 0x7f71d40b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f71dc000c00 tx=0x7f71dc031400 comp rx=0 tx=0).stop 2024-09-21T00:58:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec103f90 msgr2=0x7f71ec19b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec103f90 0x7f71ec19b140 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f71e400eaa0 tx=0x7f71e400ef60 comp rx=0 tx=0).stop 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 shutdown_connections 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f71d40b6510 0x7f71d40b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71ec103f90 0x7f71ec19b140 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec1035f0 0x7f71ec19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 --2- 172.21.15.47:0/153319188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71ec102570 0x7f71ec199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 >> 172.21.15.47:0/153319188 conn(0x7f71ec0fdeb0 msgr2=0x7f71ec0ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 shutdown_connections 2024-09-21T00:58:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:30.908+0000 7f71f12bd640 1 -- 172.21.15.47:0/153319188 wait complete. 2024-09-21T00:58:30.911 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:30 smithi114 ceph-mon[34309]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-09-21T00:58:30.919 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:30 smithi047 ceph-mon[30960]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-09-21T00:58:30.920 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-21T00:58:29.281141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658914,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":273,"num_read_kb":230,"num_write":216,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":608,"ondisk_log_size":608,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381772,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560052,"statfs":{"total":1151940427776,"available":1151549493248,"internally_reserved":0,"allocated":11980800,"data_stored":6801181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":557,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003699"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671519+0000","last_change":"2024-09-21T00:56:48.655444+0000","last_active":"2024-09-21T00:58:25.671519+0000","last_peered":"2024-09-21T00:58:25.671519+0000","last_clean":"2024-09-21T00:58:25.671519+0000","last_became_active":"2024-09-21T00:56:48.655083+0000","last_became_peered":"2024-09-21T00:56:48.655083+0000","last_unstale":"2024-09-21T00:58:25.671519+0000","last_undegraded":"2024-09-21T00:58:25.671519+0000","last_fullsized":"2024-09-21T00:58:25.671519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:07.300682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664410+0000","last_change":"2024-09-21T00:56:48.655066+0000","last_active":"2024-09-21T00:58:25.664410+0000","last_peered":"2024-09-21T00:58:25.664410+0000","last_clean":"2024-09-21T00:58:25.664410+0000","last_became_active":"2024-09-21T00:56:48.654679+0000","last_became_peered":"2024-09-21T00:56:48.654679+0000","last_unstale":"2024-09-21T00:58:25.664410+0000","last_undegraded":"2024-09-21T00:58:25.664410+0000","last_fullsized":"2024-09-21T00:58:25.664410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:24.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671983+0000","last_change":"2024-09-21T00:56:48.648770+0000","last_active":"2024-09-21T00:58:25.671983+0000","last_peered":"2024-09-21T00:58:25.671983+0000","last_clean":"2024-09-21T00:58:25.671983+0000","last_became_active":"2024-09-21T00:56:48.648383+0000","last_became_peered":"2024-09-21T00:56:48.648383+0000","last_unstale":"2024-09-21T00:58:25.671983+0000","last_undegraded":"2024-09-21T00:58:25.671983+0000","last_fullsized":"2024-09-21T00:58:25.671983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.616648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658516+0000","last_change":"2024-09-21T00:57:26.767724+0000","last_active":"2024-09-21T00:58:25.658516+0000","last_peered":"2024-09-21T00:58:25.658516+0000","last_clean":"2024-09-21T00:58:25.658516+0000","last_became_active":"2024-09-21T00:57:26.767233+0000","last_became_peered":"2024-09-21T00:57:26.767233+0000","last_unstale":"2024-09-21T00:58:25.658516+0000","last_undegraded":"2024-09-21T00:58:25.658516+0000","last_fullsized":"2024-09-21T00:58:25.658516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:41.905543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661493+0000","last_change":"2024-09-21T00:56:48.654307+0000","last_active":"2024-09-21T00:58:25.661493+0000","last_peered":"2024-09-21T00:58:25.661493+0000","last_clean":"2024-09-21T00:58:25.661493+0000","last_became_active":"2024-09-21T00:56:48.653898+0000","last_became_peered":"2024-09-21T00:56:48.653898+0000","last_unstale":"2024-09-21T00:58:25.661493+0000","last_undegraded":"2024-09-21T00:58:25.661493+0000","last_fullsized":"2024-09-21T00:58:25.661493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:02.779650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.663654+0000","last_change":"2024-09-21T00:56:48.649950+0000","last_active":"2024-09-21T00:58:25.663654+0000","last_peered":"2024-09-21T00:58:25.663654+0000","last_clean":"2024-09-21T00:58:25.663654+0000","last_became_active":"2024-09-21T00:56:48.649305+0000","last_became_peered":"2024-09-21T00:56:48.649305+0000","last_unstale":"2024-09-21T00:58:25.663654+0000","last_undegraded":"2024-09-21T00:58:25.663654+0000","last_fullsized":"2024-09-21T00:58:25.663654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:56.456377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.656095+0000","last_change":"2024-09-21T00:56:48.656109+0000","last_active":"2024-09-21T00:58:25.656095+0000","last_peered":"2024-09-21T00:58:25.656095+0000","last_clean":"2024-09-21T00:58:25.656095+0000","last_became_active":"2024-09-21T00:56:48.654465+0000","last_became_peered":"2024-09-21T00:56:48.654465+0000","last_unstale":"2024-09-21T00:58:25.656095+0000","last_undegraded":"2024-09-21T00:58:25.656095+0000","last_fullsized":"2024-09-21T00:58:25.656095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:05.779845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667128+0000","last_change":"2024-09-21T00:56:48.656351+0000","last_active":"2024-09-21T00:58:25.667128+0000","last_peered":"2024-09-21T00:58:25.667128+0000","last_clean":"2024-09-21T00:58:25.667128+0000","last_became_active":"2024-09-21T00:56:48.654388+0000","last_became_peered":"2024-09-21T00:56:48.654388+0000","last_unstale":"2024-09-21T00:58:25.667128+0000","last_undegraded":"2024-09-21T00:58:25.667128+0000","last_fullsized":"2024-09-21T00:58:25.667128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:39.441882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764916+0000","last_change":"2024-09-21T00:56:48.661083+0000","last_active":"2024-09-21T00:57:26.764916+0000","last_peered":"2024-09-21T00:57:26.764916+0000","last_clean":"2024-09-21T00:57:26.764916+0000","last_became_active":"2024-09-21T00:56:48.660418+0000","last_became_peered":"2024-09-21T00:56:48.660418+0000","last_unstale":"2024-09-21T00:57:26.764916+0000","last_undegraded":"2024-09-21T00:57:26.764916+0000","last_fullsized":"2024-09-21T00:57:26.764916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:02.494368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664867+0000","last_change":"2024-09-21T00:56:48.660257+0000","last_active":"2024-09-21T00:58:25.664867+0000","last_peered":"2024-09-21T00:58:25.664867+0000","last_clean":"2024-09-21T00:58:25.664867+0000","last_became_active":"2024-09-21T00:56:48.659894+0000","last_became_peered":"2024-09-21T00:56:48.659894+0000","last_unstale":"2024-09-21T00:58:25.664867+0000","last_undegraded":"2024-09-21T00:58:25.664867+0000","last_fullsized":"2024-09-21T00:58:25.664867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:41.012107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665538+0000","last_change":"2024-09-21T00:56:48.653146+0000","last_active":"2024-09-21T00:58:25.665538+0000","last_peered":"2024-09-21T00:58:25.665538+0000","last_clean":"2024-09-21T00:58:25.665538+0000","last_became_active":"2024-09-21T00:56:48.652599+0000","last_became_peered":"2024-09-21T00:56:48.652599+0000","last_unstale":"2024-09-21T00:58:25.665538+0000","last_undegraded":"2024-09-21T00:58:25.665538+0000","last_fullsized":"2024-09-21T00:58:25.665538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:01:16.165386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655296+0000","last_change":"2024-09-21T00:56:48.659521+0000","last_active":"2024-09-21T00:58:25.655296+0000","last_peered":"2024-09-21T00:58:25.655296+0000","last_clean":"2024-09-21T00:58:25.655296+0000","last_became_active":"2024-09-21T00:56:48.658168+0000","last_became_peered":"2024-09-21T00:56:48.658168+0000","last_unstale":"2024-09-21T00:58:25.655296+0000","last_undegraded":"2024-09-21T00:58:25.655296+0000","last_fullsized":"2024-09-21T00:58:25.655296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:51.910450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665640+0000","last_change":"2024-09-21T00:56:48.652163+0000","last_active":"2024-09-21T00:58:25.665640+0000","last_peered":"2024-09-21T00:58:25.665640+0000","last_clean":"2024-09-21T00:58:25.665640+0000","last_became_active":"2024-09-21T00:56:48.651839+0000","last_became_peered":"2024-09-21T00:56:48.651839+0000","last_unstale":"2024-09-21T00:58:25.665640+0000","last_undegraded":"2024-09-21T00:58:25.665640+0000","last_fullsized":"2024-09-21T00:58:25.665640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:50.682747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.663614+0000","last_change":"2024-09-21T00:56:48.655106+0000","last_active":"2024-09-21T00:58:25.663614+0000","last_peered":"2024-09-21T00:58:25.663614+0000","last_clean":"2024-09-21T00:58:25.663614+0000","last_became_active":"2024-09-21T00:56:48.654722+0000","last_became_peered":"2024-09-21T00:56:48.654722+0000","last_unstale":"2024-09-21T00:58:25.663614+0000","last_undegraded":"2024-09-21T00:58:25.663614+0000","last_fullsized":"2024-09-21T00:58:25.663614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:36.023960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658630+0000","last_change":"2024-09-21T00:56:48.648935+0000","last_active":"2024-09-21T00:58:25.658630+0000","last_peered":"2024-09-21T00:58:25.658630+0000","last_clean":"2024-09-21T00:58:25.658630+0000","last_became_active":"2024-09-21T00:56:48.648557+0000","last_became_peered":"2024-09-21T00:56:48.648557+0000","last_unstale":"2024-09-21T00:58:25.658630+0000","last_undegraded":"2024-09-21T00:58:25.658630+0000","last_fullsized":"2024-09-21T00:58:25.658630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:17.791401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764496+0000","last_change":"2024-09-21T00:56:48.651338+0000","last_active":"2024-09-21T00:57:26.764496+0000","last_peered":"2024-09-21T00:57:26.764496+0000","last_clean":"2024-09-21T00:57:26.764496+0000","last_became_active":"2024-09-21T00:56:48.650940+0000","last_became_peered":"2024-09-21T00:56:48.650940+0000","last_unstale":"2024-09-21T00:57:26.764496+0000","last_undegraded":"2024-09-21T00:57:26.764496+0000","last_fullsized":"2024-09-21T00:57:26.764496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:17:31.927818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671778+0000","last_change":"2024-09-21T00:56:48.655091+0000","last_active":"2024-09-21T00:58:25.671778+0000","last_peered":"2024-09-21T00:58:25.671778+0000","last_clean":"2024-09-21T00:58:25.671778+0000","last_became_active":"2024-09-21T00:56:48.654534+0000","last_became_peered":"2024-09-21T00:56:48.654534+0000","last_unstale":"2024-09-21T00:58:25.671778+0000","last_undegraded":"2024-09-21T00:58:25.671778+0000","last_fullsized":"2024-09-21T00:58:25.671778+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:44.007171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.674445+0000","last_change":"2024-09-21T00:56:48.654933+0000","last_active":"2024-09-21T00:58:25.674445+0000","last_peered":"2024-09-21T00:58:25.674445+0000","last_clean":"2024-09-21T00:58:25.674445+0000","last_became_active":"2024-09-21T00:56:48.654523+0000","last_became_peered":"2024-09-21T00:56:48.654523+0000","last_unstale":"2024-09-21T00:58:25.674445+0000","last_undegraded":"2024-09-21T00:58:25.674445+0000","last_fullsized":"2024-09-21T00:58:25.674445+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:58.190118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658456+0000","last_change":"2024-09-21T00:56:48.645166+0000","last_active":"2024-09-21T00:58:25.658456+0000","last_peered":"2024-09-21T00:58:25.658456+0000","last_clean":"2024-09-21T00:58:25.658456+0000","last_became_active":"2024-09-21T00:56:48.644695+0000","last_became_peered":"2024-09-21T00:56:48.644695+0000","last_unstale":"2024-09-21T00:58:25.658456+0000","last_undegraded":"2024-09-21T00:58:25.658456+0000","last_fullsized":"2024-09-21T00:58:25.658456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:24:07.564405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.662258+0000","last_change":"2024-09-21T00:56:48.659215+0000","last_active":"2024-09-21T00:58:25.662258+0000","last_peered":"2024-09-21T00:58:25.662258+0000","last_clean":"2024-09-21T00:58:25.662258+0000","last_became_active":"2024-09-21T00:56:48.658783+0000","last_became_peered":"2024-09-21T00:56:48.658783+0000","last_unstale":"2024-09-21T00:58:25.662258+0000","last_undegraded":"2024-09-21T00:58:25.662258+0000","last_fullsized":"2024-09-21T00:58:25.662258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:08:58.663963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.674676+0000","last_change":"2024-09-21T00:56:48.644461+0000","last_active":"2024-09-21T00:58:25.674676+0000","last_peered":"2024-09-21T00:58:25.674676+0000","last_clean":"2024-09-21T00:58:25.674676+0000","last_became_active":"2024-09-21T00:56:48.643842+0000","last_became_peered":"2024-09-21T00:56:48.643842+0000","last_unstale":"2024-09-21T00:58:25.674676+0000","last_undegraded":"2024-09-21T00:58:25.674676+0000","last_fullsized":"2024-09-21T00:58:25.674676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:12.673501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764701+0000","last_change":"2024-09-21T00:56:48.651212+0000","last_active":"2024-09-21T00:57:26.764701+0000","last_peered":"2024-09-21T00:57:26.764701+0000","last_clean":"2024-09-21T00:57:26.764701+0000","last_became_active":"2024-09-21T00:56:48.650802+0000","last_became_peered":"2024-09-21T00:56:48.650802+0000","last_unstale":"2024-09-21T00:57:26.764701+0000","last_undegraded":"2024-09-21T00:57:26.764701+0000","last_fullsized":"2024-09-21T00:57:26.764701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:06.310898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661035+0000","last_change":"2024-09-21T00:56:48.647772+0000","last_active":"2024-09-21T00:58:25.661035+0000","last_peered":"2024-09-21T00:58:25.661035+0000","last_clean":"2024-09-21T00:58:25.661035+0000","last_became_active":"2024-09-21T00:56:48.647379+0000","last_became_peered":"2024-09-21T00:56:48.647379+0000","last_unstale":"2024-09-21T00:58:25.661035+0000","last_undegraded":"2024-09-21T00:58:25.661035+0000","last_fullsized":"2024-09-21T00:58:25.661035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:06.815357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660811+0000","last_change":"2024-09-21T00:56:48.655841+0000","last_active":"2024-09-21T00:58:25.660811+0000","last_peered":"2024-09-21T00:58:25.660811+0000","last_clean":"2024-09-21T00:58:25.660811+0000","last_became_active":"2024-09-21T00:56:48.655270+0000","last_became_peered":"2024-09-21T00:56:48.655270+0000","last_unstale":"2024-09-21T00:58:25.660811+0000","last_undegraded":"2024-09-21T00:58:25.660811+0000","last_fullsized":"2024-09-21T00:58:25.660811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:28.350627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661443+0000","last_change":"2024-09-21T00:56:48.659457+0000","last_active":"2024-09-21T00:58:25.661443+0000","last_peered":"2024-09-21T00:58:25.661443+0000","last_clean":"2024-09-21T00:58:25.661443+0000","last_became_active":"2024-09-21T00:56:48.658999+0000","last_became_peered":"2024-09-21T00:56:48.658999+0000","last_unstale":"2024-09-21T00:58:25.661443+0000","last_undegraded":"2024-09-21T00:58:25.661443+0000","last_fullsized":"2024-09-21T00:58:25.661443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:56.196167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655752+0000","last_change":"2024-09-21T00:56:48.656361+0000","last_active":"2024-09-21T00:58:25.655752+0000","last_peered":"2024-09-21T00:58:25.655752+0000","last_clean":"2024-09-21T00:58:25.655752+0000","last_became_active":"2024-09-21T00:56:48.655999+0000","last_became_peered":"2024-09-21T00:56:48.655999+0000","last_unstale":"2024-09-21T00:58:25.655752+0000","last_undegraded":"2024-09-21T00:58:25.655752+0000","last_fullsized":"2024-09-21T00:58:25.655752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:46.533280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659095+0000","last_change":"2024-09-21T00:56:48.656549+0000","last_active":"2024-09-21T00:58:25.659095+0000","last_peered":"2024-09-21T00:58:25.659095+0000","last_clean":"2024-09-21T00:58:25.659095+0000","last_became_active":"2024-09-21T00:56:48.656154+0000","last_became_peered":"2024-09-21T00:56:48.656154+0000","last_unstale":"2024-09-21T00:58:25.659095+0000","last_undegraded":"2024-09-21T00:58:25.659095+0000","last_fullsized":"2024-09-21T00:58:25.659095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:37.244726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665129+0000","last_change":"2024-09-21T00:56:48.645857+0000","last_active":"2024-09-21T00:58:25.665129+0000","last_peered":"2024-09-21T00:58:25.665129+0000","last_clean":"2024-09-21T00:58:25.665129+0000","last_became_active":"2024-09-21T00:56:48.644462+0000","last_became_peered":"2024-09-21T00:56:48.644462+0000","last_unstale":"2024-09-21T00:58:25.665129+0000","last_undegraded":"2024-09-21T00:58:25.665129+0000","last_fullsized":"2024-09-21T00:58:25.665129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:11.690074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661786+0000","last_change":"2024-09-21T00:56:48.649937+0000","last_active":"2024-09-21T00:58:25.661786+0000","last_peered":"2024-09-21T00:58:25.661786+0000","last_clean":"2024-09-21T00:58:25.661786+0000","last_became_active":"2024-09-21T00:56:48.649233+0000","last_became_peered":"2024-09-21T00:56:48.649233+0000","last_unstale":"2024-09-21T00:58:25.661786+0000","last_undegraded":"2024-09-21T00:58:25.661786+0000","last_fullsized":"2024-09-21T00:58:25.661786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:00.529143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658465+0000","last_change":"2024-09-21T00:56:48.645824+0000","last_active":"2024-09-21T00:58:25.658465+0000","last_peered":"2024-09-21T00:58:25.658465+0000","last_clean":"2024-09-21T00:58:25.658465+0000","last_became_active":"2024-09-21T00:56:48.645452+0000","last_became_peered":"2024-09-21T00:56:48.645452+0000","last_unstale":"2024-09-21T00:58:25.658465+0000","last_undegraded":"2024-09-21T00:58:25.658465+0000","last_fullsized":"2024-09-21T00:58:25.658465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:40.228469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658560+0000","last_change":"2024-09-21T00:57:26.769121+0000","last_active":"2024-09-21T00:58:25.658560+0000","last_peered":"2024-09-21T00:58:25.658560+0000","last_clean":"2024-09-21T00:58:25.658560+0000","last_became_active":"2024-09-21T00:57:26.768532+0000","last_became_peered":"2024-09-21T00:57:26.768532+0000","last_unstale":"2024-09-21T00:58:25.658560+0000","last_undegraded":"2024-09-21T00:58:25.658560+0000","last_fullsized":"2024-09-21T00:58:25.658560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:57.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658300+0000","last_change":"2024-09-21T00:56:48.656431+0000","last_active":"2024-09-21T00:58:25.658300+0000","last_peered":"2024-09-21T00:58:25.658300+0000","last_clean":"2024-09-21T00:58:25.658300+0000","last_became_active":"2024-09-21T00:56:48.656080+0000","last_became_peered":"2024-09-21T00:56:48.656080+0000","last_unstale":"2024-09-21T00:58:25.658300+0000","last_undegraded":"2024-09-21T00:58:25.658300+0000","last_fullsized":"2024-09-21T00:58:25.658300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:00.068094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655004+0000","last_change":"2024-09-21T00:56:48.653355+0000","last_active":"2024-09-21T00:58:25.655004+0000","last_peered":"2024-09-21T00:58:25.655004+0000","last_clean":"2024-09-21T00:58:25.655004+0000","last_became_active":"2024-09-21T00:56:48.652959+0000","last_became_peered":"2024-09-21T00:56:48.652959+0000","last_unstale":"2024-09-21T00:58:25.655004+0000","last_undegraded":"2024-09-21T00:58:25.655004+0000","last_fullsized":"2024-09-21T00:58:25.655004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:16.462806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770600+0000","last_change":"2024-09-21T00:56:46.634744+0000","last_active":"2024-09-21T00:57:26.770600+0000","last_peered":"2024-09-21T00:57:26.770600+0000","last_clean":"2024-09-21T00:57:26.770600+0000","last_became_active":"2024-09-21T00:56:46.634367+0000","last_became_peered":"2024-09-21T00:56:46.634367+0000","last_unstale":"2024-09-21T00:57:26.770600+0000","last_undegraded":"2024-09-21T00:57:26.770600+0000","last_fullsized":"2024-09-21T00:57:26.770600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:40.923450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.661063+0000","last_change":"2024-09-21T00:56:48.660277+0000","last_active":"2024-09-21T00:58:25.661063+0000","last_peered":"2024-09-21T00:58:25.661063+0000","last_clean":"2024-09-21T00:58:25.661063+0000","last_became_active":"2024-09-21T00:56:48.659491+0000","last_became_peered":"2024-09-21T00:56:48.659491+0000","last_unstale":"2024-09-21T00:58:25.661063+0000","last_undegraded":"2024-09-21T00:58:25.661063+0000","last_fullsized":"2024-09-21T00:58:25.661063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:39.032704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858813+0000","last_change":"2024-09-21T00:56:46.634466+0000","last_active":"2024-09-21T00:57:26.858813+0000","last_peered":"2024-09-21T00:57:26.858813+0000","last_clean":"2024-09-21T00:57:26.858813+0000","last_became_active":"2024-09-21T00:56:46.634031+0000","last_became_peered":"2024-09-21T00:56:46.634031+0000","last_unstale":"2024-09-21T00:57:26.858813+0000","last_undegraded":"2024-09-21T00:57:26.858813+0000","last_fullsized":"2024-09-21T00:57:26.858813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:59:49.691014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858552+0000","last_change":"2024-09-21T00:56:46.628156+0000","last_active":"2024-09-21T00:57:26.858552+0000","last_peered":"2024-09-21T00:57:26.858552+0000","last_clean":"2024-09-21T00:57:26.858552+0000","last_became_active":"2024-09-21T00:56:46.627735+0000","last_became_peered":"2024-09-21T00:56:46.627735+0000","last_unstale":"2024-09-21T00:57:26.858552+0000","last_undegraded":"2024-09-21T00:57:26.858552+0000","last_fullsized":"2024-09-21T00:57:26.858552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:55.188016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660845+0000","last_change":"2024-09-21T00:56:48.649571+0000","last_active":"2024-09-21T00:58:25.660845+0000","last_peered":"2024-09-21T00:58:25.660845+0000","last_clean":"2024-09-21T00:58:25.660845+0000","last_became_active":"2024-09-21T00:56:48.647345+0000","last_became_peered":"2024-09-21T00:56:48.647345+0000","last_unstale":"2024-09-21T00:58:25.660845+0000","last_undegraded":"2024-09-21T00:58:25.660845+0000","last_fullsized":"2024-09-21T00:58:25.660845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:43.666739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770076+0000","last_change":"2024-09-21T00:56:46.634886+0000","last_active":"2024-09-21T00:57:26.770076+0000","last_peered":"2024-09-21T00:57:26.770076+0000","last_clean":"2024-09-21T00:57:26.770076+0000","last_became_active":"2024-09-21T00:56:46.634481+0000","last_became_peered":"2024-09-21T00:56:46.634481+0000","last_unstale":"2024-09-21T00:57:26.770076+0000","last_undegraded":"2024-09-21T00:57:26.770076+0000","last_fullsized":"2024-09-21T00:57:26.770076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:15.062776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.666669+0000","last_change":"2024-09-21T00:56:48.655740+0000","last_active":"2024-09-21T00:58:25.666669+0000","last_peered":"2024-09-21T00:58:25.666669+0000","last_clean":"2024-09-21T00:58:25.666669+0000","last_became_active":"2024-09-21T00:56:48.655312+0000","last_became_peered":"2024-09-21T00:56:48.655312+0000","last_unstale":"2024-09-21T00:58:25.666669+0000","last_undegraded":"2024-09-21T00:58:25.666669+0000","last_fullsized":"2024-09-21T00:58:25.666669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:45.815954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859165+0000","last_change":"2024-09-21T00:56:46.636212+0000","last_active":"2024-09-21T00:57:26.859165+0000","last_peered":"2024-09-21T00:57:26.859165+0000","last_clean":"2024-09-21T00:57:26.859165+0000","last_became_active":"2024-09-21T00:56:46.635702+0000","last_became_peered":"2024-09-21T00:56:46.635702+0000","last_unstale":"2024-09-21T00:57:26.859165+0000","last_undegraded":"2024-09-21T00:57:26.859165+0000","last_fullsized":"2024-09-21T00:57:26.859165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:11.254349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.765366+0000","last_change":"2024-09-21T00:56:48.646300+0000","last_active":"2024-09-21T00:57:26.765366+0000","last_peered":"2024-09-21T00:57:26.765366+0000","last_clean":"2024-09-21T00:57:26.765366+0000","last_became_active":"2024-09-21T00:56:48.645906+0000","last_became_peered":"2024-09-21T00:56:48.645906+0000","last_unstale":"2024-09-21T00:57:26.765366+0000","last_undegraded":"2024-09-21T00:57:26.765366+0000","last_fullsized":"2024-09-21T00:57:26.765366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:47.593609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766522+0000","last_change":"2024-09-21T00:56:46.639405+0000","last_active":"2024-09-21T00:57:26.766522+0000","last_peered":"2024-09-21T00:57:26.766522+0000","last_clean":"2024-09-21T00:57:26.766522+0000","last_became_active":"2024-09-21T00:56:46.638659+0000","last_became_peered":"2024-09-21T00:56:46.638659+0000","last_unstale":"2024-09-21T00:57:26.766522+0000","last_undegraded":"2024-09-21T00:57:26.766522+0000","last_fullsized":"2024-09-21T00:57:26.766522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:19.718585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.651971+0000","last_change":"2024-09-21T00:56:48.657572+0000","last_active":"2024-09-21T00:58:25.651971+0000","last_peered":"2024-09-21T00:58:25.651971+0000","last_clean":"2024-09-21T00:58:25.651971+0000","last_became_active":"2024-09-21T00:56:48.657219+0000","last_became_peered":"2024-09-21T00:56:48.657219+0000","last_unstale":"2024-09-21T00:58:25.651971+0000","last_undegraded":"2024-09-21T00:58:25.651971+0000","last_fullsized":"2024-09-21T00:58:25.651971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:48.870835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770265+0000","last_change":"2024-09-21T00:56:46.642710+0000","last_active":"2024-09-21T00:57:26.770265+0000","last_peered":"2024-09-21T00:57:26.770265+0000","last_clean":"2024-09-21T00:57:26.770265+0000","last_became_active":"2024-09-21T00:56:46.642273+0000","last_became_peered":"2024-09-21T00:56:46.642273+0000","last_unstale":"2024-09-21T00:57:26.770265+0000","last_undegraded":"2024-09-21T00:57:26.770265+0000","last_fullsized":"2024-09-21T00:57:26.770265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.751651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.860956+0000","last_change":"2024-09-21T00:57:26.860826+0000","last_active":"2024-09-21T00:57:26.860956+0000","last_peered":"2024-09-21T00:57:26.860956+0000","last_clean":"2024-09-21T00:57:26.860956+0000","last_became_active":"2024-09-21T00:57:26.860389+0000","last_became_peered":"2024-09-21T00:57:26.860389+0000","last_unstale":"2024-09-21T00:57:26.860956+0000","last_undegraded":"2024-09-21T00:57:26.860956+0000","last_fullsized":"2024-09-21T00:57:26.860956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:52.229655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'31","reported_seq":247,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:26.675080+0000","last_change":"2024-09-21T00:56:46.639555+0000","last_active":"2024-09-21T00:58:26.675080+0000","last_peered":"2024-09-21T00:58:26.675080+0000","last_clean":"2024-09-21T00:58:26.675080+0000","last_became_active":"2024-09-21T00:56:46.639200+0000","last_became_peered":"2024-09-21T00:56:46.639200+0000","last_unstale":"2024-09-21T00:58:26.675080+0000","last_undegraded":"2024-09-21T00:58:26.675080+0000","last_fullsized":"2024-09-21T00:58:26.675080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:49.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67514,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":193,"num_read_kb":162,"num_write":31,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659583+0000","last_change":"2024-09-21T00:56:48.653950+0000","last_active":"2024-09-21T00:58:25.659583+0000","last_peered":"2024-09-21T00:58:25.659583+0000","last_clean":"2024-09-21T00:58:25.659583+0000","last_became_active":"2024-09-21T00:56:48.653570+0000","last_became_peered":"2024-09-21T00:56:48.653570+0000","last_unstale":"2024-09-21T00:58:25.659583+0000","last_undegraded":"2024-09-21T00:58:25.659583+0000","last_fullsized":"2024-09-21T00:58:25.659583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:43.708982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766728+0000","last_change":"2024-09-21T00:56:46.635861+0000","last_active":"2024-09-21T00:57:26.766728+0000","last_peered":"2024-09-21T00:57:26.766728+0000","last_clean":"2024-09-21T00:57:26.766728+0000","last_became_active":"2024-09-21T00:56:46.635452+0000","last_became_peered":"2024-09-21T00:56:46.635452+0000","last_unstale":"2024-09-21T00:57:26.766728+0000","last_undegraded":"2024-09-21T00:57:26.766728+0000","last_fullsized":"2024-09-21T00:57:26.766728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:15.591100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.670846+0000","last_change":"2024-09-21T00:56:48.645567+0000","last_active":"2024-09-21T00:58:25.670846+0000","last_peered":"2024-09-21T00:58:25.670846+0000","last_clean":"2024-09-21T00:58:25.670846+0000","last_became_active":"2024-09-21T00:56:48.644499+0000","last_became_peered":"2024-09-21T00:56:48.644499+0000","last_unstale":"2024-09-21T00:58:25.670846+0000","last_undegraded":"2024-09-21T00:58:25.670846+0000","last_fullsized":"2024-09-21T00:58:25.670846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:08.655065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770242+0000","last_change":"2024-09-21T00:56:46.633014+0000","last_active":"2024-09-21T00:57:26.770242+0000","last_peered":"2024-09-21T00:57:26.770242+0000","last_clean":"2024-09-21T00:57:26.770242+0000","last_became_active":"2024-09-21T00:56:46.632656+0000","last_became_peered":"2024-09-21T00:56:46.632656+0000","last_unstale":"2024-09-21T00:57:26.770242+0000","last_undegraded":"2024-09-21T00:57:26.770242+0000","last_fullsized":"2024-09-21T00:57:26.770242+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:46.270469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.673476+0000","last_change":"2024-09-21T00:56:48.659797+0000","last_active":"2024-09-21T00:58:25.673476+0000","last_peered":"2024-09-21T00:58:25.673476+0000","last_clean":"2024-09-21T00:58:25.673476+0000","last_became_active":"2024-09-21T00:56:48.659430+0000","last_became_peered":"2024-09-21T00:56:48.659430+0000","last_unstale":"2024-09-21T00:58:25.673476+0000","last_undegraded":"2024-09-21T00:58:25.673476+0000","last_fullsized":"2024-09-21T00:58:25.673476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:45.006414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766061+0000","last_change":"2024-09-21T00:56:46.636792+0000","last_active":"2024-09-21T00:57:26.766061+0000","last_peered":"2024-09-21T00:57:26.766061+0000","last_clean":"2024-09-21T00:57:26.766061+0000","last_became_active":"2024-09-21T00:56:46.636383+0000","last_became_peered":"2024-09-21T00:56:46.636383+0000","last_unstale":"2024-09-21T00:57:26.766061+0000","last_undegraded":"2024-09-21T00:57:26.766061+0000","last_fullsized":"2024-09-21T00:57:26.766061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:39:37.078166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655806+0000","last_change":"2024-09-21T00:56:48.657065+0000","last_active":"2024-09-21T00:58:25.655806+0000","last_peered":"2024-09-21T00:58:25.655806+0000","last_clean":"2024-09-21T00:58:25.655806+0000","last_became_active":"2024-09-21T00:56:48.656658+0000","last_became_peered":"2024-09-21T00:56:48.656658+0000","last_unstale":"2024-09-21T00:58:25.655806+0000","last_undegraded":"2024-09-21T00:58:25.655806+0000","last_fullsized":"2024-09-21T00:58:25.655806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:10:31.713457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761028+0000","last_change":"2024-09-21T00:56:46.642099+0000","last_active":"2024-09-21T00:57:26.761028+0000","last_peered":"2024-09-21T00:57:26.761028+0000","last_clean":"2024-09-21T00:57:26.761028+0000","last_became_active":"2024-09-21T00:56:46.641526+0000","last_became_peered":"2024-09-21T00:56:46.641526+0000","last_unstale":"2024-09-21T00:57:26.761028+0000","last_undegraded":"2024-09-21T00:57:26.761028+0000","last_fullsized":"2024-09-21T00:57:26.761028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:19:12.518759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665383+0000","last_change":"2024-09-21T00:56:48.660991+0000","last_active":"2024-09-21T00:58:25.665383+0000","last_peered":"2024-09-21T00:58:25.665383+0000","last_clean":"2024-09-21T00:58:25.665383+0000","last_became_active":"2024-09-21T00:56:48.660623+0000","last_became_peered":"2024-09-21T00:56:48.660623+0000","last_unstale":"2024-09-21T00:58:25.665383+0000","last_undegraded":"2024-09-21T00:58:25.665383+0000","last_fullsized":"2024-09-21T00:58:25.665383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:07:34.291977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761592+0000","last_change":"2024-09-21T00:56:46.637482+0000","last_active":"2024-09-21T00:57:26.761592+0000","last_peered":"2024-09-21T00:57:26.761592+0000","last_clean":"2024-09-21T00:57:26.761592+0000","last_became_active":"2024-09-21T00:56:46.634812+0000","last_became_peered":"2024-09-21T00:56:46.634812+0000","last_unstale":"2024-09-21T00:57:26.761592+0000","last_undegraded":"2024-09-21T00:57:26.761592+0000","last_fullsized":"2024-09-21T00:57:26.761592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:30.990625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659724+0000","last_change":"2024-09-21T00:56:48.658930+0000","last_active":"2024-09-21T00:58:25.659724+0000","last_peered":"2024-09-21T00:58:25.659724+0000","last_clean":"2024-09-21T00:58:25.659724+0000","last_became_active":"2024-09-21T00:56:48.658545+0000","last_became_peered":"2024-09-21T00:56:48.658545+0000","last_unstale":"2024-09-21T00:58:25.659724+0000","last_undegraded":"2024-09-21T00:58:25.659724+0000","last_fullsized":"2024-09-21T00:58:25.659724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:30:57.850371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.859892+0000","last_change":"2024-09-21T00:56:46.628768+0000","last_active":"2024-09-21T00:57:26.859892+0000","last_peered":"2024-09-21T00:57:26.859892+0000","last_clean":"2024-09-21T00:57:26.859892+0000","last_became_active":"2024-09-21T00:56:46.628374+0000","last_became_peered":"2024-09-21T00:56:46.628374+0000","last_unstale":"2024-09-21T00:57:26.859892+0000","last_undegraded":"2024-09-21T00:57:26.859892+0000","last_fullsized":"2024-09-21T00:57:26.859892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:58:15.133651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.664902+0000","last_change":"2024-09-21T00:56:48.648097+0000","last_active":"2024-09-21T00:58:25.664902+0000","last_peered":"2024-09-21T00:58:25.664902+0000","last_clean":"2024-09-21T00:58:25.664902+0000","last_became_active":"2024-09-21T00:56:48.647619+0000","last_became_peered":"2024-09-21T00:56:48.647619+0000","last_unstale":"2024-09-21T00:58:25.664902+0000","last_undegraded":"2024-09-21T00:58:25.664902+0000","last_fullsized":"2024-09-21T00:58:25.664902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:47:08.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770460+0000","last_change":"2024-09-21T00:56:46.636947+0000","last_active":"2024-09-21T00:57:26.770460+0000","last_peered":"2024-09-21T00:57:26.770460+0000","last_clean":"2024-09-21T00:57:26.770460+0000","last_became_active":"2024-09-21T00:56:46.636469+0000","last_became_peered":"2024-09-21T00:56:46.636469+0000","last_unstale":"2024-09-21T00:57:26.770460+0000","last_undegraded":"2024-09-21T00:57:26.770460+0000","last_fullsized":"2024-09-21T00:57:26.770460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:31.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.655895+0000","last_change":"2024-09-21T00:57:26.774145+0000","last_active":"2024-09-21T00:58:25.655895+0000","last_peered":"2024-09-21T00:58:25.655895+0000","last_clean":"2024-09-21T00:58:25.655895+0000","last_became_active":"2024-09-21T00:57:26.770919+0000","last_became_peered":"2024-09-21T00:57:26.770919+0000","last_unstale":"2024-09-21T00:58:25.655895+0000","last_undegraded":"2024-09-21T00:58:25.655895+0000","last_fullsized":"2024-09-21T00:58:25.655895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:21.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766495+0000","last_change":"2024-09-21T00:56:47.391206+0000","last_active":"2024-09-21T00:57:26.766495+0000","last_peered":"2024-09-21T00:57:26.766495+0000","last_clean":"2024-09-21T00:57:26.766495+0000","last_became_active":"2024-09-21T00:56:47.390708+0000","last_became_peered":"2024-09-21T00:56:47.390708+0000","last_unstale":"2024-09-21T00:57:26.766495+0000","last_undegraded":"2024-09-21T00:57:26.766495+0000","last_fullsized":"2024-09-21T00:57:26.766495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:59.632185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665899+0000","last_change":"2024-09-21T00:56:48.648452+0000","last_active":"2024-09-21T00:58:25.665899+0000","last_peered":"2024-09-21T00:58:25.665899+0000","last_clean":"2024-09-21T00:58:25.665899+0000","last_became_active":"2024-09-21T00:56:48.647682+0000","last_became_peered":"2024-09-21T00:56:48.647682+0000","last_unstale":"2024-09-21T00:58:25.665899+0000","last_undegraded":"2024-09-21T00:58:25.665899+0000","last_fullsized":"2024-09-21T00:58:25.665899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:45.844596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767189+0000","last_change":"2024-09-21T00:55:37.551147+0000","last_active":"2024-09-21T00:57:26.767189+0000","last_peered":"2024-09-21T00:57:26.767189+0000","last_clean":"2024-09-21T00:57:26.767189+0000","last_became_active":"2024-09-21T00:55:37.545124+0000","last_became_peered":"2024-09-21T00:55:37.545124+0000","last_unstale":"2024-09-21T00:57:26.767189+0000","last_undegraded":"2024-09-21T00:57:26.767189+0000","last_fullsized":"2024-09-21T00:57:26.767189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:52:17.996374+0000","last_clean_scrub_stamp":"2024-09-21T00:52:17.996374+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:42:20.205607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766410+0000","last_change":"2024-09-21T00:56:46.637264+0000","last_active":"2024-09-21T00:57:26.766410+0000","last_peered":"2024-09-21T00:57:26.766410+0000","last_clean":"2024-09-21T00:57:26.766410+0000","last_became_active":"2024-09-21T00:56:46.636320+0000","last_became_peered":"2024-09-21T00:56:46.636320+0000","last_unstale":"2024-09-21T00:57:26.766410+0000","last_undegraded":"2024-09-21T00:57:26.766410+0000","last_fullsized":"2024-09-21T00:57:26.766410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:42.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.666605+0000","last_change":"2024-09-21T00:56:48.651051+0000","last_active":"2024-09-21T00:58:25.666605+0000","last_peered":"2024-09-21T00:58:25.666605+0000","last_clean":"2024-09-21T00:58:25.666605+0000","last_became_active":"2024-09-21T00:56:48.650693+0000","last_became_peered":"2024-09-21T00:56:48.650693+0000","last_unstale":"2024-09-21T00:58:25.666605+0000","last_undegraded":"2024-09-21T00:58:25.666605+0000","last_fullsized":"2024-09-21T00:58:25.666605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:49.575213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767099+0000","last_change":"2024-09-21T00:56:46.634826+0000","last_active":"2024-09-21T00:57:26.767099+0000","last_peered":"2024-09-21T00:57:26.767099+0000","last_clean":"2024-09-21T00:57:26.767099+0000","last_became_active":"2024-09-21T00:56:46.634370+0000","last_became_peered":"2024-09-21T00:56:46.634370+0000","last_unstale":"2024-09-21T00:57:26.767099+0000","last_undegraded":"2024-09-21T00:57:26.767099+0000","last_fullsized":"2024-09-21T00:57:26.767099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:29.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.659724+0000","last_change":"2024-09-21T00:56:48.646296+0000","last_active":"2024-09-21T00:58:25.659724+0000","last_peered":"2024-09-21T00:58:25.659724+0000","last_clean":"2024-09-21T00:58:25.659724+0000","last_became_active":"2024-09-21T00:56:48.644271+0000","last_became_peered":"2024-09-21T00:56:48.644271+0000","last_unstale":"2024-09-21T00:58:25.659724+0000","last_undegraded":"2024-09-21T00:58:25.659724+0000","last_fullsized":"2024-09-21T00:58:25.659724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:27.609714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.858660+0000","last_change":"2024-09-21T00:56:46.641852+0000","last_active":"2024-09-21T00:57:26.858660+0000","last_peered":"2024-09-21T00:57:26.858660+0000","last_clean":"2024-09-21T00:57:26.858660+0000","last_became_active":"2024-09-21T00:56:46.641449+0000","last_became_peered":"2024-09-21T00:56:46.641449+0000","last_unstale":"2024-09-21T00:57:26.858660+0000","last_undegraded":"2024-09-21T00:57:26.858660+0000","last_fullsized":"2024-09-21T00:57:26.858660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:51.086321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.651867+0000","last_change":"2024-09-21T00:56:48.660295+0000","last_active":"2024-09-21T00:58:25.651867+0000","last_peered":"2024-09-21T00:58:25.651867+0000","last_clean":"2024-09-21T00:58:25.651867+0000","last_became_active":"2024-09-21T00:56:48.659638+0000","last_became_peered":"2024-09-21T00:56:48.659638+0000","last_unstale":"2024-09-21T00:58:25.651867+0000","last_undegraded":"2024-09-21T00:58:25.651867+0000","last_fullsized":"2024-09-21T00:58:25.651867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:34.719676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.767333+0000","last_change":"2024-09-21T00:56:46.639317+0000","last_active":"2024-09-21T00:57:26.767333+0000","last_peered":"2024-09-21T00:57:26.767333+0000","last_clean":"2024-09-21T00:57:26.767333+0000","last_became_active":"2024-09-21T00:56:46.638732+0000","last_became_peered":"2024-09-21T00:56:46.638732+0000","last_unstale":"2024-09-21T00:57:26.767333+0000","last_undegraded":"2024-09-21T00:57:26.767333+0000","last_fullsized":"2024-09-21T00:57:26.767333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:47.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.653953+0000","last_change":"2024-09-21T00:56:48.651038+0000","last_active":"2024-09-21T00:58:25.653953+0000","last_peered":"2024-09-21T00:58:25.653953+0000","last_clean":"2024-09-21T00:58:25.653953+0000","last_became_active":"2024-09-21T00:56:48.650682+0000","last_became_peered":"2024-09-21T00:56:48.650682+0000","last_unstale":"2024-09-21T00:58:25.653953+0000","last_undegraded":"2024-09-21T00:58:25.653953+0000","last_fullsized":"2024-09-21T00:58:25.653953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.015768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760268+0000","last_change":"2024-09-21T00:56:46.641993+0000","last_active":"2024-09-21T00:57:26.760268+0000","last_peered":"2024-09-21T00:57:26.760268+0000","last_clean":"2024-09-21T00:57:26.760268+0000","last_became_active":"2024-09-21T00:56:46.641631+0000","last_became_peered":"2024-09-21T00:56:46.641631+0000","last_unstale":"2024-09-21T00:57:26.760268+0000","last_undegraded":"2024-09-21T00:57:26.760268+0000","last_fullsized":"2024-09-21T00:57:26.760268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:12.986551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.671123+0000","last_change":"2024-09-21T00:56:48.649620+0000","last_active":"2024-09-21T00:58:25.671123+0000","last_peered":"2024-09-21T00:58:25.671123+0000","last_clean":"2024-09-21T00:58:25.671123+0000","last_became_active":"2024-09-21T00:56:48.645757+0000","last_became_peered":"2024-09-21T00:56:48.645757+0000","last_unstale":"2024-09-21T00:58:25.671123+0000","last_undegraded":"2024-09-21T00:58:25.671123+0000","last_fullsized":"2024-09-21T00:58:25.671123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:12.802042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761384+0000","last_change":"2024-09-21T00:56:46.641723+0000","last_active":"2024-09-21T00:57:26.761384+0000","last_peered":"2024-09-21T00:57:26.761384+0000","last_clean":"2024-09-21T00:57:26.761384+0000","last_became_active":"2024-09-21T00:56:46.641219+0000","last_became_peered":"2024-09-21T00:56:46.641219+0000","last_unstale":"2024-09-21T00:57:26.761384+0000","last_undegraded":"2024-09-21T00:57:26.761384+0000","last_fullsized":"2024-09-21T00:57:26.761384+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:47.676869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.657190+0000","last_change":"2024-09-21T00:56:48.641940+0000","last_active":"2024-09-21T00:58:25.657190+0000","last_peered":"2024-09-21T00:58:25.657190+0000","last_clean":"2024-09-21T00:58:25.657190+0000","last_became_active":"2024-09-21T00:56:48.641521+0000","last_became_peered":"2024-09-21T00:56:48.641521+0000","last_unstale":"2024-09-21T00:58:25.657190+0000","last_undegraded":"2024-09-21T00:58:25.657190+0000","last_fullsized":"2024-09-21T00:58:25.657190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:38.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'11","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.669776+0000","last_change":"2024-09-21T00:56:46.631037+0000","last_active":"2024-09-21T00:58:25.669776+0000","last_peered":"2024-09-21T00:58:25.669776+0000","last_clean":"2024-09-21T00:58:25.669776+0000","last_became_active":"2024-09-21T00:56:46.630612+0000","last_became_peered":"2024-09-21T00:56:46.630612+0000","last_unstale":"2024-09-21T00:58:25.669776+0000","last_undegraded":"2024-09-21T00:58:25.669776+0000","last_fullsized":"2024-09-21T00:58:25.669776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.390614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667871+0000","last_change":"2024-09-21T00:56:48.649774+0000","last_active":"2024-09-21T00:58:25.667871+0000","last_peered":"2024-09-21T00:58:25.667871+0000","last_clean":"2024-09-21T00:58:25.667871+0000","last_became_active":"2024-09-21T00:56:48.649380+0000","last_became_peered":"2024-09-21T00:56:48.649380+0000","last_unstale":"2024-09-21T00:58:25.667871+0000","last_undegraded":"2024-09-21T00:58:25.667871+0000","last_fullsized":"2024-09-21T00:58:25.667871+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:12.595820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766611+0000","last_change":"2024-09-21T00:56:47.391328+0000","last_active":"2024-09-21T00:57:26.766611+0000","last_peered":"2024-09-21T00:57:26.766611+0000","last_clean":"2024-09-21T00:57:26.766611+0000","last_became_active":"2024-09-21T00:56:47.390860+0000","last_became_peered":"2024-09-21T00:56:47.390860+0000","last_unstale":"2024-09-21T00:57:26.766611+0000","last_undegraded":"2024-09-21T00:57:26.766611+0000","last_fullsized":"2024-09-21T00:57:26.766611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:24.267908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.668870+0000","last_change":"2024-09-21T00:56:48.657644+0000","last_active":"2024-09-21T00:58:25.668870+0000","last_peered":"2024-09-21T00:58:25.668870+0000","last_clean":"2024-09-21T00:58:25.668870+0000","last_became_active":"2024-09-21T00:56:48.657263+0000","last_became_peered":"2024-09-21T00:56:48.657263+0000","last_unstale":"2024-09-21T00:58:25.668870+0000","last_undegraded":"2024-09-21T00:58:25.668870+0000","last_fullsized":"2024-09-21T00:58:25.668870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:20.635667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.861164+0000","last_change":"2024-09-21T00:57:26.861046+0000","last_active":"2024-09-21T00:57:26.861164+0000","last_peered":"2024-09-21T00:57:26.861164+0000","last_clean":"2024-09-21T00:57:26.861164+0000","last_became_active":"2024-09-21T00:57:26.860555+0000","last_became_peered":"2024-09-21T00:57:26.860555+0000","last_unstale":"2024-09-21T00:57:26.861164+0000","last_undegraded":"2024-09-21T00:57:26.861164+0000","last_fullsized":"2024-09-21T00:57:26.861164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.786618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.619200+0000","last_change":"2024-09-21T00:56:48.656028+0000","last_active":"2024-09-21T00:58:25.619200+0000","last_peered":"2024-09-21T00:58:25.619200+0000","last_clean":"2024-09-21T00:58:25.619200+0000","last_became_active":"2024-09-21T00:56:48.655380+0000","last_became_peered":"2024-09-21T00:56:48.655380+0000","last_unstale":"2024-09-21T00:58:25.619200+0000","last_undegraded":"2024-09-21T00:58:25.619200+0000","last_fullsized":"2024-09-21T00:58:25.619200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:37.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.769373+0000","last_change":"2024-09-21T00:56:46.635884+0000","last_active":"2024-09-21T00:57:26.769373+0000","last_peered":"2024-09-21T00:57:26.769373+0000","last_clean":"2024-09-21T00:57:26.769373+0000","last_became_active":"2024-09-21T00:56:46.635545+0000","last_became_peered":"2024-09-21T00:56:46.635545+0000","last_unstale":"2024-09-21T00:57:26.769373+0000","last_undegraded":"2024-09-21T00:57:26.769373+0000","last_fullsized":"2024-09-21T00:57:26.769373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:03.170611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.658287+0000","last_change":"2024-09-21T00:56:48.649548+0000","last_active":"2024-09-21T00:58:25.658287+0000","last_peered":"2024-09-21T00:58:25.658287+0000","last_clean":"2024-09-21T00:58:25.658287+0000","last_became_active":"2024-09-21T00:56:48.649157+0000","last_became_peered":"2024-09-21T00:56:48.649157+0000","last_unstale":"2024-09-21T00:58:25.658287+0000","last_undegraded":"2024-09-21T00:58:25.658287+0000","last_fullsized":"2024-09-21T00:58:25.658287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:46.794274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.766443+0000","last_change":"2024-09-21T00:56:46.632139+0000","last_active":"2024-09-21T00:57:26.766443+0000","last_peered":"2024-09-21T00:57:26.766443+0000","last_clean":"2024-09-21T00:57:26.766443+0000","last_became_active":"2024-09-21T00:56:46.631680+0000","last_became_peered":"2024-09-21T00:56:46.631680+0000","last_unstale":"2024-09-21T00:57:26.766443+0000","last_undegraded":"2024-09-21T00:57:26.766443+0000","last_fullsized":"2024-09-21T00:57:26.766443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:21:17.909161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.667922+0000","last_change":"2024-09-21T00:56:48.654956+0000","last_active":"2024-09-21T00:58:25.667922+0000","last_peered":"2024-09-21T00:58:25.667922+0000","last_clean":"2024-09-21T00:58:25.667922+0000","last_became_active":"2024-09-21T00:56:48.654354+0000","last_became_peered":"2024-09-21T00:56:48.654354+0000","last_unstale":"2024-09-21T00:58:25.667922+0000","last_undegraded":"2024-09-21T00:58:25.667922+0000","last_fullsized":"2024-09-21T00:58:25.667922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:56.540664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.773409+0000","last_change":"2024-09-21T00:57:26.773289+0000","last_active":"2024-09-21T00:57:26.773409+0000","last_peered":"2024-09-21T00:57:26.773409+0000","last_clean":"2024-09-21T00:57:26.773409+0000","last_became_active":"2024-09-21T00:57:26.768686+0000","last_became_peered":"2024-09-21T00:57:26.768686+0000","last_unstale":"2024-09-21T00:57:26.773409+0000","last_undegraded":"2024-09-21T00:57:26.773409+0000","last_fullsized":"2024-09-21T00:57:26.773409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:04.247758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.673751+0000","last_change":"2024-09-21T00:56:48.647881+0000","last_active":"2024-09-21T00:58:25.673751+0000","last_peered":"2024-09-21T00:58:25.673751+0000","last_clean":"2024-09-21T00:58:25.673751+0000","last_became_active":"2024-09-21T00:56:48.647391+0000","last_became_peered":"2024-09-21T00:56:48.647391+0000","last_unstale":"2024-09-21T00:58:25.673751+0000","last_undegraded":"2024-09-21T00:58:25.673751+0000","last_fullsized":"2024-09-21T00:58:25.673751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:57.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.665664+0000","last_change":"2024-09-21T00:56:48.662093+0000","last_active":"2024-09-21T00:58:25.665664+0000","last_peered":"2024-09-21T00:58:25.665664+0000","last_clean":"2024-09-21T00:58:25.665664+0000","last_became_active":"2024-09-21T00:56:48.661652+0000","last_became_peered":"2024-09-21T00:56:48.661652+0000","last_unstale":"2024-09-21T00:58:25.665664+0000","last_undegraded":"2024-09-21T00:58:25.665664+0000","last_fullsized":"2024-09-21T00:58:25.665664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:42:29.908634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761597+0000","last_change":"2024-09-21T00:56:46.633958+0000","last_active":"2024-09-21T00:57:26.761597+0000","last_peered":"2024-09-21T00:57:26.761597+0000","last_clean":"2024-09-21T00:57:26.761597+0000","last_became_active":"2024-09-21T00:56:46.633473+0000","last_became_peered":"2024-09-21T00:56:46.633473+0000","last_unstale":"2024-09-21T00:57:26.761597+0000","last_undegraded":"2024-09-21T00:57:26.761597+0000","last_fullsized":"2024-09-21T00:57:26.761597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:03:41.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.764943+0000","last_change":"2024-09-21T00:56:48.647961+0000","last_active":"2024-09-21T00:57:26.764943+0000","last_peered":"2024-09-21T00:57:26.764943+0000","last_clean":"2024-09-21T00:57:26.764943+0000","last_became_active":"2024-09-21T00:56:48.647301+0000","last_became_peered":"2024-09-21T00:56:48.647301+0000","last_unstale":"2024-09-21T00:57:26.764943+0000","last_undegraded":"2024-09-21T00:57:26.764943+0000","last_fullsized":"2024-09-21T00:57:26.764943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:19:21.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.761236+0000","last_change":"2024-09-21T00:56:46.637114+0000","last_active":"2024-09-21T00:57:26.761236+0000","last_peered":"2024-09-21T00:57:26.761236+0000","last_clean":"2024-09-21T00:57:26.761236+0000","last_became_active":"2024-09-21T00:56:46.636244+0000","last_became_peered":"2024-09-21T00:56:46.636244+0000","last_unstale":"2024-09-21T00:57:26.761236+0000","last_undegraded":"2024-09-21T00:57:26.761236+0000","last_fullsized":"2024-09-21T00:57:26.761236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:36.374016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.672155+0000","last_change":"2024-09-21T00:56:48.647249+0000","last_active":"2024-09-21T00:58:25.672155+0000","last_peered":"2024-09-21T00:58:25.672155+0000","last_clean":"2024-09-21T00:58:25.672155+0000","last_became_active":"2024-09-21T00:56:48.646888+0000","last_became_peered":"2024-09-21T00:56:48.646888+0000","last_unstale":"2024-09-21T00:58:25.672155+0000","last_undegraded":"2024-09-21T00:58:25.672155+0000","last_fullsized":"2024-09-21T00:58:25.672155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:02.997909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.770241+0000","last_change":"2024-09-21T00:56:46.642781+0000","last_active":"2024-09-21T00:57:26.770241+0000","last_peered":"2024-09-21T00:57:26.770241+0000","last_clean":"2024-09-21T00:57:26.770241+0000","last_became_active":"2024-09-21T00:56:46.642346+0000","last_became_peered":"2024-09-21T00:56:46.642346+0000","last_unstale":"2024-09-21T00:57:26.770241+0000","last_undegraded":"2024-09-21T00:57:26.770241+0000","last_fullsized":"2024-09-21T00:57:26.770241+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:16.050014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:58:25.660933+0000","last_change":"2024-09-21T00:56:48.651942+0000","last_active":"2024-09-21T00:58:25.660933+0000","last_peered":"2024-09-21T00:58:25.660933+0000","last_clean":"2024-09-21T00:58:25.660933+0000","last_became_active":"2024-09-21T00:56:48.650577+0000","last_became_peered":"2024-09-21T00:56:48.650577+0000","last_unstale":"2024-09-21T00:58:25.660933+0000","last_undegraded":"2024-09-21T00:58:25.660933+0000","last_fullsized":"2024-09-21T00:58:25.660933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:47.621600+0000","last_clean_scrub_stamp":"2024-09-21T00:56:47.621600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:44.176473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T00:57:26.760475+0000","last_change":"2024-09-21T00:56:46.634428+0000","last_active":"2024-09-21T00:57:26.760475+0000","last_peered":"2024-09-21T00:57:26.760475+0000","last_clean":"2024-09-21T00:57:26.760475+0000","last_became_active":"2024-09-21T00:56:46.634037+0000","last_became_peered":"2024-09-21T00:56:46.634037+0000","last_unstale":"2024-09-21T00:57:26.760475+0000","last_undegraded":"2024-09-21T00:57:26.760475+0000","last_fullsized":"2024-09-21T00:57:26.760475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T00:56:45.610057+0000","last_clean_scrub_stamp":"2024-09-21T00:56:45.610057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:25.293650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":442,"ondisk_log_size":442,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68312,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":197,"num_read_kb":166,"num_write":91,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":204379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743455,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":402083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939685,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1060276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":402782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":831488,"data_stored":402687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495668,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":993150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40312,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704840,"statfs":{"total":95995035648,"available":95953756160,"internally_reserved":0,"allocated":827392,"data_stored":402200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":992750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":402105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":402304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":469631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":469040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":402173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T00:58:30.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:58:31.218 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:31.622 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:31 smithi047 ceph-mon[30960]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.622 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:31 smithi047 ceph-mon[30960]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.622 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:31 smithi047 ceph-mon[30960]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 -- 172.21.15.47:0/3315167318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c8102a60 msgr2=0x7fd8c8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:31.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 --2- 172.21.15.47:0/3315167318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c8102a60 0x7fd8c8102e70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009900 tx=0x7fd8b802a410 comp rx=0 tx=0).stop 2024-09-21T00:58:31.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 -- 172.21.15.47:0/3315167318 shutdown_connections 2024-09-21T00:58:31.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 --2- 172.21.15.47:0/3315167318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c8108cf0 0x7fd8c810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 --2- 172.21.15.47:0/3315167318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8c81083a0 0x7fd8c81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 --2- 172.21.15.47:0/3315167318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c8102a60 0x7fd8c8102e70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 -- 172.21.15.47:0/3315167318 >> 172.21.15.47:0/3315167318 conn(0x7fd8c8079730 msgr2=0x7fd8c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:31.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 -- 172.21.15.47:0/3315167318 shutdown_connections 2024-09-21T00:58:31.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.713+0000 7fd8cebee640 1 -- 172.21.15.47:0/3315167318 wait complete. 2024-09-21T00:58:31.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cebee640 1 Processor -- start 2024-09-21T00:58:31.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cebee640 1 -- start start 2024-09-21T00:58:31.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cebee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8c8102a60 0x7fd8c819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:31.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cebee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c81083a0 0x7fd8c819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cebee640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c8108cf0 0x7fd8c81a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cebee640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8112960 con 0x7fd8c81083a0 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cebee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c81127e0 con 0x7fd8c8102a60 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cebee640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8112ae0 con 0x7fd8c8108cf0 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c81083a0 0x7fd8c819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c81083a0 0x7fd8c819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38530/0 (socket says 172.21.15.47:38530) 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8c7fff640 1 -- 172.21.15.47:0/1963234371 learned_addr learned my addr 172.21.15.47:0/1963234371 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cc98a640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8c8102a60 0x7fd8c819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.714+0000 7fd8cd18b640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c8108cf0 0x7fd8c81a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c7fff640 1 -- 172.21.15.47:0/1963234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c8108cf0 msgr2=0x7fd8c81a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c7fff640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c8108cf0 0x7fd8c81a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c7fff640 1 -- 172.21.15.47:0/1963234371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8c8102a60 msgr2=0x7fd8c819c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c7fff640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8c8102a60 0x7fd8c819c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c7fff640 1 -- 172.21.15.47:0/1963234371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c81a25a0 con 0x7fd8c81083a0 2024-09-21T00:58:31.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8cd18b640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c8108cf0 0x7fd8c81a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:31.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c7fff640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c81083a0 0x7fd8c819cbd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c970 tx=0x7fd8bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:31.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c5ffb640 1 -- 172.21.15.47:0/1963234371 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc007bb0 con 0x7fd8c81083a0 2024-09-21T00:58:31.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c81a2890 con 0x7fd8c81083a0 2024-09-21T00:58:31.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c5ffb640 1 -- 172.21.15.47:0/1963234371 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8bc007d50 con 0x7fd8c81083a0 2024-09-21T00:58:31.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8c5ffb640 1 -- 172.21.15.47:0/1963234371 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc00f450 con 0x7fd8c81083a0 2024-09-21T00:58:31.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.715+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c81a8ff0 con 0x7fd8c81083a0 2024-09-21T00:58:31.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.716+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c8102e70 con 0x7fd8c81083a0 2024-09-21T00:58:31.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.718+0000 7fd8c5ffb640 1 -- 172.21.15.47:0/1963234371 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd8bc004ea0 con 0x7fd8c81083a0 2024-09-21T00:58:31.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.719+0000 7fd8c5ffb640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd8b00b6510 0x7fd8b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:31.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.719+0000 7fd8cc98a640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd8b00b6510 0x7fd8b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:31.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.719+0000 7fd8c5ffb640 1 -- 172.21.15.47:0/1963234371 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fd8bc0e7410 con 0x7fd8c81083a0 2024-09-21T00:58:31.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.719+0000 7fd8cc98a640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd8b00b6510 0x7fd8b00b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8031440 tx=0x7fd8b8005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:31.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.722+0000 7fd8c5ffb640 1 -- 172.21.15.47:0/1963234371 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8bc014030 con 0x7fd8c81083a0 2024-09-21T00:58:31.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:31 smithi134 ceph-mon[34785]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:31 smithi134 ceph-mon[34785]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:31 smithi134 ceph-mon[34785]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:31 smithi114 ceph-mon[34309]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:31 smithi114 ceph-mon[34309]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:31 smithi114 ceph-mon[34309]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T00:58:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.947+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8c819d760 con 0x7fd8c81083a0 2024-09-21T00:58:31.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.948+0000 7fd8c5ffb640 1 -- 172.21.15.47:0/1963234371 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7fd8c819d760 con 0x7fd8c81083a0 2024-09-21T00:58:31.949 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:31.949 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:58:31.950 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:58:31.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.950+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd8b00b6510 msgr2=0x7fd8b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:31.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.950+0000 7fd8cebee640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd8b00b6510 0x7fd8b00b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8031440 tx=0x7fd8b8005e80 comp rx=0 tx=0).stop 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.950+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c81083a0 msgr2=0x7fd8c819cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.950+0000 7fd8cebee640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c81083a0 0x7fd8c819cbd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c970 tx=0x7fd8bc00ce30 comp rx=0 tx=0).stop 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.951+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 shutdown_connections 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.951+0000 7fd8cebee640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd8b00b6510 0x7fd8b00b8a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.951+0000 7fd8cebee640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c8108cf0 0x7fd8c81a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.951+0000 7fd8cebee640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8c81083a0 0x7fd8c819cbd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.951+0000 7fd8cebee640 1 --2- 172.21.15.47:0/1963234371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8c8102a60 0x7fd8c819c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.951+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 >> 172.21.15.47:0/1963234371 conn(0x7fd8c8079730 msgr2=0x7fd8c8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.951+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 shutdown_connections 2024-09-21T00:58:31.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:31.951+0000 7fd8cebee640 1 -- 172.21.15.47:0/1963234371 wait complete. 2024-09-21T00:58:32.668 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:32 smithi047 ceph-mon[30960]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-09-21T00:58:32.669 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:32 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1963234371' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:32.700 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T00:58:32.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:32 smithi134 ceph-mon[34785]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-09-21T00:58:32.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:32 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1963234371' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:32.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:32 smithi114 ceph-mon[34309]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-09-21T00:58:32.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:32 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1963234371' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:58:32.960 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:33.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 -- 172.21.15.47:0/3073045250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f101049b0 msgr2=0x7f6f10104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:33.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 --2- 172.21.15.47:0/3073045250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f101049b0 0x7f6f10104dc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009900 tx=0x7f6f0c02a410 comp rx=0 tx=0).stop 2024-09-21T00:58:33.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 -- 172.21.15.47:0/3073045250 shutdown_connections 2024-09-21T00:58:33.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 --2- 172.21.15.47:0/3073045250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f1010de10 0x7f6f10110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 --2- 172.21.15.47:0/3073045250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f10105300 0x7f6f1010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 --2- 172.21.15.47:0/3073045250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f101049b0 0x7f6f10104dc0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 -- 172.21.15.47:0/3073045250 >> 172.21.15.47:0/3073045250 conn(0x7f6f10079730 msgr2=0x7f6f10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 -- 172.21.15.47:0/3073045250 shutdown_connections 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.513+0000 7f6f17eed640 1 -- 172.21.15.47:0/3073045250 wait complete. 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.514+0000 7f6f17eed640 1 Processor -- start 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.514+0000 7f6f17eed640 1 -- start start 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.514+0000 7f6f17eed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f101049b0 0x7f6f1019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.514+0000 7f6f17eed640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f10105300 0x7f6f1019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f17eed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f1010de10 0x7f6f1019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f17eed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10113ae0 con 0x7f6f1010de10 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f17eed640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10113960 con 0x7f6f10105300 2024-09-21T00:58:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f17eed640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10113c60 con 0x7f6f101049b0 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f10105300 0x7f6f1019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f10105300 0x7f6f1019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:53840/0 (socket says 172.21.15.47:53840) 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 -- 172.21.15.47:0/2483524645 learned_addr learned my addr 172.21.15.47:0/2483524645 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f1648a640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f1010de10 0x7f6f1019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15c89640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f101049b0 0x7f6f1019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 -- 172.21.15.47:0/2483524645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f101049b0 msgr2=0x7f6f1019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f101049b0 0x7f6f1019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 -- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f1010de10 msgr2=0x7f6f1019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f1010de10 0x7f6f1019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 -- 172.21.15.47:0/2483524645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f101a04c0 con 0x7f6f10105300 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f1648a640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f1010de10 0x7f6f1019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:58:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.515+0000 7f6f15488640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f10105300 0x7f6f1019aaf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000e9f0 tx=0x7f6f0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.516+0000 7f6f06ffd640 1 -- 172.21.15.47:0/2483524645 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000ccc0 con 0x7f6f10105300 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.516+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f101a07b0 con 0x7f6f10105300 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.516+0000 7f6f06ffd640 1 -- 172.21.15.47:0/2483524645 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f000108e0 con 0x7f6f10105300 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.516+0000 7f6f06ffd640 1 -- 172.21.15.47:0/2483524645 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00018860 con 0x7f6f10105300 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.516+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f101a6f10 con 0x7f6f10105300 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.517+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f10104dc0 con 0x7f6f10105300 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.519+0000 7f6f06ffd640 1 -- 172.21.15.47:0/2483524645 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6f00010430 con 0x7f6f10105300 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.519+0000 7f6f06ffd640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6efc0b6510 0x7f6efc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.520+0000 7f6f15c89640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6efc0b6510 0x7f6efc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.520+0000 7f6f06ffd640 1 -- 172.21.15.47:0/2483524645 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f6f000e7980 con 0x7f6f10105300 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.520+0000 7f6f15c89640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6efc0b6510 0x7f6efc0b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c031440 tx=0x7f6f0c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.523+0000 7f6f06ffd640 1 -- 172.21.15.47:0/2483524645 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f000b2670 con 0x7f6f10105300 2024-09-21T00:58:33.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.710+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f101a71b0 con 0x7f6f10105300 2024-09-21T00:58:33.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.712+0000 7f6f06ffd640 1 -- 172.21.15.47:0/2483524645 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22632 (secure 0 0 0) 0x7f6f000b75b0 con 0x7f6f10105300 2024-09-21T00:58:33.714 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:58:33.714 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":77,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:57:26.756741+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6efc0b6510 msgr2=0x7f6efc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6efc0b6510 0x7f6efc0b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c031440 tx=0x7f6f0c005a20 comp rx=0 tx=0).stop 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f10105300 msgr2=0x7f6f1019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f10105300 0x7f6f1019aaf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000e9f0 tx=0x7f6f0000eeb0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 shutdown_connections 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6efc0b6510 0x7f6efc0b8a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f1010de10 0x7f6f1019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f10105300 0x7f6f1019aaf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 --2- 172.21.15.47:0/2483524645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f101049b0 0x7f6f1019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 >> 172.21.15.47:0/2483524645 conn(0x7f6f10079730 msgr2=0x7f6f100ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 shutdown_connections 2024-09-21T00:58:33.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:33.715+0000 7f6f17eed640 1 -- 172.21.15.47:0/2483524645 wait complete. 2024-09-21T00:58:34.449 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T00:58:34.449 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T00:58:34.464 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi047.front.sepia.ceph.com 2024-09-21T00:58:34.464 DEBUG:teuthology.orchestra.run.smithi047:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T00:58:34.465 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T00:58:34.465 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:58:34.465 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:58:34.467 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T00:58:34.479 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:58:34.479 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T00:58:34.480 INFO:tasks.workunit:timeout=3h 2024-09-21T00:58:34.480 INFO:tasks.workunit:cleanup=True 2024-09-21T00:58:34.480 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T00:58:34.497 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T00:58:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T00:58:34.498 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T00:58:34.498 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T00:58:34.498 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T00:58:34.498 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-21 00:57:05.461023029 +0000 2024-09-21T00:58:34.498 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-21 00:57:05.461023029 +0000 2024-09-21T00:58:34.498 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-21 00:58:26.255126202 +0000 2024-09-21T00:58:34.498 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-21 00:57:05.461023029 +0000 2024-09-21T00:58:34.499 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T00:58:34.499 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T00:58:34.569 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:58:34.625 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T00:58:34.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:34 smithi047 ceph-mon[30960]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-21T00:58:34.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:34 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2483524645' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:34.736 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:34.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:34 smithi134 ceph-mon[34785]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-21T00:58:34.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:34 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2483524645' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:34.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:34 smithi114 ceph-mon[34309]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-21T00:58:34.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:34 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2483524645' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T00:58:35.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 -- 172.21.15.47:0/1469106973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e8108d10 msgr2=0x7f46e810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 --2- 172.21.15.47:0/1469106973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e8108d10 0x7f46e810f540 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009ca0 tx=0x7f46e002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 -- 172.21.15.47:0/1469106973 shutdown_connections 2024-09-21T00:58:35.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 --2- 172.21.15.47:0/1469106973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e8108d10 0x7f46e810f540 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 --2- 172.21.15.47:0/1469106973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e81083c0 0x7f46e81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 --2- 172.21.15.47:0/1469106973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46e8102a80 0x7f46e8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 -- 172.21.15.47:0/1469106973 >> 172.21.15.47:0/1469106973 conn(0x7f46e8079740 msgr2=0x7f46e8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 -- 172.21.15.47:0/1469106973 shutdown_connections 2024-09-21T00:58:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.209+0000 7f46efd12640 1 -- 172.21.15.47:0/1469106973 wait complete. 2024-09-21T00:58:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46efd12640 1 Processor -- start 2024-09-21T00:58:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46efd12640 1 -- start start 2024-09-21T00:58:35.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46efd12640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e8102a80 0x7f46e819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46efd12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e81083c0 0x7f46e819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46efd12640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46e8108d10 0x7f46e819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46efd12640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46e8113a90 con 0x7f46e81083c0 2024-09-21T00:58:35.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46efd12640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f46e8113910 con 0x7f46e8102a80 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46efd12640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f46e8113c10 con 0x7f46e8108d10 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ed2ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e81083c0 0x7f46e819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ed2ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e81083c0 0x7f46e819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38564/0 (socket says 172.21.15.47:38564) 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ed2ad640 1 -- 172.21.15.47:0/2349691729 learned_addr learned my addr 172.21.15.47:0/2349691729 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ee2af640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46e8108d10 0x7f46e819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46edaae640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e8102a80 0x7f46e819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ed2ad640 1 -- 172.21.15.47:0/2349691729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46e8108d10 msgr2=0x7f46e819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46e8108d10 0x7f46e819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ed2ad640 1 -- 172.21.15.47:0/2349691729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e8102a80 msgr2=0x7f46e819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e8102a80 0x7f46e819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ed2ad640 1 -- 172.21.15.47:0/2349691729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e81a0390 con 0x7f46e81083c0 2024-09-21T00:58:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.210+0000 7f46ee2af640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46e8108d10 0x7f46e819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.211+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e81083c0 0x7f46e819aa80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c970 tx=0x7f46d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.211+0000 7f46deffd640 1 -- 172.21.15.47:0/2349691729 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8014070 con 0x7f46e81083c0 2024-09-21T00:58:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.211+0000 7f46deffd640 1 -- 172.21.15.47:0/2349691729 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46d8004440 con 0x7f46e81083c0 2024-09-21T00:58:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.211+0000 7f46efd12640 1 -- 172.21.15.47:0/2349691729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e81a0680 con 0x7f46e81083c0 2024-09-21T00:58:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.211+0000 7f46deffd640 1 -- 172.21.15.47:0/2349691729 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8003e50 con 0x7f46e81083c0 2024-09-21T00:58:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.211+0000 7f46efd12640 1 -- 172.21.15.47:0/2349691729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e81a6ea0 con 0x7f46e81083c0 2024-09-21T00:58:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.213+0000 7f46f6286740 1 Processor -- start 2024-09-21T00:58:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46f6286740 1 -- start start 2024-09-21T00:58:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46f6286740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 0x5622b2732430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46f6286740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2732970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46f6286740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2732eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46f6286740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622b26a8e60 con 0x5622b2362490 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46f6286740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5622b2698290 con 0x5622b238b350 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46f6286740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5622b269c0a0 con 0x5622b236a670 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46deffd640 1 -- 172.21.15.47:0/2349691729 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f46d8017070 con 0x7f46e81083c0 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46edaae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2732970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46edaae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2732970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38578/0 (socket says 172.21.15.47:38578) 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46edaae640 1 -- 172.21.15.47:0/1452636989 learned_addr learned my addr 172.21.15.47:0/1452636989 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46ee2af640 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 0x5622b2732430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.214+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2732eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46edaae640 1 -- 172.21.15.47:0/1452636989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 msgr2=0x5622b2732eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46edaae640 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2732eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46edaae640 1 -- 172.21.15.47:0/1452636989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 msgr2=0x5622b2732430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:35.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46edaae640 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 0x5622b2732430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46edaae640 1 -- 172.21.15.47:0/1452636989 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b23f6930 con 0x5622b2362490 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46edaae640 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2732970 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f46e400bcf0 tx=0x7f46e400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bdb19c4eb97b47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46d3fff640 1 -- 172.21.15.47:0/1452636989 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4015070 con 0x5622b2362490 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46deffd640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46d40b66e0 0x7f46d40b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46d3fff640 1 -- 172.21.15.47:0/1452636989 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46e40118f0 con 0x5622b2362490 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46d3fff640 1 -- 172.21.15.47:0/1452636989 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e40107f0 con 0x5622b2362490 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46deffd640 1 -- 172.21.15.47:0/2349691729 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f46d80e6e50 con 0x7f46e81083c0 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.215+0000 7f46ee2af640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46d40b66e0 0x7f46d40b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 -- 172.21.15.47:0/1452636989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 msgr2=0x5622b2732970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2732970 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f46e400bcf0 tx=0x7f46e400f730 comp rx=0 tx=0).stop 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46ee2af640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46d40b66e0 0x7f46d40b8bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f46e0005cc0 tx=0x7f46e0005c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:35.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 -- 172.21.15.47:0/1452636989 shutdown_connections 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2732eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2732970 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 --2- 172.21.15.47:0/1452636989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 0x5622b2732430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 -- 172.21.15.47:0/1452636989 >> 172.21.15.47:0/1452636989 conn(0x5622b237f740 msgr2=0x5622b2730320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 -- 172.21.15.47:0/1452636989 shutdown_connections 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.216+0000 7f46f6286740 1 -- 172.21.15.47:0/1452636989 wait complete. 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 1 -- start start 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 1 Processor -- start 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b273dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b273e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b238b350 0x5622b2749f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622b24f9890 con 0x5622b238b350 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5622b2632d40 con 0x5622b2362490 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5622b2740c10 con 0x5622b236a670 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46f6286740 10 client.0 _ll_register_callbacks cb 0x5622b2696c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.217+0000 7f46ee2af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b238b350 0x5622b2749f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ee2af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b238b350 0x5622b2749f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38584/0 (socket says 172.21.15.47:38584) 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ee2af640 1 -- 172.21.15.47:0/3852820591 learned_addr learned my addr 172.21.15.47:0/3852820591 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b273e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46edaae640 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b273dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ee2af640 1 -- 172.21.15.47:0/3852820591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 msgr2=0x5622b273e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ee2af640 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b273e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ee2af640 1 -- 172.21.15.47:0/3852820591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 msgr2=0x5622b273dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ee2af640 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b273dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ee2af640 1 -- 172.21.15.47:0/3852820591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b274a4d0 con 0x5622b238b350 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46ee2af640 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b238b350 0x5622b2749f60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f46e0035000 tx=0x7f46e002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2c1fdeef12be2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46d17fa640 1 -- 172.21.15.47:0/3852820591 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0003d80 con 0x5622b238b350 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46d17fa640 1 -- 172.21.15.47:0/3852820591 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f46e0004040 con 0x5622b238b350 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.218+0000 7f46f6286740 1 -- 172.21.15.47:0/3852820591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e40118f0 con 0x5622b238b350 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46d17fa640 1 -- 172.21.15.47:0/3852820591 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f46e0004280 con 0x5622b238b350 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46f6286740 10 client.15294 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46f6286740 1 -- 172.21.15.47:0/3852820591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5622b274ce00 con 0x5622b238b350 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46d17fa640 1 -- 172.21.15.47:0/3852820591 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46e40118f0 con 0x5622b238b350 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46d17fa640 1 -- 172.21.15.47:0/3852820591 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f46e0051070 con 0x5622b238b350 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46f6286740 10 client.15294 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46f6286740 10 client.15294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46f6286740 20 client.15294 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46f6286740 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5622b2349cd0 0x5622b27503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46f6286740 4 client.15294 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46f6286740 1 -- 172.21.15.47:0/3852820591 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622b26aadb0 con 0x5622b2349cd0 2024-09-21T00:58:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.219+0000 7f46edaae640 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5622b2349cd0 0x5622b27503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.220+0000 7f46edaae640 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5622b2349cd0 0x5622b27503f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96dca5c984a06f09 server_cookie=a3090d3a42653530 in_seq=0 out_seq=0 2024-09-21T00:58:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.220+0000 7f46d17fa640 10 client.15294 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46d17fa640 1 -- 172.21.15.47:0/3852820591 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622b26aadb0 con 0x5622b2349cd0 2024-09-21T00:58:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46d17fa640 10 client.15294 handle_command_reply: tid=0 2024-09-21T00:58:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 client.15294 shutdown 2024-09-21T00:58:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 -- 172.21.15.47:0/3852820591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b238b350 msgr2=0x5622b2749f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b238b350 0x5622b2749f60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f46e0035000 tx=0x7f46e002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 -- 172.21.15.47:0/3852820591 shutdown_connections 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5622b2349cd0 0x5622b27503f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b238b350 0x5622b2749f60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b273e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 --2- 172.21.15.47:0/3852820591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b273dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46d17fa640 0 client.15294 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 -- 172.21.15.47:0/3852820591 >> 172.21.15.47:0/3852820591 conn(0x5622b237f740 msgr2=0x5622b27355c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 -- 172.21.15.47:0/3852820591 shutdown_connections 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 1 -- 172.21.15.47:0/3852820591 wait complete. 2024-09-21T00:58:35.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.221+0000 7f46f6286740 20 client.15294 trim_cache size 0 max 16384 2024-09-21T00:58:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46f6286740 1 Processor -- start 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46f6286740 1 -- start start 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46f6286740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b2738550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46f6286740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b236a670 0x5622b2749e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46f6286740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b238b350 0x5622b273afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46f6286740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46e81ad1f0 con 0x5622b236a670 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46f6286740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f46e81afa50 con 0x5622b2362490 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46f6286740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f46e81ad840 con 0x5622b238b350 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46ed2ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b236a670 0x5622b2749e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46ed2ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b236a670 0x5622b2749e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38598/0 (socket says 172.21.15.47:38598) 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46ed2ad640 1 -- 172.21.15.47:0/3721537795 learned_addr learned my addr 172.21.15.47:0/3721537795 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46edaae640 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b2738550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46ee2af640 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b238b350 0x5622b273afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46ed2ad640 1 -- 172.21.15.47:0/3721537795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b238b350 msgr2=0x5622b273afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b238b350 0x5622b273afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46ed2ad640 1 -- 172.21.15.47:0/3721537795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 msgr2=0x5622b2738550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.239+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b2738550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.240+0000 7f46ed2ad640 1 -- 172.21.15.47:0/3721537795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b273f070 con 0x5622b236a670 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.240+0000 7f46edaae640 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b2738550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.240+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b236a670 0x5622b2749e60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f46d80e70f0 tx=0x7f46d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe8391b665d0682 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.240+0000 7f46d37fe640 1 -- 172.21.15.47:0/3721537795 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d80ac750 con 0x5622b236a670 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.240+0000 7f46d37fe640 1 -- 172.21.15.47:0/3721537795 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46d80acaf0 con 0x5622b236a670 2024-09-21T00:58:35.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.240+0000 7f46d37fe640 1 -- 172.21.15.47:0/3721537795 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d80abcb0 con 0x5622b236a670 2024-09-21T00:58:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 -- 172.21.15.47:0/3721537795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b236a670 msgr2=0x5622b2749e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b236a670 0x5622b2749e60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f46d80e70f0 tx=0x7f46d8000bc0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 -- 172.21.15.47:0/3721537795 shutdown_connections 2024-09-21T00:58:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b238b350 0x5622b273afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b236a670 0x5622b2749e60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 --2- 172.21.15.47:0/3721537795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b2362490 0x5622b2738550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 -- 172.21.15.47:0/3721537795 >> 172.21.15.47:0/3721537795 conn(0x5622b237f740 msgr2=0x5622b273c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 -- 172.21.15.47:0/3721537795 shutdown_connections 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 -- 172.21.15.47:0/3721537795 wait complete. 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 -- start start 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.241+0000 7f46f6286740 1 Processor -- start 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46f6286740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2742580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46f6286740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2742ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46f6286740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 0x5622b27be200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46f6286740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46e81adf10 con 0x5622b2362490 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46f6286740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f46e81af380 con 0x5622b238b350 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46f6286740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f46e81ae5e0 con 0x5622b236a670 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46f6286740 10 client.0 _ll_register_callbacks cb 0x7f46e002f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46edaae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2742580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46edaae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2742580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38610/0 (socket says 172.21.15.47:38610) 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46edaae640 1 -- 172.21.15.47:0/4083636173 learned_addr learned my addr 172.21.15.47:0/4083636173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2742ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46ee2af640 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 0x5622b27be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46edaae640 1 -- 172.21.15.47:0/4083636173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 msgr2=0x5622b2742ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46edaae640 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2742ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46edaae640 1 -- 172.21.15.47:0/4083636173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 msgr2=0x5622b27be200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46edaae640 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 0x5622b27be200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46edaae640 1 -- 172.21.15.47:0/4083636173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b27be740 con 0x5622b2362490 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.242+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2742ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46edaae640 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2742580 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f46e400fc30 tx=0x7f46e4005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7168729cbad934f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46d17fa640 1 -- 172.21.15.47:0/4083636173 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4015040 con 0x5622b2362490 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46d17fa640 1 -- 172.21.15.47:0/4083636173 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f46e4005040 con 0x5622b2362490 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 1 -- 172.21.15.47:0/4083636173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46d80acaf0 con 0x5622b2362490 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46d17fa640 1 -- 172.21.15.47:0/4083636173 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f46e4005240 con 0x5622b2362490 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 10 client.15300 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 1 -- 172.21.15.47:0/4083636173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5622b27bf960 con 0x5622b2362490 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46d17fa640 1 -- 172.21.15.47:0/4083636173 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46d80acaf0 con 0x5622b2362490 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46d17fa640 1 -- 172.21.15.47:0/4083636173 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f46e40114c0 con 0x5622b2362490 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 10 client.15300 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 10 client.15300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 20 client.15300 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5622b231f080 0x5622b27c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:35.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 4 client.15300 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:58:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.243+0000 7f46f6286740 1 -- 172.21.15.47:0/4083636173 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5622b26a6860 con 0x5622b231f080 2024-09-21T00:58:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.244+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5622b231f080 0x5622b27c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.244+0000 7f46ed2ad640 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5622b231f080 0x5622b27c1fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a9f7c5bcebd638e server_cookie=7a149e93571d169b in_seq=0 out_seq=0 2024-09-21T00:58:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.244+0000 7f46d17fa640 10 client.15300 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:35.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46d17fa640 1 -- 172.21.15.47:0/4083636173 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5622b26a6860 con 0x5622b231f080 2024-09-21T00:58:35.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46d17fa640 10 client.15300 handle_command_reply: tid=0 2024-09-21T00:58:35.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 client.15300 shutdown 2024-09-21T00:58:35.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 -- 172.21.15.47:0/4083636173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 msgr2=0x5622b2742580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2742580 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f46e400fc30 tx=0x7f46e4005d40 comp rx=0 tx=0).stop 2024-09-21T00:58:35.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 -- 172.21.15.47:0/4083636173 shutdown_connections 2024-09-21T00:58:35.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5622b231f080 0x5622b27c1fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5622b238b350 0x5622b27be200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622b236a670 0x5622b2742ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 --2- 172.21.15.47:0/4083636173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622b2362490 0x5622b2742580 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46d17fa640 0 client.15300 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 -- 172.21.15.47:0/4083636173 >> 172.21.15.47:0/4083636173 conn(0x5622b237f740 msgr2=0x5622b2733400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 -- 172.21.15.47:0/4083636173 shutdown_connections 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 1 -- 172.21.15.47:0/4083636173 wait complete. 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.246+0000 7f46f6286740 20 client.15300 trim_cache size 0 max 16384 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "f1966ae8-5721-4668-bade-5c8cf1819177", 2024-09-21T00:58:35.252 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-09-21T00:58:35.253 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:58:35.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 -- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46d40b66e0 msgr2=0x7f46d40b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46d40b66e0 0x7f46d40b8bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f46e0005cc0 tx=0x7f46e0005c30 comp rx=0 tx=0).stop 2024-09-21T00:58:35.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 -- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e81083c0 msgr2=0x7f46e819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:35.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e81083c0 0x7f46e819aa80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c970 tx=0x7f46d800ce30 comp rx=0 tx=0).stop 2024-09-21T00:58:35.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 -- 172.21.15.47:0/2349691729 shutdown_connections 2024-09-21T00:58:35.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f46d40b66e0 0x7f46d40b8bf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46e8108d10 0x7f46e819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46e81083c0 0x7f46e819aa80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 --2- 172.21.15.47:0/2349691729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e8102a80 0x7f46e819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:35.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 -- 172.21.15.47:0/2349691729 >> 172.21.15.47:0/2349691729 conn(0x7f46e8079740 msgr2=0x7f46e81043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:35.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 -- 172.21.15.47:0/2349691729 shutdown_connections 2024-09-21T00:58:35.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:35.247+0000 7f46efd12640 1 -- 172.21.15.47:0/2349691729 wait complete. 2024-09-21T00:58:35.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:35 smithi134 ceph-mon[34785]: scrub queued for path: / 2024-09-21T00:58:35.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:35 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:35.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:35 smithi134 ceph-mon[34785]: scrub summary: active paths [/] 2024-09-21T00:58:35.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:35 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:35.873 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:35 smithi047 ceph-mon[30960]: scrub queued for path: / 2024-09-21T00:58:35.873 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:35 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:35.873 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:35 smithi047 ceph-mon[30960]: scrub summary: active paths [/] 2024-09-21T00:58:35.873 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:35 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:35.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:35 smithi114 ceph-mon[34309]: scrub queued for path: / 2024-09-21T00:58:35.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:35 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:35.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:35 smithi114 ceph-mon[34309]: scrub summary: active paths [/] 2024-09-21T00:58:35.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:35 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T00:58:35.931 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:58:36.232 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:58:36.679 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:36 smithi047 ceph-mon[30960]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-21T00:58:36.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 -- 172.21.15.47:0/4082729262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 msgr2=0x7fbbec10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 --2- 172.21.15.47:0/4082729262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 0x7fbbec10f5a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009ca0 tx=0x7fbbe402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 -- 172.21.15.47:0/4082729262 shutdown_connections 2024-09-21T00:58:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 --2- 172.21.15.47:0/4082729262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 0x7fbbec10f5a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 --2- 172.21.15.47:0/4082729262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbec1051c0 0x7fbbec1055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 --2- 172.21.15.47:0/4082729262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbec1031b0 0x7fbbec1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 -- 172.21.15.47:0/4082729262 >> 172.21.15.47:0/4082729262 conn(0x7fbbec079e40 msgr2=0x7fbbec07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 -- 172.21.15.47:0/4082729262 shutdown_connections 2024-09-21T00:58:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.687+0000 7fbbf460d640 1 -- 172.21.15.47:0/4082729262 wait complete. 2024-09-21T00:58:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.688+0000 7fbbf460d640 1 Processor -- start 2024-09-21T00:58:36.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.688+0000 7fbbf460d640 1 -- start start 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf460d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbec1031b0 0x7fbbec19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf460d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbec1051c0 0x7fbbec19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf460d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 0x7fbbec1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf460d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1129e0 con 0x7fbbec105b10 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf460d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec112860 con 0x7fbbec1031b0 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf460d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec112b60 con 0x7fbbec1051c0 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf2baa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 0x7fbbec1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf2baa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 0x7fbbec1a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38618/0 (socket says 172.21.15.47:38618) 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf2baa640 1 -- 172.21.15.47:0/2537862385 learned_addr learned my addr 172.21.15.47:0/2537862385 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbec1051c0 0x7fbbec19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbec1031b0 0x7fbbec19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf2baa640 1 -- 172.21.15.47:0/2537862385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbec1051c0 msgr2=0x7fbbec19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf2baa640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbec1051c0 0x7fbbec19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf2baa640 1 -- 172.21.15.47:0/2537862385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbec1031b0 msgr2=0x7fbbec19c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf2baa640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbec1031b0 0x7fbbec19c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.689+0000 7fbbf2baa640 1 -- 172.21.15.47:0/2537862385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec1a2470 con 0x7fbbec105b10 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.690+0000 7fbbf2baa640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 0x7fbbec1a1e00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4005cc0 tx=0x7fbbe402f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.690+0000 7fbbe37fe640 1 -- 172.21.15.47:0/2537862385 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4003cf0 con 0x7fbbec105b10 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.690+0000 7fbbf460d640 1 -- 172.21.15.47:0/2537862385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbec1a2700 con 0x7fbbec105b10 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.690+0000 7fbbe37fe640 1 -- 172.21.15.47:0/2537862385 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbe40044f0 con 0x7fbbec105b10 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.690+0000 7fbbe37fe640 1 -- 172.21.15.47:0/2537862385 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe402fbc0 con 0x7fbbec105b10 2024-09-21T00:58:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.690+0000 7fbbf460d640 1 -- 172.21.15.47:0/2537862385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbec1a2c40 con 0x7fbbec105b10 2024-09-21T00:58:36.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.693+0000 7fbbfab81740 1 Processor -- start 2024-09-21T00:58:36.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.693+0000 7fbbe37fe640 1 -- 172.21.15.47:0/2537862385 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbbe402fd60 con 0x7fbbec105b10 2024-09-21T00:58:36.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbfab81740 1 -- start start 2024-09-21T00:58:36.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2456070 0x55bad27fd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad27fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2435390 0x55bad27fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbfab81740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bad2773e50 con 0x55bad2435390 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbfab81740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55bad2763280 con 0x55bad2456070 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbfab81740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bad2767090 con 0x55bad242d1b0 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf1ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2435390 0x55bad27fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf1ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2435390 0x55bad27fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38624/0 (socket says 172.21.15.47:38624) 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/1040075625 learned_addr learned my addr 172.21.15.47:0/1040075625 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad27fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2456070 0x55bad27fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbe37fe640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbd80b6540 0x7fbbd80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/1040075625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 msgr2=0x55bad27fd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad27fd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/1040075625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2456070 msgr2=0x55bad27fd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.694+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2456070 0x55bad27fd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.695+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/1040075625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bad24c1650 con 0x55bad2435390 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.695+0000 7fbbf2baa640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbd80b6540 0x7fbbd80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.695+0000 7fbbe37fe640 1 -- 172.21.15.47:0/2537862385 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbbe41086c0 con 0x7fbbec105b10 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.695+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2435390 0x55bad27fdcf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc011780 tx=0x7fbbdc00a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7a993037d6e80b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.695+0000 7fbbe0ff9640 1 -- 172.21.15.47:0/1040075625 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc005020 con 0x55bad2435390 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.695+0000 7fbbe0ff9640 1 -- 172.21.15.47:0/1040075625 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbdc0047a0 con 0x55bad2435390 2024-09-21T00:58:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.695+0000 7fbbe0ff9640 1 -- 172.21.15.47:0/1040075625 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00fa20 con 0x55bad2435390 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 -- 172.21.15.47:0/1040075625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2435390 msgr2=0x55bad27fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbf2baa640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbd80b6540 0x7fbbd80b8a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40044c0 tx=0x7fbbe40c8ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2435390 0x55bad27fdcf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc011780 tx=0x7fbbdc00a700 comp rx=0 tx=0).stop 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 -- 172.21.15.47:0/1040075625 shutdown_connections 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2435390 0x55bad27fdcf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad27fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1040075625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2456070 0x55bad27fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 -- 172.21.15.47:0/1040075625 >> 172.21.15.47:0/1040075625 conn(0x55bad244a460 msgr2=0x55bad27fb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 -- 172.21.15.47:0/1040075625 shutdown_connections 2024-09-21T00:58:36.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.696+0000 7fbbfab81740 1 -- 172.21.15.47:0/1040075625 wait complete. 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 1 -- start start 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 1 Processor -- start 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad2808900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad2808e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad2814d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bad25c4700 con 0x55bad2456070 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55bad26fe110 con 0x55bad2435390 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bad280ba50 con 0x55bad242d1b0 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbfab81740 10 client.0 _ll_register_callbacks cb 0x55bad2717990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbf1ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad2814d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbf1ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad2814d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38632/0 (socket says 172.21.15.47:38632) 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/3935658018 learned_addr learned my addr 172.21.15.47:0/3935658018 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad2808900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.697+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad2808e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/3935658018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 msgr2=0x55bad2808900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad2808900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/3935658018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 msgr2=0x55bad2808e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad2808e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/3935658018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bad272bc40 con 0x55bad2456070 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad2814d40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00ace0 tx=0x7fbbdc013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730d579315ad47c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/3935658018 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011260 con 0x55bad2456070 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/3935658018 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbbdc005250 con 0x55bad2456070 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbfab81740 1 -- 172.21.15.47:0/3935658018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbdc0047a0 con 0x55bad2456070 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/3935658018 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbbdc005450 con 0x55bad2456070 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbfab81740 10 client.15312 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.698+0000 7fbbfab81740 1 -- 172.21.15.47:0/3935658018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55bad2817730 con 0x55bad2456070 2024-09-21T00:58:36.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/3935658018 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbdc0047a0 con 0x55bad2456070 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/3935658018 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fbbdc01e590 con 0x55bad2456070 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbfab81740 10 client.15312 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbfab81740 10 client.15312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbfab81740 20 client.15312 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55bad24149f0 0x55bad281aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbfab81740 4 client.15312 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbfab81740 1 -- 172.21.15.47:0/3935658018 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bad2775da0 con 0x55bad24149f0 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.699+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55bad24149f0 0x55bad281aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.700+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55bad24149f0 0x55bad281aaf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7f477b665f05bd9 server_cookie=8f7fda67e7bab8cd in_seq=0 out_seq=0 2024-09-21T00:58:36.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.700+0000 7fbbd5ffb640 10 client.15312 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:36.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.700+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/3935658018 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bad2775da0 con 0x55bad24149f0 2024-09-21T00:58:36.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.700+0000 7fbbd5ffb640 10 client.15312 handle_command_reply: tid=0 2024-09-21T00:58:36.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 client.15312 shutdown 2024-09-21T00:58:36.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 -- 172.21.15.47:0/3935658018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 msgr2=0x55bad2814d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad2814d40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00ace0 tx=0x7fbbdc013040 comp rx=0 tx=0).stop 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 -- 172.21.15.47:0/3935658018 shutdown_connections 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55bad24149f0 0x55bad281aaf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad2814d40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad2808e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3935658018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad2808900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 -- 172.21.15.47:0/3935658018 >> 172.21.15.47:0/3935658018 conn(0x55bad244a460 msgr2=0x55bad2800450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbd5ffb640 0 client.15312 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 -- 172.21.15.47:0/3935658018 shutdown_connections 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 1 -- 172.21.15.47:0/3935658018 wait complete. 2024-09-21T00:58:36.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.701+0000 7fbbfab81740 20 client.15312 trim_cache size 0 max 16384 2024-09-21T00:58:36.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbfab81740 1 Processor -- start 2024-09-21T00:58:36.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbfab81740 1 -- start start 2024-09-21T00:58:36.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad280a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad2814cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad27fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbfab81740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1af320 con 0x55bad2456070 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbfab81740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1b1ba0 con 0x55bad2435390 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbfab81740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1af990 con 0x55bad242d1b0 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf1ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad27fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf1ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad27fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38636/0 (socket says 172.21.15.47:38636) 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/3544788400 learned_addr learned my addr 172.21.15.47:0/3544788400 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad280a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad2814cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/3544788400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 msgr2=0x55bad280a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:36.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad280a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/3544788400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 msgr2=0x55bad2814cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:36.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.719+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad2814cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.720+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/3544788400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bad27ff560 con 0x55bad2456070 2024-09-21T00:58:36.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.720+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad27fe9b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc004ac0 tx=0x7fbbdc016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721aaf44a368f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:36.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.720+0000 7fbbd7fff640 1 -- 172.21.15.47:0/3544788400 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00a630 con 0x55bad2456070 2024-09-21T00:58:36.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.720+0000 7fbbd7fff640 1 -- 172.21.15.47:0/3544788400 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbdc03d070 con 0x55bad2456070 2024-09-21T00:58:36.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.720+0000 7fbbd7fff640 1 -- 172.21.15.47:0/3544788400 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00f790 con 0x55bad2456070 2024-09-21T00:58:36.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 -- 172.21.15.47:0/3544788400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 msgr2=0x55bad27fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad27fe9b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc004ac0 tx=0x7fbbdc016040 comp rx=0 tx=0).stop 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 -- 172.21.15.47:0/3544788400 shutdown_connections 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad2456070 0x55bad27fe9b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad2814cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 --2- 172.21.15.47:0/3544788400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad242d1b0 0x55bad280a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 -- 172.21.15.47:0/3544788400 >> 172.21.15.47:0/3544788400 conn(0x55bad244a460 msgr2=0x55bad27fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 -- 172.21.15.47:0/3544788400 shutdown_connections 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 -- 172.21.15.47:0/3544788400 wait complete. 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 -- start start 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.721+0000 7fbbfab81740 1 Processor -- start 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad242d1b0 0x55bad281e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad281b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbfab81740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad2456070 0x55bad281bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbfab81740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1b0060 con 0x55bad242d1b0 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbfab81740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1b14d0 con 0x55bad2435390 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbfab81740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1b0730 con 0x55bad2456070 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbfab81740 10 client.0 _ll_register_callbacks cb 0x7fbbdc00ae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad242d1b0 0x55bad281e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad242d1b0 0x55bad281e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38638/0 (socket says 172.21.15.47:38638) 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/1682677527 learned_addr learned my addr 172.21.15.47:0/1682677527 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad281b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad2456070 0x55bad281bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/1682677527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad2456070 msgr2=0x55bad281bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad2456070 0x55bad281bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/1682677527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 msgr2=0x55bad281b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:36.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad281b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 -- 172.21.15.47:0/1682677527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bad281c1d0 con 0x55bad242d1b0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbf1ba8640 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad242d1b0 0x55bad281e180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc004790 tx=0x7fbbdc00a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2c832809fe747f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/1682677527 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc04c070 con 0x55bad242d1b0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.722+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/1682677527 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbbdc01e670 con 0x55bad242d1b0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 1 -- 172.21.15.47:0/1682677527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbdc03d070 con 0x55bad242d1b0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/1682677527 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbbdc00f790 con 0x55bad242d1b0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 10 client.15318 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 1 -- 172.21.15.47:0/1682677527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55bad2885030 con 0x55bad242d1b0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/1682677527 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbdc03d070 con 0x55bad242d1b0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/1682677527 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fbbdc04f020 con 0x55bad242d1b0 2024-09-21T00:58:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 10 client.15318 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 10 client.15318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 20 client.15318 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55bad23e9da0 0x55bad2887540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 4 client.15318 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbfab81740 1 -- 172.21.15.47:0/1682677527 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bad2771850 con 0x55bad23e9da0 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.723+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55bad23e9da0 0x55bad2887540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbf23a9640 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55bad23e9da0 0x55bad2887540 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e12064e0a6ffc374 server_cookie=e966ad7b0277d81a in_seq=0 out_seq=0 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbd5ffb640 10 client.15318 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbd5ffb640 1 -- 172.21.15.47:0/1682677527 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55bad2771850 con 0x55bad23e9da0 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbd5ffb640 10 client.15318 handle_command_reply: tid=0 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 client.15318 shutdown 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 -- 172.21.15.47:0/1682677527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad242d1b0 msgr2=0x55bad281e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad242d1b0 0x55bad281e180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc004790 tx=0x7fbbdc00a8d0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 -- 172.21.15.47:0/1682677527 shutdown_connections 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55bad23e9da0 0x55bad2887540 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bad2456070 0x55bad281bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55bad2435390 0x55bad281b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 --2- 172.21.15.47:0/1682677527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bad242d1b0 0x55bad281e180 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 -- 172.21.15.47:0/1682677527 >> 172.21.15.47:0/1682677527 conn(0x55bad244a460 msgr2=0x55bad280a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbd5ffb640 0 client.15318 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.724+0000 7fbbfab81740 1 -- 172.21.15.47:0/1682677527 shutdown_connections 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbfab81740 1 -- 172.21.15.47:0/1682677527 wait complete. 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbfab81740 20 client.15318 trim_cache size 0 max 16384 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:58:36.731 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "f1966ae8-5721-4668-bade-5c8cf1819177", 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:58:36.732 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:58:36.733 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:58:36.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:58:36.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:58:36.733 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:58:36.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 -- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbd80b6540 msgr2=0x7fbbd80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbd80b6540 0x7fbbd80b8a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40044c0 tx=0x7fbbe40c8ea0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 -- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 msgr2=0x7fbbec1a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 0x7fbbec1a1e00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4005cc0 tx=0x7fbbe402f450 comp rx=0 tx=0).stop 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 -- 172.21.15.47:0/2537862385 shutdown_connections 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbd80b6540 0x7fbbd80b8a50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbec105b10 0x7fbbec1a1e00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbec1051c0 0x7fbbec19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 --2- 172.21.15.47:0/2537862385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbec1031b0 0x7fbbec19c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 -- 172.21.15.47:0/2537862385 >> 172.21.15.47:0/2537862385 conn(0x7fbbec079e40 msgr2=0x7fbbec1083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 -- 172.21.15.47:0/2537862385 shutdown_connections 2024-09-21T00:58:36.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:58:36.725+0000 7fbbf460d640 1 -- 172.21.15.47:0/2537862385 wait complete. 2024-09-21T00:58:36.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:36 smithi134 ceph-mon[34785]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-21T00:58:36.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:36 smithi114 ceph-mon[34309]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-21T00:58:37.437 INFO:tasks.cephfs.filesystem:scrub status for tag:f1966ae8-5721-4668-bade-5c8cf1819177 - {'path': '/', 'tag': 'f1966ae8-5721-4668-bade-5c8cf1819177', 'options': 'recursive,force'} 2024-09-21T00:58:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:38 smithi134 ceph-mon[34785]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T00:58:38.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:38 smithi114 ceph-mon[34309]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T00:58:38.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:38 smithi047 ceph-mon[30960]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T00:58:39.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:39 smithi134 ceph-mon[34785]: scrub summary: idle 2024-09-21T00:58:39.904 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:39 smithi047 ceph-mon[30960]: scrub summary: idle 2024-09-21T00:58:39.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:39 smithi114 ceph-mon[34309]: scrub summary: idle 2024-09-21T00:58:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:40 smithi134 ceph-mon[34785]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T00:58:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:40 smithi114 ceph-mon[34309]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T00:58:40.917 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:40 smithi047 ceph-mon[30960]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T00:58:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:42 smithi134 ceph-mon[34785]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T00:58:42.979 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:42 smithi047 ceph-mon[30960]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T00:58:42.979 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:42 smithi114 ceph-mon[34309]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T00:58:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:44 smithi134 ceph-mon[34785]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T00:58:44.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:44 smithi114 ceph-mon[34309]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T00:58:44.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:44 smithi047 ceph-mon[30960]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T00:58:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:46 smithi134 ceph-mon[34785]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:58:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:46 smithi114 ceph-mon[34309]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:58:46.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:46 smithi047 ceph-mon[30960]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:58:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 -- 172.21.15.47:0/19162357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 msgr2=0x7f3e6410b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 --2- 172.21.15.47:0/19162357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 0x7f3e6410b910 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ca0 tx=0x7f3e5c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 -- 172.21.15.47:0/19162357 shutdown_connections 2024-09-21T00:58:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 --2- 172.21.15.47:0/19162357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 0x7f3e6410b910 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 --2- 172.21.15.47:0/19162357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e64106840 0x7f3e64108cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 --2- 172.21.15.47:0/19162357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e6406c4f0 0x7f3e64106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 -- 172.21.15.47:0/19162357 >> 172.21.15.47:0/19162357 conn(0x7f3e640fdf00 msgr2=0x7f3e641003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 -- 172.21.15.47:0/19162357 shutdown_connections 2024-09-21T00:58:47.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.627+0000 7f3e68b57640 1 -- 172.21.15.47:0/19162357 wait complete. 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e68b57640 1 Processor -- start 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e68b57640 1 -- start start 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e68b57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e6406c4f0 0x7f3e64199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e68b57640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e64106840 0x7f3e6419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e68b57640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 0x7f3e6419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e68b57640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6410f340 con 0x7f3e64109400 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e68b57640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6410f1c0 con 0x7f3e64106840 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e68b57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6410f4c0 con 0x7f3e6406c4f0 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e62d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 0x7f3e6419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e62d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 0x7f3e6419b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45904/0 (socket says 172.21.15.47:45904) 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e62d9d640 1 -- 172.21.15.47:0/2436434778 learned_addr learned my addr 172.21.15.47:0/2436434778 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e6259c640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e6406c4f0 0x7f3e64199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.628+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e64106840 0x7f3e6419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e62d9d640 1 -- 172.21.15.47:0/2436434778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e6406c4f0 msgr2=0x7f3e64199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e62d9d640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e6406c4f0 0x7f3e64199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e62d9d640 1 -- 172.21.15.47:0/2436434778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e64106840 msgr2=0x7f3e6419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e62d9d640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e64106840 0x7f3e6419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e62d9d640 1 -- 172.21.15.47:0/2436434778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6419b9a0 con 0x7f3e64109400 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e62d9d640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 0x7f3e6419b180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0097b0 tx=0x7f3e5c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e5bfff640 1 -- 172.21.15.47:0/2436434778 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c004240 con 0x7f3e64109400 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e68b57640 1 -- 172.21.15.47:0/2436434778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6419bc30 con 0x7f3e64109400 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e5bfff640 1 -- 172.21.15.47:0/2436434778 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e5c02f380 con 0x7f3e64109400 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e5bfff640 1 -- 172.21.15.47:0/2436434778 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c02fc30 con 0x7f3e64109400 2024-09-21T00:58:47.632 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.629+0000 7f3e68b57640 1 -- 172.21.15.47:0/2436434778 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e641a2380 con 0x7f3e64109400 2024-09-21T00:58:47.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.632+0000 7f3e5bfff640 1 -- 172.21.15.47:0/2436434778 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3e5c0043e0 con 0x7f3e64109400 2024-09-21T00:58:47.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.632+0000 7f3e6fac4740 1 Processor -- start 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.632+0000 7f3e6fac4740 1 -- start start 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925941b0 0x560592940260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 0x560592941420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605928ae6f0 con 0x56059256b2f0 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56059289db20 con 0x5605925734d0 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5605928a1930 con 0x5605925941b0 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45906/0 (socket says 172.21.15.47:45906) 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 -- 172.21.15.47:0/2432464890 learned_addr learned my addr 172.21.15.47:0/2432464890 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925941b0 0x560592940260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.635 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 0x560592941420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e5bfff640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e500b6510 0x7f3e500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 -- 172.21.15.47:0/2432464890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925941b0 msgr2=0x560592940260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925941b0 0x560592940260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 -- 172.21.15.47:0/2432464890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 msgr2=0x560592941420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 0x560592941420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 -- 172.21.15.47:0/2432464890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560592863530 con 0x56059256b2f0 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e62d9d640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e500b6510 0x7f3e500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e6259c640 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929408d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400b760 tx=0x7f3e5400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9babed43faa989 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.633+0000 7f3e5bfff640 1 -- 172.21.15.47:0/2436434778 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f3e5c1086d0 con 0x7f3e64109400 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.634+0000 7f3e58d99640 1 -- 172.21.15.47:0/2432464890 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54003dd0 con 0x56059256b2f0 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.634+0000 7f3e58d99640 1 -- 172.21.15.47:0/2432464890 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e54015070 con 0x56059256b2f0 2024-09-21T00:58:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.634+0000 7f3e58d99640 1 -- 172.21.15.47:0/2432464890 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54004d50 con 0x56059256b2f0 2024-09-21T00:58:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 -- 172.21.15.47:0/2432464890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 msgr2=0x5605929408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e62d9d640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e500b6510 0x7f3e500b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c04d000 tx=0x7f3e5c092f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929408d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400b760 tx=0x7f3e5400bc20 comp rx=0 tx=0).stop 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 -- 172.21.15.47:0/2432464890 shutdown_connections 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 0x560592941420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929408d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/2432464890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925941b0 0x560592940260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 -- 172.21.15.47:0/2432464890 >> 172.21.15.47:0/2432464890 conn(0x560592588300 msgr2=0x5605929378e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 -- 172.21.15.47:0/2432464890 shutdown_connections 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 -- 172.21.15.47:0/2432464890 wait complete. 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 -- start start 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.635+0000 7f3e6fac4740 1 Processor -- start 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.641 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x56059294a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925941b0 0x56059294abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605927d5ab0 con 0x56059256b2f0 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560592843730 con 0x5605925941b0 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560592941f40 con 0x5605925734d0 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e6fac4740 10 client.0 _ll_register_callbacks cb 0x5605928976b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45910/0 (socket says 172.21.15.47:45910) 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 -- 172.21.15.47:0/3489440848 learned_addr learned my addr 172.21.15.47:0/3489440848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e6259c640 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x56059294a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925941b0 0x56059294abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 -- 172.21.15.47:0/3489440848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 msgr2=0x56059294a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x56059294a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.642 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 -- 172.21.15.47:0/3489440848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925941b0 msgr2=0x56059294abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925941b0 0x56059294abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 -- 172.21.15.47:0/3489440848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605925ff790 con 0x56059256b2f0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929499c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c012ae0 tx=0x7f3e4c00ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1a82801c73e443 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.636+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3489440848 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c010d60 con 0x56059256b2f0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3489440848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e54015070 con 0x56059256b2f0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3489440848 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f3e4c005020 con 0x56059256b2f0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3489440848 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3e4c005220 con 0x56059256b2f0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 10 client.15330 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3489440848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560592678620 con 0x56059256b2f0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3489440848 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e54015070 con 0x56059256b2f0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3489440848 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3e4c004830 con 0x56059256b2f0 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 10 client.15330 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:47.643 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 10 client.15330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 20 client.15330 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x560592552d80 0x560592957100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 4 client.15330 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.637+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3489440848 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605928b0640 con 0x560592552d80 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.638+0000 7f3e6259c640 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x560592552d80 0x560592957100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.638+0000 7f3e49ffb640 10 client.15330 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.638+0000 7f3e6259c640 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x560592552d80 0x560592957100 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb27615bc03705c2 server_cookie=fbd2d6002e77f217 in_seq=0 out_seq=0 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3489440848 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605928b0640 con 0x560592552d80 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e49ffb640 10 client.15330 handle_command_reply: tid=0 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 client.15330 shutdown 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3489440848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 msgr2=0x5605929499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929499c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c012ae0 tx=0x7f3e4c00ba00 comp rx=0 tx=0).stop 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3489440848 shutdown_connections 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x560592552d80 0x560592957100 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925941b0 0x56059294abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.644 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x56059294a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3489440848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56059256b2f0 0x5605929499c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e49ffb640 0 client.15330 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3489440848 >> 172.21.15.47:0/3489440848 conn(0x560592588300 msgr2=0x560592935ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3489440848 shutdown_connections 2024-09-21T00:58:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3489440848 wait complete. 2024-09-21T00:58:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.639+0000 7f3e6fac4740 20 client.15330 trim_cache size 0 max 16384 2024-09-21T00:58:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e6fac4740 1 Processor -- start 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e6fac4740 1 -- start start 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56059256b2f0 0x560592948be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x560592947ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592948410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641a6bd0 con 0x5605925941b0 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641a9430 con 0x56059256b2f0 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641a7220 con 0x5605925734d0 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592948410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592948410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45916/0 (socket says 172.21.15.47:45916) 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e59d9b640 1 -- 172.21.15.47:0/1454913184 learned_addr learned my addr 172.21.15.47:0/1454913184 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.654+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56059256b2f0 0x560592948be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e59d9b640 1 -- 172.21.15.47:0/1454913184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 msgr2=0x560592947ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e6259c640 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x560592947ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x560592947ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e59d9b640 1 -- 172.21.15.47:0/1454913184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56059256b2f0 msgr2=0x560592948be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56059256b2f0 0x560592948be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e59d9b640 1 -- 172.21.15.47:0/1454913184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560592951e90 con 0x5605925941b0 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e6259c640 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x560592947ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592948410 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c001eb0 tx=0x7f3e4c00b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b06c4e6a6cdbc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e4bfff640 1 -- 172.21.15.47:0/1454913184 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c005070 con 0x5605925941b0 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e4bfff640 1 -- 172.21.15.47:0/1454913184 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e4c0053c0 con 0x5605925941b0 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.655+0000 7f3e4bfff640 1 -- 172.21.15.47:0/1454913184 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0216b0 con 0x5605925941b0 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 -- 172.21.15.47:0/1454913184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 msgr2=0x560592948410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592948410 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c001eb0 tx=0x7f3e4c00b710 comp rx=0 tx=0).stop 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 -- 172.21.15.47:0/1454913184 shutdown_connections 2024-09-21T00:58:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592948410 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605925734d0 0x560592947ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/1454913184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56059256b2f0 0x560592948be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 -- 172.21.15.47:0/1454913184 >> 172.21.15.47:0/1454913184 conn(0x560592588300 msgr2=0x560592936610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 -- 172.21.15.47:0/1454913184 shutdown_connections 2024-09-21T00:58:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 -- 172.21.15.47:0/1454913184 wait complete. 2024-09-21T00:58:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 -- start start 2024-09-21T00:58:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 Processor -- start 2024-09-21T00:58:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56059256b2f0 0x560592951820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 0x560592950540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592950c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641a78f0 con 0x5605925941b0 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.656+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641a8d60 con 0x5605925734d0 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e6fac4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e641a7fc0 con 0x56059256b2f0 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e6fac4740 10 client.0 _ll_register_callbacks cb 0x7f3e4c012900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592950c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592950c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45926/0 (socket says 172.21.15.47:45926) 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 -- 172.21.15.47:0/3497155064 learned_addr learned my addr 172.21.15.47:0/3497155064 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56059256b2f0 0x560592951820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e6259c640 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 0x560592950540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 -- 172.21.15.47:0/3497155064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56059256b2f0 msgr2=0x560592951820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56059256b2f0 0x560592951820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 -- 172.21.15.47:0/3497155064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 msgr2=0x560592950540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 0x560592950540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 -- 172.21.15.47:0/3497155064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059294af60 con 0x5605925941b0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e59d9b640 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592950c50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c012ae0 tx=0x7f3e4c02d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e009fbbadeb6eb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3497155064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0048c0 con 0x5605925941b0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3497155064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f3e4c021680 con 0x5605925941b0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.657+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3497155064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e4c0053c0 con 0x5605925941b0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3497155064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3e4c021880 con 0x5605925941b0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6fac4740 10 client.15336 fetch_fsmap learned FSMap version 19 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3497155064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5605929c1b00 con 0x5605925941b0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3497155064 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e4c0053c0 con 0x5605925941b0 2024-09-21T00:58:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3497155064 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3e4c036040 con 0x5605925941b0 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6fac4740 10 client.15336 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6fac4740 10 client.15336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6fac4740 20 client.15336 populate_metadata read hostname 'smithi047' 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605925281c0 0x5605929c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6fac4740 4 client.15336 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3497155064 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5605928ac0f0 con 0x5605925281c0 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.658+0000 7f3e6259c640 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605925281c0 0x5605929c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.659+0000 7f3e49ffb640 10 client.15336 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:47.664 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.659+0000 7f3e6259c640 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605925281c0 0x5605929c4280 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed6c55b69130efed server_cookie=1a14ef1740667fb3 in_seq=0 out_seq=0 2024-09-21T00:58:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e49ffb640 1 -- 172.21.15.47:0/3497155064 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5605928ac0f0 con 0x5605925281c0 2024-09-21T00:58:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e49ffb640 10 client.15336 handle_command_reply: tid=0 2024-09-21T00:58:47.671 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 client.15336 shutdown 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3497155064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 msgr2=0x560592950c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592950c50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c012ae0 tx=0x7f3e4c02d040 comp rx=0 tx=0).stop 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3497155064 shutdown_connections 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605925281c0 0x5605929c4280 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605925941b0 0x560592950c50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605925734d0 0x560592950540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e49ffb640 0 client.15336 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 --2- 172.21.15.47:0/3497155064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56059256b2f0 0x560592951820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3497155064 >> 172.21.15.47:0/3497155064 conn(0x560592588300 msgr2=0x560592940200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3497155064 shutdown_connections 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.670+0000 7f3e6fac4740 1 -- 172.21.15.47:0/3497155064 wait complete. 2024-09-21T00:58:47.672 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e6fac4740 20 client.15336 trim_cache size 0 max 16384 2024-09-21T00:58:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T00:58:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T00:58:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T00:58:47.673 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 -- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e500b6510 msgr2=0x7f3e500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e500b6510 0x7f3e500b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c04d000 tx=0x7f3e5c092f60 comp rx=0 tx=0).stop 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 -- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 msgr2=0x7f3e6419b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 0x7f3e6419b180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0097b0 tx=0x7f3e5c003c20 comp rx=0 tx=0).stop 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 -- 172.21.15.47:0/2436434778 shutdown_connections 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3e500b6510 0x7f3e500b8a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e64109400 0x7f3e6419b180 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e64106840 0x7f3e6419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 --2- 172.21.15.47:0/2436434778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e6406c4f0 0x7f3e64199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:58:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 -- 172.21.15.47:0/2436434778 >> 172.21.15.47:0/2436434778 conn(0x7f3e640fdf00 msgr2=0x7f3e64104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:58:47.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 -- 172.21.15.47:0/2436434778 shutdown_connections 2024-09-21T00:58:47.675 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:58:47.671+0000 7f3e68b57640 1 -- 172.21.15.47:0/2436434778 wait complete. 2024-09-21T00:58:48.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:48 smithi134 ceph-mon[34785]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:58:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:48 smithi114 ceph-mon[34309]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:58:48.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:48 smithi047 ceph-mon[30960]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T00:58:50.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:50 smithi047 ceph-mon[30960]: pgmap v349: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:50 smithi134 ceph-mon[34785]: pgmap v349: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:50 smithi114 ceph-mon[34309]: pgmap v349: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:58:52.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:52 smithi134 ceph-mon[34785]: pgmap v350: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T00:58:52.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:52 smithi114 ceph-mon[34309]: pgmap v350: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T00:58:52.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:52 smithi047 ceph-mon[30960]: pgmap v350: 97 pgs: 97 active+clean; 654 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T00:58:54.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:54 smithi047 ceph-mon[30960]: pgmap v351: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T00:58:54.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:54 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:58:54.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:54 smithi134 ceph-mon[34785]: pgmap v351: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T00:58:54.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:54 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:58:54.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:54 smithi114 ceph-mon[34309]: pgmap v351: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T00:58:54.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:54 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:58:56.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:58:56.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:58:56.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:58:56.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:58:56.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:56.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: pgmap v352: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:58:56.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:58:56.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:58:56.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:58:58.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:58:58 smithi134 ceph-mon[34785]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T00:58:58.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:58:58 smithi114 ceph-mon[34309]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T00:58:58.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:58:58 smithi047 ceph-mon[30960]: pgmap v353: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T00:59:00.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:00 smithi114 ceph-mon[34309]: pgmap v354: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:59:00.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:00 smithi047 ceph-mon[30960]: pgmap v354: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:59:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 -- 172.21.15.47:0/522049804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 msgr2=0x7f950c10a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 --2- 172.21.15.47:0/522049804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 0x7f950c10a980 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9504009ca0 tx=0x7f950402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 -- 172.21.15.47:0/522049804 shutdown_connections 2024-09-21T00:59:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 --2- 172.21.15.47:0/522049804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 0x7f950c10a980 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 --2- 172.21.15.47:0/522049804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950c103640 0x7f950c103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 --2- 172.21.15.47:0/522049804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f950c1025c0 0x7f950c102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 -- 172.21.15.47:0/522049804 >> 172.21.15.47:0/522049804 conn(0x7f950c0fdf00 msgr2=0x7f950c1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 -- 172.21.15.47:0/522049804 shutdown_connections 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.772+0000 7f95117a8640 1 -- 172.21.15.47:0/522049804 wait complete. 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f95117a8640 1 Processor -- start 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f95117a8640 1 -- start start 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f95117a8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950c1025c0 0x7f950c199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f95117a8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f950c103640 0x7f950c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f95117a8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 0x7f950c19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f95117a8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f950c10f340 con 0x7f950c103fe0 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f95117a8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f950c10f1c0 con 0x7f950c1025c0 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f95117a8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f950c10f4c0 con 0x7f950c103640 2024-09-21T00:59:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 0x7f950c19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 0x7f950c19b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35716/0 (socket says 172.21.15.47:35716) 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.773+0000 7f950b7fe640 1 -- 172.21.15.47:0/3955800825 learned_addr learned my addr 172.21.15.47:0/3955800825 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f950affd640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950c1025c0 0x7f950c199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f9503fff640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f950c103640 0x7f950c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f950b7fe640 1 -- 172.21.15.47:0/3955800825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f950c103640 msgr2=0x7f950c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f950b7fe640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f950c103640 0x7f950c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f950b7fe640 1 -- 172.21.15.47:0/3955800825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950c1025c0 msgr2=0x7f950c199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f950b7fe640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950c1025c0 0x7f950c199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f950b7fe640 1 -- 172.21.15.47:0/3955800825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950c19b930 con 0x7f950c103fe0 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f9503fff640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f950c103640 0x7f950c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f950affd640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950c1025c0 0x7f950c199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f950b7fe640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 0x7f950c19b110 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9504006010 tx=0x7f9504003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f9508ff9640 1 -- 172.21.15.47:0/3955800825 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504004240 con 0x7f950c103fe0 2024-09-21T00:59:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f9508ff9640 1 -- 172.21.15.47:0/3955800825 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95040317e0 con 0x7f950c103fe0 2024-09-21T00:59:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f9508ff9640 1 -- 172.21.15.47:0/3955800825 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950402fac0 con 0x7f950c103fe0 2024-09-21T00:59:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f95117a8640 1 -- 172.21.15.47:0/3955800825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950c19bbc0 con 0x7f950c103fe0 2024-09-21T00:59:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.774+0000 7f95117a8640 1 -- 172.21.15.47:0/3955800825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950c1a2310 con 0x7f950c103fe0 2024-09-21T00:59:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.777+0000 7f95187f0740 1 Processor -- start 2024-09-21T00:59:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.778+0000 7f9508ff9640 1 -- 172.21.15.47:0/3955800825 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f950402fcc0 con 0x7f950c103fe0 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.778+0000 7f95187f0740 1 -- start start 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.778+0000 7f95187f0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b33441b0 0x5580b36ebe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.778+0000 7f95187f0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b331b2f0 0x5580b36ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.778+0000 7f95187f0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36ed010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.778+0000 7f95187f0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580b365e6f0 con 0x5580b331b2f0 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.778+0000 7f95187f0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5580b364db20 con 0x5580b33441b0 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.778+0000 7f95187f0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5580b3651930 con 0x5580b33234d0 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b331b2f0 0x5580b36ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b331b2f0 0x5580b36ec4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35728/0 (socket says 172.21.15.47:35728) 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 -- 172.21.15.47:0/3217149730 learned_addr learned my addr 172.21.15.47:0/3217149730 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f9503fff640 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b33441b0 0x5580b36ebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f9503fff640 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 -- 172.21.15.47:0/3217149730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 msgr2=0x5580b36ed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36ed010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 -- 172.21.15.47:0/3217149730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b33441b0 msgr2=0x5580b36ebe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b33441b0 0x5580b36ebe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 -- 172.21.15.47:0/3217149730 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b3613530 con 0x5580b331b2f0 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f9503fff640 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f9508ff9640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f94f80b6510 0x7f94f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f950affd640 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b331b2f0 0x5580b36ec4c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009d40 tx=0x7f94fc0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f126f08ca2604b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f9503fff640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f94f80b6510 0x7f94f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.779+0000 7f9508ff9640 1 -- 172.21.15.47:0/3955800825 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f95041086f0 con 0x7f950c103fe0 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.780+0000 7f95017fa640 1 -- 172.21.15.47:0/3217149730 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc012650 con 0x5580b331b2f0 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.780+0000 7f95017fa640 1 -- 172.21.15.47:0/3217149730 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94fc009e30 con 0x5580b331b2f0 2024-09-21T00:59:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.780+0000 7f95017fa640 1 -- 172.21.15.47:0/3217149730 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00fc30 con 0x5580b331b2f0 2024-09-21T00:59:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 -- 172.21.15.47:0/3217149730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b331b2f0 msgr2=0x5580b36ec4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f9503fff640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f94f80b6510 0x7f94f80b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009460 tx=0x7f94f40093b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b331b2f0 0x5580b36ec4c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009d40 tx=0x7f94fc0117b0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 -- 172.21.15.47:0/3217149730 shutdown_connections 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b331b2f0 0x5580b36ec4c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 --2- 172.21.15.47:0/3217149730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b33441b0 0x5580b36ebe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 -- 172.21.15.47:0/3217149730 >> 172.21.15.47:0/3217149730 conn(0x5580b3338300 msgr2=0x5580b36e78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 -- 172.21.15.47:0/3217149730 shutdown_connections 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 -- 172.21.15.47:0/3217149730 wait complete. 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 -- start start 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.781+0000 7f95187f0740 1 Processor -- start 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f95187f0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 0x5580b36f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f95187f0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f95187f0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33441b0 0x5580b36f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f95187f0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580b3585ab0 con 0x5580b33441b0 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f95187f0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5580b35f3730 con 0x5580b331b2f0 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f95187f0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5580b36edb30 con 0x5580b33234d0 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f95187f0740 10 client.0 _ll_register_callbacks cb 0x5580b36476b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33441b0 0x5580b36f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33441b0 0x5580b36f67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35738/0 (socket says 172.21.15.47:35738) 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 -- 172.21.15.47:0/2141206338 learned_addr learned my addr 172.21.15.47:0/2141206338 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950affd640 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 0x5580b36f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f9503fff640 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 -- 172.21.15.47:0/2141206338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 msgr2=0x5580b36f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 -- 172.21.15.47:0/2141206338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 msgr2=0x5580b36f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 0x5580b36f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 -- 172.21.15.47:0/2141206338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b33af790 con 0x5580b33441b0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f950b7fe640 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33441b0 0x5580b36f67d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f950402f510 tx=0x7f95040ce150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a1144725f1dde9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f94f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f94f27fc640 1 -- 172.21.15.47:0/2141206338 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95040d80b0 con 0x5580b33441b0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f94f27fc640 1 -- 172.21.15.47:0/2141206338 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f95040cc870 con 0x5580b33441b0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.782+0000 7f95187f0740 1 -- 172.21.15.47:0/2141206338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94fc009e30 con 0x5580b33441b0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f94f27fc640 1 -- 172.21.15.47:0/2141206338 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f95040cf020 con 0x5580b33441b0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f95187f0740 10 client.15348 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f95187f0740 1 -- 172.21.15.47:0/2141206338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5580b3428620 con 0x5580b33441b0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f94f27fc640 1 -- 172.21.15.47:0/2141206338 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94fc009e30 con 0x5580b33441b0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f94f27fc640 1 -- 172.21.15.47:0/2141206338 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f95040cdb80 con 0x5580b33441b0 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f95187f0740 10 client.15348 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f95187f0740 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f95187f0740 20 client.15348 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f95187f0740 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580b3302d80 0x5580b3702d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f95187f0740 4 client.15348 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f95187f0740 1 -- 172.21.15.47:0/2141206338 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580b3660640 con 0x5580b3302d80 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.783+0000 7f950affd640 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580b3302d80 0x5580b3702d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.784+0000 7f94f27fc640 10 client.15348 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.784+0000 7f950affd640 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580b3302d80 0x5580b3702d60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a07aad512a293e37 server_cookie=ea3febc8ec25c585 in_seq=0 out_seq=0 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f94f27fc640 1 -- 172.21.15.47:0/2141206338 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580b3660640 con 0x5580b3302d80 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f94f27fc640 10 client.15348 handle_command_reply: tid=0 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 client.15348 shutdown 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 -- 172.21.15.47:0/2141206338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33441b0 msgr2=0x5580b36f67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33441b0 0x5580b36f67d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f950402f510 tx=0x7f95040ce150 comp rx=0 tx=0).stop 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 -- 172.21.15.47:0/2141206338 shutdown_connections 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580b3302d80 0x5580b3702d60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33441b0 0x5580b36f67d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f94f27fc640 0 client.15348 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b33234d0 0x5580b36f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 --2- 172.21.15.47:0/2141206338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 0x5580b36f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 -- 172.21.15.47:0/2141206338 >> 172.21.15.47:0/2141206338 conn(0x5580b3338300 msgr2=0x5580b36e5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 -- 172.21.15.47:0/2141206338 shutdown_connections 2024-09-21T00:59:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 1 -- 172.21.15.47:0/2141206338 wait complete. 2024-09-21T00:59:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.785+0000 7f95187f0740 20 client.15348 trim_cache size 0 max 16384 2024-09-21T00:59:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.800+0000 7f95187f0740 1 Processor -- start 2024-09-21T00:59:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.800+0000 7f95187f0740 1 -- start start 2024-09-21T00:59:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f95187f0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b3302d80 0x5580b36f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f95187f0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b331b2f0 0x5580b36e7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f95187f0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f95187f0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1a8d90 con 0x5580b33234d0 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f95187f0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1ab610 con 0x5580b3302d80 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f95187f0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1a9400 con 0x5580b331b2f0 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36e7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35742/0 (socket says 172.21.15.47:35742) 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950b7fe640 1 -- 172.21.15.47:0/3529864523 learned_addr learned my addr 172.21.15.47:0/3529864523 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950affd640 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b3302d80 0x5580b36f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f9503fff640 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b331b2f0 0x5580b36e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950b7fe640 1 -- 172.21.15.47:0/3529864523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b331b2f0 msgr2=0x5580b36e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950b7fe640 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b331b2f0 0x5580b36e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950b7fe640 1 -- 172.21.15.47:0/3529864523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b3302d80 msgr2=0x5580b36f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950b7fe640 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b3302d80 0x5580b36f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.801+0000 7f950b7fe640 1 -- 172.21.15.47:0/3529864523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b36f5330 con 0x5580b33234d0 2024-09-21T00:59:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.802+0000 7f950b7fe640 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36e7d70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9504004af0 tx=0x7f95040f2110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a37e7458f82bd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.802+0000 7f9500ff9640 1 -- 172.21.15.47:0/3529864523 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95040d3400 con 0x5580b33234d0 2024-09-21T00:59:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.802+0000 7f9500ff9640 1 -- 172.21.15.47:0/3529864523 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9504036040 con 0x5580b33234d0 2024-09-21T00:59:00.804 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.802+0000 7f9500ff9640 1 -- 172.21.15.47:0/3529864523 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95040ca1e0 con 0x5580b33234d0 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 -- 172.21.15.47:0/3529864523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 msgr2=0x5580b36e7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36e7d70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9504004af0 tx=0x7f95040f2110 comp rx=0 tx=0).stop 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 -- 172.21.15.47:0/3529864523 shutdown_connections 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36e7d70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b331b2f0 0x5580b36e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 --2- 172.21.15.47:0/3529864523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b3302d80 0x5580b36f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 -- 172.21.15.47:0/3529864523 >> 172.21.15.47:0/3529864523 conn(0x5580b3338300 msgr2=0x5580b3702ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 -- 172.21.15.47:0/3529864523 shutdown_connections 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 -- 172.21.15.47:0/3529864523 wait complete. 2024-09-21T00:59:00.807 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 -- start start 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.803+0000 7f95187f0740 1 Processor -- start 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f95187f0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b3302d80 0x5580b36fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f95187f0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 0x5580b36fbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f95187f0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f95187f0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1a9ad0 con 0x5580b33234d0 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f95187f0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1aaf40 con 0x5580b331b2f0 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f95187f0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1aa1a0 con 0x5580b3302d80 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f95187f0740 10 client.0 _ll_register_callbacks cb 0x7f9504009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36fc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35750/0 (socket says 172.21.15.47:35750) 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 -- 172.21.15.47:0/786893635 learned_addr learned my addr 172.21.15.47:0/786893635 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f9503fff640 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 0x5580b36fbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950affd640 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b3302d80 0x5580b36fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.808 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 -- 172.21.15.47:0/786893635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b3302d80 msgr2=0x5580b36fd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b3302d80 0x5580b36fd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 -- 172.21.15.47:0/786893635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 msgr2=0x5580b36fbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 0x5580b36fbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 -- 172.21.15.47:0/786893635 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b36fc820 con 0x5580b33234d0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f950b7fe640 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36fc2e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f95040d8380 tx=0x7f95040ce760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648cc6ea9a7d2eab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f94f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f94f27fc640 1 -- 172.21.15.47:0/786893635 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95040d3400 con 0x5580b33234d0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f94f27fc640 1 -- 172.21.15.47:0/786893635 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f95040cdb80 con 0x5580b33234d0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.804+0000 7f95187f0740 1 -- 172.21.15.47:0/786893635 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9504036040 con 0x5580b33234d0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f94f27fc640 1 -- 172.21.15.47:0/786893635 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f95040d7eb0 con 0x5580b33234d0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f95187f0740 10 client.15354 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f95187f0740 1 -- 172.21.15.47:0/786893635 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5580b36fc820 con 0x5580b33234d0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f94f27fc640 1 -- 172.21.15.47:0/786893635 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9504036040 con 0x5580b33234d0 2024-09-21T00:59:00.809 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f94f27fc640 1 -- 172.21.15.47:0/786893635 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f95040cd5f0 con 0x5580b33234d0 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f95187f0740 10 client.15354 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f95187f0740 10 client.15354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f95187f0740 20 client.15354 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f95187f0740 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580b33441b0 0x5580b376f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f95187f0740 4 client.15354 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f95187f0740 1 -- 172.21.15.47:0/786893635 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5580b365c0f0 con 0x5580b33441b0 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.805+0000 7f950affd640 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580b33441b0 0x5580b376f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.806+0000 7f94f27fc640 10 client.15354 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:00.810 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.806+0000 7f950affd640 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580b33441b0 0x5580b376f930 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48a048d8839d292d server_cookie=f43b34956509805f in_seq=0 out_seq=0 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.811+0000 7f94f27fc640 1 -- 172.21.15.47:0/786893635 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5580b365c0f0 con 0x5580b33441b0 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.811+0000 7f94f27fc640 10 client.15354 handle_command_reply: tid=0 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.811+0000 7f95187f0740 1 client.15354 shutdown 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 -- 172.21.15.47:0/786893635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 msgr2=0x5580b36fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36fc2e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f95040d8380 tx=0x7f95040ce760 comp rx=0 tx=0).stop 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 -- 172.21.15.47:0/786893635 shutdown_connections 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580b33441b0 0x5580b376f930 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580b33234d0 0x5580b36fc2e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580b331b2f0 0x5580b36fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f94f27fc640 0 client.15354 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 --2- 172.21.15.47:0/786893635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580b3302d80 0x5580b36fd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 -- 172.21.15.47:0/786893635 >> 172.21.15.47:0/786893635 conn(0x5580b3338300 msgr2=0x5580b36eff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 -- 172.21.15.47:0/786893635 shutdown_connections 2024-09-21T00:59:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 1 -- 172.21.15.47:0/786893635 wait complete. 2024-09-21T00:59:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95187f0740 20 client.15354 trim_cache size 0 max 16384 2024-09-21T00:59:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T00:59:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T00:59:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T00:59:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95117a8640 1 -- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f94f80b6510 msgr2=0x7f94f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95117a8640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f94f80b6510 0x7f94f80b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009460 tx=0x7f94f40093b0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95117a8640 1 -- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 msgr2=0x7f950c19b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.812+0000 7f95117a8640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 0x7f950c19b110 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9504006010 tx=0x7f9504003c20 comp rx=0 tx=0).stop 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.813+0000 7f95117a8640 1 -- 172.21.15.47:0/3955800825 shutdown_connections 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.813+0000 7f95117a8640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f94f80b6510 0x7f94f80b8a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.813+0000 7f95117a8640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f950c103fe0 0x7f950c19b110 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.813+0000 7f95117a8640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f950c103640 0x7f950c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.813+0000 7f95117a8640 1 --2- 172.21.15.47:0/3955800825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950c1025c0 0x7f950c199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.813+0000 7f95117a8640 1 -- 172.21.15.47:0/3955800825 >> 172.21.15.47:0/3955800825 conn(0x7f950c0fdf00 msgr2=0x7f950c106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.813+0000 7f95117a8640 1 -- 172.21.15.47:0/3955800825 shutdown_connections 2024-09-21T00:59:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:00.813+0000 7f95117a8640 1 -- 172.21.15.47:0/3955800825 wait complete. 2024-09-21T00:59:00.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:00 smithi134 ceph-mon[34785]: pgmap v354: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:59:02.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:02 smithi114 ceph-mon[34309]: pgmap v355: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:59:02.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:02 smithi047 ceph-mon[30960]: pgmap v355: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:59:02.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:02 smithi134 ceph-mon[34785]: pgmap v355: 97 pgs: 97 active+clean; 655 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T00:59:04.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:04 smithi114 ceph-mon[34309]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T00:59:04.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:04 smithi047 ceph-mon[30960]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T00:59:04.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:04 smithi134 ceph-mon[34785]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T00:59:06.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:06 smithi114 ceph-mon[34309]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:06.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:06 smithi047 ceph-mon[30960]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:06 smithi134 ceph-mon[34785]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:07.437 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:59:07.790 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.332+0000 7fef6159a640 1 -- 172.21.15.47:0/1973714003 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c02f310 con 0x7fef6410ddf0 2024-09-21T00:59:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.333+0000 7fef68bd4640 1 -- 172.21.15.47:0/1973714003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6410ddf0 msgr2=0x7fef64110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.333+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1973714003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6410ddf0 0x7fef64110300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009ca0 tx=0x7fef5c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.333+0000 7fef68bd4640 1 -- 172.21.15.47:0/1973714003 shutdown_connections 2024-09-21T00:59:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.333+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1973714003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6410ddf0 0x7fef64110300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.333+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1973714003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef64105270 0x7fef6410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.333+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1973714003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef64104840 0x7fef64104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.333+0000 7fef68bd4640 1 -- 172.21.15.47:0/1973714003 >> 172.21.15.47:0/1973714003 conn(0x7fef64079730 msgr2=0x7fef64079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.333+0000 7fef68bd4640 1 -- 172.21.15.47:0/1973714003 shutdown_connections 2024-09-21T00:59:08.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.334+0000 7fef68bd4640 1 -- 172.21.15.47:0/1973714003 wait complete. 2024-09-21T00:59:08.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef68bd4640 1 Processor -- start 2024-09-21T00:59:08.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef68bd4640 1 -- start start 2024-09-21T00:59:08.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef68bd4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64104840 0x7fef6419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef68bd4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef64105270 0x7fef6419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef68bd4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef6410ddf0 0x7fef6419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef68bd4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fef64113a70 con 0x7fef64104840 2024-09-21T00:59:08.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef68bd4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fef641138f0 con 0x7fef6410ddf0 2024-09-21T00:59:08.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef68bd4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef64113bf0 con 0x7fef64105270 2024-09-21T00:59:08.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef6259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64104840 0x7fef6419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef6259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64104840 0x7fef6419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58100/0 (socket says 172.21.15.47:58100) 2024-09-21T00:59:08.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef6259c640 1 -- 172.21.15.47:0/1338785230 learned_addr learned my addr 172.21.15.47:0/1338785230 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:08.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.335+0000 7fef61d9b640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef64105270 0x7fef6419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef62d9d640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef6410ddf0 0x7fef6419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef6259c640 1 -- 172.21.15.47:0/1338785230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef64105270 msgr2=0x7fef6419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef6259c640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef64105270 0x7fef6419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef6259c640 1 -- 172.21.15.47:0/1338785230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef6410ddf0 msgr2=0x7fef6419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef6259c640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef6410ddf0 0x7fef6419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef6259c640 1 -- 172.21.15.47:0/1338785230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef641a0410 con 0x7fef64104840 2024-09-21T00:59:08.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef62d9d640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef6410ddf0 0x7fef6419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:08.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef61d9b640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef64105270 0x7fef6419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:08.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef6259c640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64104840 0x7fef6419a4a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fef5400e9c0 tx=0x7fef5400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef537fe640 1 -- 172.21.15.47:0/1338785230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5400cd80 con 0x7fef64104840 2024-09-21T00:59:08.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef68bd4640 1 -- 172.21.15.47:0/1338785230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef641a0700 con 0x7fef64104840 2024-09-21T00:59:08.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.336+0000 7fef68bd4640 1 -- 172.21.15.47:0/1338785230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef64102630 con 0x7fef64104840 2024-09-21T00:59:08.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.337+0000 7fef537fe640 1 -- 172.21.15.47:0/1338785230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef540108e0 con 0x7fef64104840 2024-09-21T00:59:08.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.337+0000 7fef537fe640 1 -- 172.21.15.47:0/1338785230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540176a0 con 0x7fef64104840 2024-09-21T00:59:08.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.340+0000 7fef537fe640 1 -- 172.21.15.47:0/1338785230 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fef54017880 con 0x7fef64104840 2024-09-21T00:59:08.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.340+0000 7fef6f148740 1 Processor -- start 2024-09-21T00:59:08.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.340+0000 7fef6f148740 1 -- start start 2024-09-21T00:59:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef6f148740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 0x558351a4b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef6f148740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55835167b1b0 0x558351a4b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef6f148740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a4bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef6f148740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5583519c1e50 con 0x558351683390 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef6f148740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5583519b1280 con 0x5583516a4070 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef6f148740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5583519b5090 con 0x55835167b1b0 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a4bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a4bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58116/0 (socket says 172.21.15.47:58116) 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef61d9b640 1 -- 172.21.15.47:0/1910846009 learned_addr learned my addr 172.21.15.47:0/1910846009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef537fe640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fef4c0b6510 0x7fef4c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.341+0000 7fef62d9d640 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 0x558351a4b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.342+0000 7fef537fe640 1 -- 172.21.15.47:0/1338785230 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fef540e75d0 con 0x7fef64104840 2024-09-21T00:59:08.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.342+0000 7fef6259c640 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55835167b1b0 0x558351a4b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.342+0000 7fef61d9b640 1 -- 172.21.15.47:0/1910846009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55835167b1b0 msgr2=0x558351a4b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.342+0000 7fef61d9b640 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55835167b1b0 0x558351a4b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.342+0000 7fef61d9b640 1 -- 172.21.15.47:0/1910846009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 msgr2=0x558351a4b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.342+0000 7fef61d9b640 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 0x558351a4b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.342+0000 7fef62d9d640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fef4c0b6510 0x7fef4c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.342+0000 7fef61d9b640 1 -- 172.21.15.47:0/1910846009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835170f650 con 0x558351683390 2024-09-21T00:59:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.343+0000 7fef62d9d640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fef4c0b6510 0x7fef4c0b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fef5c02f500 tx=0x7fef5c02a8c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.343+0000 7fef61d9b640 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a4bcf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fef580096f0 tx=0x7fef58005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c90047313e9d9d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.343+0000 7fef50ff9640 1 -- 172.21.15.47:0/1910846009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5801e070 con 0x558351683390 2024-09-21T00:59:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.343+0000 7fef50ff9640 1 -- 172.21.15.47:0/1910846009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef5800e930 con 0x558351683390 2024-09-21T00:59:08.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.343+0000 7fef50ff9640 1 -- 172.21.15.47:0/1910846009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58003850 con 0x558351683390 2024-09-21T00:59:08.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 -- 172.21.15.47:0/1910846009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 msgr2=0x558351a4bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a4bcf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fef580096f0 tx=0x7fef58005f90 comp rx=0 tx=0).stop 2024-09-21T00:59:08.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 -- 172.21.15.47:0/1910846009 shutdown_connections 2024-09-21T00:59:08.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a4bcf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55835167b1b0 0x558351a4b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 --2- 172.21.15.47:0/1910846009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 0x558351a4b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 -- 172.21.15.47:0/1910846009 >> 172.21.15.47:0/1910846009 conn(0x558351698460 msgr2=0x558351a49160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 -- 172.21.15.47:0/1910846009 shutdown_connections 2024-09-21T00:59:08.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.344+0000 7fef6f148740 1 -- 172.21.15.47:0/1910846009 wait complete. 2024-09-21T00:59:08.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.345+0000 7fef6f148740 1 -- start start 2024-09-21T00:59:08.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.345+0000 7fef6f148740 1 Processor -- start 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef6f148740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55835167b1b0 0x558351a5f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef6f148740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a5f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a5f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a5f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58124/0 (socket says 172.21.15.47:58124) 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef61d9b640 1 -- 172.21.15.47:0/1539882909 learned_addr learned my addr 172.21.15.47:0/1539882909 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef6f148740 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a6b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558351812700 con 0x558351683390 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55835194c110 con 0x55835167b1b0 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef6259c640 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55835167b1b0 0x558351a5f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558351a62180 con 0x5583516a4070 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.346+0000 7fef6f148740 10 client.0 _ll_register_callbacks cb 0x558351965990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:08.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef62d9d640 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a6b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef61d9b640 1 -- 172.21.15.47:0/1539882909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 msgr2=0x558351a6b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef61d9b640 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a6b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef61d9b640 1 -- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55835167b1b0 msgr2=0x558351a5f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef61d9b640 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55835167b1b0 0x558351a5f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef61d9b640 1 -- 172.21.15.47:0/1539882909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558351979c40 con 0x558351683390 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef6259c640 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55835167b1b0 0x558351a5f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef61d9b640 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a5f610 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fef580106c0 tx=0x7fef5800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46db1333962836aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef49ffb640 1 -- 172.21.15.47:0/1539882909 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5801e070 con 0x558351683390 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.347+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef5800e930 con 0x558351683390 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef49ffb640 1 -- 172.21.15.47:0/1539882909 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fef58019660 con 0x558351683390 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef49ffb640 1 -- 172.21.15.47:0/1539882909 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fef58019860 con 0x558351683390 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef6f148740 10 client.15366 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558351a6deb0 con 0x558351683390 2024-09-21T00:59:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef49ffb640 1 -- 172.21.15.47:0/1539882909 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef5800e930 con 0x558351683390 2024-09-21T00:59:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef49ffb640 1 -- 172.21.15.47:0/1539882909 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fef58024c00 con 0x558351683390 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef6f148740 10 client.15366 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef6f148740 10 client.15366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef6f148740 20 client.15366 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef6f148740 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5583516629f0 0x558351a71270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef6f148740 4 client.15366 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.348+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583519c3da0 con 0x5583516629f0 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.349+0000 7fef6259c640 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5583516629f0 0x558351a71270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.349+0000 7fef49ffb640 10 client.15366 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.349+0000 7fef6259c640 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5583516629f0 0x558351a71270 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd2cd2a95ec514db server_cookie=80df99472c13f342 in_seq=0 out_seq=0 2024-09-21T00:59:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef49ffb640 1 -- 172.21.15.47:0/1539882909 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583519c3da0 con 0x5583516629f0 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef49ffb640 10 client.15366 handle_command_reply: tid=0 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 client.15366 shutdown 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 msgr2=0x558351a5f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a5f610 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fef580106c0 tx=0x7fef5800eb70 comp rx=0 tx=0).stop 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 shutdown_connections 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5583516629f0 0x558351a71270 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef49ffb640 0 client.15366 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a6b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558351683390 0x558351a5f610 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 --2- 172.21.15.47:0/1539882909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55835167b1b0 0x558351a5f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.350+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 >> 172.21.15.47:0/1539882909 conn(0x558351698460 msgr2=0x558351a47700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.351+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 shutdown_connections 2024-09-21T00:59:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.351+0000 7fef6f148740 1 -- 172.21.15.47:0/1539882909 wait complete. 2024-09-21T00:59:08.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.351+0000 7fef6f148740 20 client.15366 trim_cache size 0 max 16384 2024-09-21T00:59:08.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef6f148740 1 Processor -- start 2024-09-21T00:59:08.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef6f148740 1 -- start start 2024-09-21T00:59:08.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef6f148740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516629f0 0x558351a5f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef6f148740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a50a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef6f148740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a5c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef6f148740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400c2d0 con 0x55835167b1b0 2024-09-21T00:59:08.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef6f148740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400eb50 con 0x5583516629f0 2024-09-21T00:59:08.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a50a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a50a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58136/0 (socket says 172.21.15.47:58136) 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef61d9b640 1 -- 172.21.15.47:0/2713324554 learned_addr learned my addr 172.21.15.47:0/2713324554 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.370+0000 7fef6f148740 1 -- 172.21.15.47:0/2713324554 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400c940 con 0x5583516a4070 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef6259c640 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516629f0 0x558351a5f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef62d9d640 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a5c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef61d9b640 1 -- 172.21.15.47:0/2713324554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 msgr2=0x558351a5c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef61d9b640 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a5c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef61d9b640 1 -- 172.21.15.47:0/2713324554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516629f0 msgr2=0x558351a5f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef61d9b640 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516629f0 0x558351a5f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef61d9b640 1 -- 172.21.15.47:0/2713324554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558351a5e030 con 0x55835167b1b0 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef62d9d640 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a5c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef6259c640 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516629f0 0x558351a5f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:08.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.371+0000 7fef61d9b640 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a50a00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fef5800ef90 tx=0x7fef5802d640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8647485c4aa453df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.372+0000 7fef4bfff640 1 -- 172.21.15.47:0/2713324554 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5801e070 con 0x55835167b1b0 2024-09-21T00:59:08.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.372+0000 7fef4bfff640 1 -- 172.21.15.47:0/2713324554 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef5803d070 con 0x55835167b1b0 2024-09-21T00:59:08.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.372+0000 7fef4bfff640 1 -- 172.21.15.47:0/2713324554 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58019a00 con 0x55835167b1b0 2024-09-21T00:59:08.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 -- 172.21.15.47:0/2713324554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 msgr2=0x558351a50a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a50a00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fef5800ef90 tx=0x7fef5802d640 comp rx=0 tx=0).stop 2024-09-21T00:59:08.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 -- 172.21.15.47:0/2713324554 shutdown_connections 2024-09-21T00:59:08.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516a4070 0x558351a5c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a50a00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 --2- 172.21.15.47:0/2713324554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516629f0 0x558351a5f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 -- 172.21.15.47:0/2713324554 >> 172.21.15.47:0/2713324554 conn(0x558351698460 msgr2=0x558351a502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 -- 172.21.15.47:0/2713324554 shutdown_connections 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 -- 172.21.15.47:0/2713324554 wait complete. 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 -- start start 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.373+0000 7fef6f148740 1 Processor -- start 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef6f148740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516629f0 0x558351a63be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef6f148740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a64120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef6f148740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 0x558351adaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef6f148740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400d010 con 0x55835167b1b0 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef6f148740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400e480 con 0x5583516a4070 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef6f148740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef4400d6e0 con 0x5583516629f0 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef6f148740 10 client.0 _ll_register_callbacks cb 0x7fef5801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a64120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef61d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a64120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58146/0 (socket says 172.21.15.47:58146) 2024-09-21T00:59:08.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef61d9b640 1 -- 172.21.15.47:0/3963562486 learned_addr learned my addr 172.21.15.47:0/3963562486 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef6259c640 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516629f0 0x558351a63be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef62d9d640 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 0x558351adaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef61d9b640 1 -- 172.21.15.47:0/3963562486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516629f0 msgr2=0x558351a63be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef61d9b640 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516629f0 0x558351a63be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef61d9b640 1 -- 172.21.15.47:0/3963562486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 msgr2=0x558351adaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef61d9b640 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 0x558351adaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.374+0000 7fef61d9b640 1 -- 172.21.15.47:0/3963562486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558351adb030 con 0x55835167b1b0 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.375+0000 7fef61d9b640 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a64120 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fef5800e850 tx=0x7fef5800e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf5a646931ad212 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.375+0000 7fef49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.375+0000 7fef49ffb640 1 -- 172.21.15.47:0/3963562486 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5801e070 con 0x55835167b1b0 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.375+0000 7fef49ffb640 1 -- 172.21.15.47:0/3963562486 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fef5802da60 con 0x55835167b1b0 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.375+0000 7fef6f148740 1 -- 172.21.15.47:0/3963562486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef5803d070 con 0x55835167b1b0 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.375+0000 7fef49ffb640 1 -- 172.21.15.47:0/3963562486 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fef5802dc60 con 0x55835167b1b0 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.375+0000 7fef6f148740 10 client.15372 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.375+0000 7fef6f148740 1 -- 172.21.15.47:0/3963562486 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558351adc230 con 0x55835167b1b0 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef49ffb640 1 -- 172.21.15.47:0/3963562486 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef58046070 con 0x55835167b1b0 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef49ffb640 1 -- 172.21.15.47:0/3963562486 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fef580054a0 con 0x55835167b1b0 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef6f148740 10 client.15372 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef6f148740 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef6f148740 20 client.15372 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef6f148740 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558351637da0 0x558351ade8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef6f148740 4 client.15372 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:59:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef6f148740 1 -- 172.21.15.47:0/3963562486 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fef5803d070 con 0x558351637da0 2024-09-21T00:59:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.376+0000 7fef6259c640 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558351637da0 0x558351ade8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.377+0000 7fef49ffb640 10 client.15372 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.377+0000 7fef6259c640 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558351637da0 0x558351ade8a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd81ed7e8419d5c4 server_cookie=5e291ed042a900f4 in_seq=0 out_seq=0 2024-09-21T00:59:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.377+0000 7fef49ffb640 1 -- 172.21.15.47:0/3963562486 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7fef5803d070 con 0x558351637da0 2024-09-21T00:59:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.377+0000 7fef49ffb640 10 client.15372 handle_command_reply: tid=0 2024-09-21T00:59:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.377+0000 7fef6f148740 1 client.15372 shutdown 2024-09-21T00:59:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.377+0000 7fef6f148740 1 -- 172.21.15.47:0/3963562486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 msgr2=0x558351a64120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.377+0000 7fef6f148740 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a64120 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fef5800e850 tx=0x7fef5800e880 comp rx=0 tx=0).stop 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 1 -- 172.21.15.47:0/3963562486 shutdown_connections 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558351637da0 0x558351ade8a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5583516a4070 0x558351adaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef49ffb640 0 client.15372 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55835167b1b0 0x558351a64120 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 1 --2- 172.21.15.47:0/3963562486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583516629f0 0x558351a63be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 1 -- 172.21.15.47:0/3963562486 >> 172.21.15.47:0/3963562486 conn(0x558351698460 msgr2=0x558351a4c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 1 -- 172.21.15.47:0/3963562486 shutdown_connections 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 1 -- 172.21.15.47:0/3963562486 wait complete. 2024-09-21T00:59:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.378+0000 7fef6f148740 20 client.15372 trim_cache size 0 max 16384 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:08.382 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:08.383 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:59:08.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 -- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fef4c0b6510 msgr2=0x7fef4c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fef4c0b6510 0x7fef4c0b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fef5c02f500 tx=0x7fef5c02a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 -- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64104840 msgr2=0x7fef6419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:08.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64104840 0x7fef6419a4a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fef5400e9c0 tx=0x7fef5400ee80 comp rx=0 tx=0).stop 2024-09-21T00:59:08.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 -- 172.21.15.47:0/1338785230 shutdown_connections 2024-09-21T00:59:08.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fef4c0b6510 0x7fef4c0b8a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef6410ddf0 0x7fef6419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef64105270 0x7fef6419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 --2- 172.21.15.47:0/1338785230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef64104840 0x7fef6419a4a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:08.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 -- 172.21.15.47:0/1338785230 >> 172.21.15.47:0/1338785230 conn(0x7fef64079730 msgr2=0x7fef64107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:08.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 -- 172.21.15.47:0/1338785230 shutdown_connections 2024-09-21T00:59:08.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:08.379+0000 7fef68bd4640 1 -- 172.21.15.47:0/1338785230 wait complete. 2024-09-21T00:59:08.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:08 smithi114 ceph-mon[34309]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:08.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:08 smithi047 ceph-mon[30960]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:08.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:08 smithi134 ceph-mon[34785]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:09.279 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:59:09.279 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:59:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:10.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 -- 172.21.15.47:0/1701692472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828103b80 msgr2=0x7f7828103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:10.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 --2- 172.21.15.47:0/1701692472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828103b80 0x7f7828103f90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f781c009900 tx=0x7f781c02a410 comp rx=0 tx=0).stop 2024-09-21T00:59:10.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 -- 172.21.15.47:0/1701692472 shutdown_connections 2024-09-21T00:59:10.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 --2- 172.21.15.47:0/1701692472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7828109e10 0x7f7828110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 --2- 172.21.15.47:0/1701692472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78281094c0 0x7f78281098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 --2- 172.21.15.47:0/1701692472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828103b80 0x7f7828103f90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 -- 172.21.15.47:0/1701692472 >> 172.21.15.47:0/1701692472 conn(0x7f78280ff610 msgr2=0x7f7828101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:10.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 -- 172.21.15.47:0/1701692472 shutdown_connections 2024-09-21T00:59:10.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.114+0000 7f782ef40640 1 -- 172.21.15.47:0/1701692472 wait complete. 2024-09-21T00:59:10.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.115+0000 7f782ef40640 1 Processor -- start 2024-09-21T00:59:10.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.115+0000 7f782ef40640 1 -- start start 2024-09-21T00:59:10.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.115+0000 7f782ef40640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78281094c0 0x7f782819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.115+0000 7f782ef40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828109e10 0x7f782819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.115+0000 7f782ef40640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78281a1fb0 0x7f78281a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.115+0000 7f782ef40640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7828113b20 con 0x7f7828109e10 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.115+0000 7f782ef40640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f78281139a0 con 0x7f78281a1fb0 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.115+0000 7f782ef40640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7828113ca0 con 0x7f78281094c0 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828109e10 0x7f782819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828109e10 0x7f782819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58168/0 (socket says 172.21.15.47:58168) 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 -- 172.21.15.47:0/2204111377 learned_addr learned my addr 172.21.15.47:0/2204111377 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f782d4dd640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78281a1fb0 0x7f78281a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f782ccdc640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78281094c0 0x7f782819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 -- 172.21.15.47:0/2204111377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78281094c0 msgr2=0x7f782819c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:10.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78281094c0 0x7f782819c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 -- 172.21.15.47:0/2204111377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78281a1fb0 msgr2=0x7f78281a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:10.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78281a1fb0 0x7f78281a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 -- 172.21.15.47:0/2204111377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78281a2b90 con 0x7f7828109e10 2024-09-21T00:59:10.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f782ccdc640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78281094c0 0x7f782819c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:10.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.116+0000 7f7827fff640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828109e10 0x7f782819cdd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7814009f70 tx=0x7f781400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:10.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.117+0000 7f7825ffb640 1 -- 172.21.15.47:0/2204111377 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781400cd20 con 0x7f7828109e10 2024-09-21T00:59:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.117+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782810a4d0 con 0x7f7828109e10 2024-09-21T00:59:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.117+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782810aa60 con 0x7f7828109e10 2024-09-21T00:59:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.118+0000 7f7825ffb640 1 -- 172.21.15.47:0/2204111377 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78140218f0 con 0x7f7828109e10 2024-09-21T00:59:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.118+0000 7f7825ffb640 1 -- 172.21.15.47:0/2204111377 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814037060 con 0x7f7828109e10 2024-09-21T00:59:10.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.119+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7828104e00 con 0x7f7828109e10 2024-09-21T00:59:10.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.122+0000 7f7825ffb640 1 -- 172.21.15.47:0/2204111377 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7814029590 con 0x7f7828109e10 2024-09-21T00:59:10.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.123+0000 7f7825ffb640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78180b6790 0x7f78180b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:10.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.123+0000 7f7825ffb640 1 -- 172.21.15.47:0/2204111377 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f78140f8230 con 0x7f7828109e10 2024-09-21T00:59:10.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.124+0000 7f782ccdc640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78180b6790 0x7f78180b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.124+0000 7f782ccdc640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78180b6790 0x7f78180b8ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f781c006010 tx=0x7f781c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:10.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.132+0000 7f7825ffb640 1 -- 172.21.15.47:0/2204111377 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78140beac0 con 0x7f7828109e10 2024-09-21T00:59:10.359 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:10 smithi047 ceph-mon[30960]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:10.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.389+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f782810add0 con 0x7f7828109e10 2024-09-21T00:59:10.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.389+0000 7f7825ffb640 1 -- 172.21.15.47:0/2204111377 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f78140c2ea0 con 0x7f7828109e10 2024-09-21T00:59:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:59:10.390 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:59:10.391 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78180b6790 msgr2=0x7f78180b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78180b6790 0x7f78180b8ca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f781c006010 tx=0x7f781c000bc0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828109e10 msgr2=0x7f782819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828109e10 0x7f782819cdd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7814009f70 tx=0x7f781400edd0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 shutdown_connections 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78180b6790 0x7f78180b8ca0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78281a1fb0 0x7f78281a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7828109e10 0x7f782819cdd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 --2- 172.21.15.47:0/2204111377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78281094c0 0x7f782819c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 >> 172.21.15.47:0/2204111377 conn(0x7f78280ff610 msgr2=0x7f7828108bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 shutdown_connections 2024-09-21T00:59:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:10.393+0000 7f782ef40640 1 -- 172.21.15.47:0/2204111377 wait complete. 2024-09-21T00:59:10.646 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:10 smithi134 ceph-mon[34785]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:10.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:10 smithi114 ceph-mon[34309]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:11.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:59:11.401 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:11.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:11 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2204111377' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:11.660 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:11 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2204111377' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:11.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:11 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2204111377' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:11.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.914+0000 7fde1337d640 1 -- 172.21.15.47:0/1912799047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c109e00 msgr2=0x7fde0c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.914+0000 7fde1337d640 1 --2- 172.21.15.47:0/1912799047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c109e00 0x7fde0c110630 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fde04009ca0 tx=0x7fde0402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.914+0000 7fde1337d640 1 -- 172.21.15.47:0/1912799047 shutdown_connections 2024-09-21T00:59:11.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.914+0000 7fde1337d640 1 --2- 172.21.15.47:0/1912799047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c109e00 0x7fde0c110630 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.914+0000 7fde1337d640 1 --2- 172.21.15.47:0/1912799047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c1094b0 0x7fde0c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.914+0000 7fde1337d640 1 --2- 172.21.15.47:0/1912799047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c101f70 0x7fde0c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.914+0000 7fde1337d640 1 -- 172.21.15.47:0/1912799047 >> 172.21.15.47:0/1912799047 conn(0x7fde0c077c60 msgr2=0x7fde0c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.914+0000 7fde1337d640 1 -- 172.21.15.47:0/1912799047 shutdown_connections 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.915+0000 7fde1337d640 1 -- 172.21.15.47:0/1912799047 wait complete. 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.915+0000 7fde1337d640 1 Processor -- start 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde1337d640 1 -- start start 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde1337d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c101f70 0x7fde0c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde1337d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c1094b0 0x7fde0c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde1337d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c109e00 0x7fde0c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde1337d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c113b10 con 0x7fde0c101f70 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde1337d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c113990 con 0x7fde0c109e00 2024-09-21T00:59:11.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde1337d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c113c90 con 0x7fde0c1094b0 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde11119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c101f70 0x7fde0c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde11119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c101f70 0x7fde0c19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55642/0 (socket says 172.21.15.47:55642) 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde11119640 1 -- 172.21.15.47:0/815868374 learned_addr learned my addr 172.21.15.47:0/815868374 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.916+0000 7fde10918640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c1094b0 0x7fde0c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde1191a640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c109e00 0x7fde0c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde10918640 1 -- 172.21.15.47:0/815868374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c109e00 msgr2=0x7fde0c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde10918640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c109e00 0x7fde0c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde10918640 1 -- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c101f70 msgr2=0x7fde0c19a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde10918640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c101f70 0x7fde0c19a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde10918640 1 -- 172.21.15.47:0/815868374 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c1a02b0 con 0x7fde0c1094b0 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde1191a640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c109e00 0x7fde0c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde11119640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c101f70 0x7fde0c19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde10918640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c1094b0 0x7fde0c19a9a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fde0c075ab0 tx=0x7fddfc00cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde027fc640 1 -- 172.21.15.47:0/815868374 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc007bb0 con 0x7fde0c1094b0 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde1337d640 1 -- 172.21.15.47:0/815868374 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c1a05a0 con 0x7fde0c1094b0 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.917+0000 7fde1337d640 1 -- 172.21.15.47:0/815868374 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c1a6dc0 con 0x7fde0c1094b0 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.918+0000 7fde027fc640 1 -- 172.21.15.47:0/815868374 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddfc007d50 con 0x7fde0c1094b0 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.918+0000 7fde027fc640 1 -- 172.21.15.47:0/815868374 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0187c0 con 0x7fde0c1094b0 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.921+0000 7fde027fc640 1 -- 172.21.15.47:0/815868374 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fddfc018960 con 0x7fde0c1094b0 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde198f1740 1 Processor -- start 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde198f1740 1 -- start start 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde027fc640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddf80b6540 0x7fddf80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde027fc640 1 -- 172.21.15.47:0/815868374 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fddfc0e7110 con 0x7fde0c1094b0 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde198f1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba6e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde198f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 0x55c18ba6e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde198f1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba6ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde198f1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c18b9e4ea0 con 0x55c18b6a6390 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde198f1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55c18b9d42d0 con 0x55c18b6c7070 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde198f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c18b9d80e0 con 0x55c18b69e1b0 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.922+0000 7fde1191a640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddf80b6540 0x7fddf80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba6e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba6e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:55946/0 (socket says 172.21.15.47:55946) 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde1191a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba6ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 -- 172.21.15.47:0/935842160 learned_addr learned my addr 172.21.15.47:0/935842160 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde10918640 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 0x55c18ba6e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 -- 172.21.15.47:0/935842160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 msgr2=0x55c18ba6e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 0x55c18ba6e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 -- 172.21.15.47:0/935842160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 msgr2=0x55c18ba6ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba6ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 -- 172.21.15.47:0/935842160 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c18b732650 con 0x55c18b6c7070 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde1191a640 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba6ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.923+0000 7fde11119640 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba6e2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde08011630 tx=0x7fde08011af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363e9221b2e0ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.924+0000 7fde1191a640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddf80b6540 0x7fddf80b8a50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fde0402f540 tx=0x7fde04004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.924+0000 7fddf77fe640 1 -- 172.21.15.47:0/935842160 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0801e070 con 0x55c18b6c7070 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.924+0000 7fddf77fe640 1 -- 172.21.15.47:0/935842160 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde0800fba0 con 0x55c18b6c7070 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.924+0000 7fddf77fe640 1 -- 172.21.15.47:0/935842160 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08019ca0 con 0x55c18b6c7070 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 -- 172.21.15.47:0/935842160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 msgr2=0x55c18ba6e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba6e2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde08011630 tx=0x7fde08011af0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 -- 172.21.15.47:0/935842160 shutdown_connections 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba6ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 0x55c18ba6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 --2- 172.21.15.47:0/935842160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba6e2c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 -- 172.21.15.47:0/935842160 >> 172.21.15.47:0/935842160 conn(0x55c18b6bb460 msgr2=0x55c18ba6c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:11.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 -- 172.21.15.47:0/935842160 shutdown_connections 2024-09-21T00:59:11.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.925+0000 7fde198f1740 1 -- 172.21.15.47:0/935842160 wait complete. 2024-09-21T00:59:11.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.926+0000 7fde198f1740 1 -- start start 2024-09-21T00:59:11.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.926+0000 7fde198f1740 1 Processor -- start 2024-09-21T00:59:11.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.926+0000 7fde198f1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b69e1b0 0x55c18ba80400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.926+0000 7fde198f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6a6390 0x55c18ba798b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde198f1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba79f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde198f1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c18b835700 con 0x55c18b69e1b0 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde198f1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55c18b96f160 con 0x55c18b6c7070 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde11119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b69e1b0 0x55c18ba80400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde198f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c18ba80da0 con 0x55c18b6a6390 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde198f1740 10 client.0 _ll_register_callbacks cb 0x55c18b9889e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde11119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b69e1b0 0x55c18ba80400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55666/0 (socket says 172.21.15.47:55666) 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde11119640 1 -- 172.21.15.47:0/2212011106 learned_addr learned my addr 172.21.15.47:0/2212011106 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde1191a640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba79f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.927+0000 7fde10918640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6a6390 0x55c18ba798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde1191a640 1 -- 172.21.15.47:0/2212011106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6a6390 msgr2=0x55c18ba798b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde1191a640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6a6390 0x55c18ba798b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde1191a640 1 -- 172.21.15.47:0/2212011106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b69e1b0 msgr2=0x55c18ba80400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde1191a640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b69e1b0 0x55c18ba80400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde1191a640 1 -- 172.21.15.47:0/2212011106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c18b99cc90 con 0x55c18b6c7070 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde10918640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6a6390 0x55c18ba798b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde11119640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b69e1b0 0x55c18ba80400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde1191a640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba79f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fde04005e30 tx=0x7fde0402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bb2dab3279d80dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fddf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fddf4ff9640 1 -- 172.21.15.47:0/2212011106 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0404f070 con 0x55c18b6c7070 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fde198f1740 1 -- 172.21.15.47:0/2212011106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde0800fba0 con 0x55c18b6c7070 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.928+0000 7fddf4ff9640 1 -- 172.21.15.47:0/2212011106 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fde04004240 con 0x55c18b6c7070 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fddf4ff9640 1 -- 172.21.15.47:0/2212011106 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fde0405b050 con 0x55c18b6c7070 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fde198f1740 10 client.25115 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fde198f1740 1 -- 172.21.15.47:0/2212011106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c18ba90f60 con 0x55c18b6c7070 2024-09-21T00:59:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fddf4ff9640 1 -- 172.21.15.47:0/2212011106 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde0800fba0 con 0x55c18b6c7070 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fddf4ff9640 1 -- 172.21.15.47:0/2212011106 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fde0402f9f0 con 0x55c18b6c7070 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fde198f1740 10 client.25115 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fde198f1740 10 client.25115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fde198f1740 20 client.25115 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fde198f1740 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c18b6859f0 0x55c18ba943f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fde198f1740 4 client.25115 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.929+0000 7fde198f1740 1 -- 172.21.15.47:0/2212011106 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c18b9e6df0 con 0x55c18b6859f0 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.930+0000 7fde11119640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c18b6859f0 0x55c18ba943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.930+0000 7fddf4ff9640 10 client.25115 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.930+0000 7fde11119640 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c18b6859f0 0x55c18ba943f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a8d187ee0547bc9 server_cookie=f130037649aa6d4a in_seq=0 out_seq=0 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.931+0000 7fddf4ff9640 1 -- 172.21.15.47:0/2212011106 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c18b9e6df0 con 0x55c18b6859f0 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.931+0000 7fddf4ff9640 10 client.25115 handle_command_reply: tid=0 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.931+0000 7fde198f1740 1 client.25115 shutdown 2024-09-21T00:59:11.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.931+0000 7fde198f1740 1 -- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 msgr2=0x55c18ba79f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.931+0000 7fde198f1740 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba79f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fde04005e30 tx=0x7fde0402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.932+0000 7fde198f1740 1 -- 172.21.15.47:0/2212011106 shutdown_connections 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.932+0000 7fde198f1740 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c18b6859f0 0x55c18ba943f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.932+0000 7fddf4ff9640 0 client.25115 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.932+0000 7fde198f1740 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6c7070 0x55c18ba79f50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.932+0000 7fde198f1740 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6a6390 0x55c18ba798b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.932+0000 7fde198f1740 1 --2- 172.21.15.47:0/2212011106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b69e1b0 0x55c18ba80400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.932+0000 7fde198f1740 1 -- 172.21.15.47:0/2212011106 >> 172.21.15.47:0/2212011106 conn(0x55c18b6bb460 msgr2=0x55c18ba6fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.932+0000 7fde198f1740 1 -- 172.21.15.47:0/2212011106 shutdown_connections 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.934+0000 7fde198f1740 1 -- 172.21.15.47:0/2212011106 wait complete. 2024-09-21T00:59:11.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.934+0000 7fde198f1740 20 client.25115 trim_cache size 0 max 16384 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.949+0000 7fde198f1740 1 Processor -- start 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.949+0000 7fde198f1740 1 -- start start 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde198f1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6859f0 0x55c18ba78130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde198f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 0x55c18ba78670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde198f1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6a6390 0x55c18ba76cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde198f1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fddf000c2f0 con 0x55c18b6859f0 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde198f1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fddf000eb70 con 0x55c18b6a6390 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde198f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddf000c960 con 0x55c18b69e1b0 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6859f0 0x55c18ba78130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6859f0 0x55c18ba78130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55678/0 (socket says 172.21.15.47:55678) 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 -- 172.21.15.47:0/1963852033 learned_addr learned my addr 172.21.15.47:0/1963852033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde1191a640 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6a6390 0x55c18ba76cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde10918640 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 0x55c18ba78670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 -- 172.21.15.47:0/1963852033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 msgr2=0x55c18ba78670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 0x55c18ba78670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 -- 172.21.15.47:0/1963852033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6a6390 msgr2=0x55c18ba76cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6a6390 0x55c18ba76cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 -- 172.21.15.47:0/1963852033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c18ba71080 con 0x55c18b6859f0 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.950+0000 7fde11119640 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6859f0 0x55c18ba78130 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fde08019880 tx=0x7fde08011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20006b16f6ec1c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.951+0000 7fddf6ffd640 1 -- 172.21.15.47:0/1963852033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08029070 con 0x55c18b6859f0 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.951+0000 7fddf6ffd640 1 -- 172.21.15.47:0/1963852033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde08019e20 con 0x55c18b6859f0 2024-09-21T00:59:11.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.951+0000 7fddf6ffd640 1 -- 172.21.15.47:0/1963852033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0801e040 con 0x55c18b6859f0 2024-09-21T00:59:11.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 -- 172.21.15.47:0/1963852033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6859f0 msgr2=0x55c18ba78130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6859f0 0x55c18ba78130 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fde08019880 tx=0x7fde08011580 comp rx=0 tx=0).stop 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 -- 172.21.15.47:0/1963852033 shutdown_connections 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b6a6390 0x55c18ba76cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b69e1b0 0x55c18ba78670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 --2- 172.21.15.47:0/1963852033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6859f0 0x55c18ba78130 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 -- 172.21.15.47:0/1963852033 >> 172.21.15.47:0/1963852033 conn(0x55c18b6bb460 msgr2=0x55c18ba749f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 -- 172.21.15.47:0/1963852033 shutdown_connections 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 -- 172.21.15.47:0/1963852033 wait complete. 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 -- start start 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.952+0000 7fde198f1740 1 Processor -- start 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde198f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6859f0 0x55c18ba7df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde198f1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b69e1b0 0x55c18ba7e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde198f1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba7e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde198f1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fddf000d030 con 0x55c18b6a6390 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde198f1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fddf000e4a0 con 0x55c18b69e1b0 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde1191a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba7e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde198f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fddf000d700 con 0x55c18b6859f0 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde1191a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba7e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55690/0 (socket says 172.21.15.47:55690) 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde1191a640 1 -- 172.21.15.47:0/3446075804 learned_addr learned my addr 172.21.15.47:0/3446075804 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde11119640 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6859f0 0x55c18ba7df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.953+0000 7fde10918640 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b69e1b0 0x55c18ba7e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fde198f1740 10 client.0 _ll_register_callbacks cb 0x7fde08005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fde11119640 1 -- 172.21.15.47:0/3446075804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b69e1b0 msgr2=0x55c18ba7e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fde11119640 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b69e1b0 0x55c18ba7e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fde11119640 1 -- 172.21.15.47:0/3446075804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 msgr2=0x55c18ba7e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:11.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fde11119640 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba7e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fde11119640 1 -- 172.21.15.47:0/3446075804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c18ba8e030 con 0x55c18b6859f0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fde11119640 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6859f0 0x55c18ba7df50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fde08005b90 tx=0x7fde08005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aed1fff7fed5867 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fddf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fddf4ff9640 1 -- 172.21.15.47:0/3446075804 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0801e070 con 0x55c18b6859f0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fddf4ff9640 1 -- 172.21.15.47:0/3446075804 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fde080198b0 con 0x55c18b6859f0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.954+0000 7fde198f1740 1 -- 172.21.15.47:0/3446075804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde08019e20 con 0x55c18b6859f0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fddf4ff9640 1 -- 172.21.15.47:0/3446075804 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fde08029040 con 0x55c18b6859f0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fde198f1740 10 client.25126 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fde198f1740 1 -- 172.21.15.47:0/3446075804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c18bafef70 con 0x55c18b6859f0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fddf4ff9640 1 -- 172.21.15.47:0/3446075804 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde08005670 con 0x55c18b6859f0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fddf4ff9640 1 -- 172.21.15.47:0/3446075804 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fde0803a030 con 0x55c18b6859f0 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fde198f1740 10 client.25126 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fde198f1740 10 client.25126 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fde198f1740 20 client.25126 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fde198f1740 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c18b6c7070 0x55c18bb014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fde198f1740 4 client.25126 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.955+0000 7fde198f1740 1 -- 172.21.15.47:0/3446075804 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fde08019e20 con 0x55c18b6c7070 2024-09-21T00:59:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.956+0000 7fde10918640 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c18b6c7070 0x55c18bb014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:11.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.956+0000 7fddf4ff9640 10 client.25126 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:11.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.956+0000 7fde10918640 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c18b6c7070 0x55c18bb014b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccf869c3ddf14165 server_cookie=681a98f8b3f9145c in_seq=0 out_seq=0 2024-09-21T00:59:11.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.956+0000 7fddf4ff9640 1 -- 172.21.15.47:0/3446075804 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fde08019e20 con 0x55c18b6c7070 2024-09-21T00:59:11.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.956+0000 7fddf4ff9640 10 client.25126 handle_command_reply: tid=0 2024-09-21T00:59:11.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.956+0000 7fde198f1740 1 client.25126 shutdown 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 -- 172.21.15.47:0/3446075804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6859f0 msgr2=0x55c18ba7df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6859f0 0x55c18ba7df50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fde08005b90 tx=0x7fde08005040 comp rx=0 tx=0).stop 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 -- 172.21.15.47:0/3446075804 shutdown_connections 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c18b6c7070 0x55c18bb014b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c18b6a6390 0x55c18ba7e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c18b69e1b0 0x55c18ba7e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 --2- 172.21.15.47:0/3446075804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c18b6859f0 0x55c18ba7df50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 -- 172.21.15.47:0/3446075804 >> 172.21.15.47:0/3446075804 conn(0x55c18b6bb460 msgr2=0x55c18ba749f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fddf4ff9640 0 client.25126 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 -- 172.21.15.47:0/3446075804 shutdown_connections 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 1 -- 172.21.15.47:0/3446075804 wait complete. 2024-09-21T00:59:11.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.957+0000 7fde198f1740 20 client.25126 trim_cache size 0 max 16384 2024-09-21T00:59:11.963 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-09-21T00:59:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 -- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddf80b6540 msgr2=0x7fddf80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddf80b6540 0x7fddf80b8a50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fde0402f540 tx=0x7fde04004a40 comp rx=0 tx=0).stop 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 -- 172.21.15.47:0/815868374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c1094b0 msgr2=0x7fde0c19a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c1094b0 0x7fde0c19a9a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fde0c075ab0 tx=0x7fddfc00cdd0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 -- 172.21.15.47:0/815868374 shutdown_connections 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fddf80b6540 0x7fddf80b8a50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde0c109e00 0x7fde0c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde0c1094b0 0x7fde0c19a9a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 --2- 172.21.15.47:0/815868374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde0c101f70 0x7fde0c19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 -- 172.21.15.47:0/815868374 >> 172.21.15.47:0/815868374 conn(0x7fde0c077c60 msgr2=0x7fde0c1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.958+0000 7fde1337d640 1 -- 172.21.15.47:0/815868374 shutdown_connections 2024-09-21T00:59:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:11.959+0000 7fde1337d640 1 -- 172.21.15.47:0/815868374 wait complete. 2024-09-21T00:59:12.635 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:12 smithi047 ceph-mon[30960]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:12.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:12 smithi114 ceph-mon[34309]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:12.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:12 smithi134 ceph-mon[34785]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:13.637 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:59:13.678 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:59:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.951+0000 7fdc30558640 1 -- 172.21.15.47:0/744558451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc28103fc0 msgr2=0x7fdc2810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.951+0000 7fdc30558640 1 --2- 172.21.15.47:0/744558451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc28103fc0 0x7fdc2810a960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009c90 tx=0x7fdc2002a860 comp rx=0 tx=0).stop 2024-09-21T00:59:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.951+0000 7fdc30558640 1 -- 172.21.15.47:0/744558451 shutdown_connections 2024-09-21T00:59:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.951+0000 7fdc30558640 1 --2- 172.21.15.47:0/744558451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc28103fc0 0x7fdc2810a960 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.951+0000 7fdc30558640 1 --2- 172.21.15.47:0/744558451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28103620 0x7fdc28103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.951+0000 7fdc30558640 1 --2- 172.21.15.47:0/744558451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc281025a0 0x7fdc28102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.951+0000 7fdc30558640 1 -- 172.21.15.47:0/744558451 >> 172.21.15.47:0/744558451 conn(0x7fdc280fdee0 msgr2=0x7fdc28100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.952+0000 7fdc30558640 1 -- 172.21.15.47:0/744558451 shutdown_connections 2024-09-21T00:59:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.952+0000 7fdc30558640 1 -- 172.21.15.47:0/744558451 wait complete. 2024-09-21T00:59:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.953+0000 7fdc30558640 1 Processor -- start 2024-09-21T00:59:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.953+0000 7fdc30558640 1 -- start start 2024-09-21T00:59:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.954+0000 7fdc30558640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc281025a0 0x7fdc28199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.954+0000 7fdc30558640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28103620 0x7fdc2819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.954+0000 7fdc2e2f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc281025a0 0x7fdc28199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.954+0000 7fdc2e2f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc281025a0 0x7fdc28199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55710/0 (socket says 172.21.15.47:55710) 2024-09-21T00:59:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.954+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/1513625163 learned_addr learned my addr 172.21.15.47:0/1513625163 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.954+0000 7fdc30558640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc28103fc0 0x7fdc2819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.954+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810f390 con 0x7fdc281025a0 2024-09-21T00:59:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28103620 0x7fdc2819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc28103fc0 0x7fdc2819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810f210 con 0x7fdc28103fc0 2024-09-21T00:59:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2810f510 con 0x7fdc28103620 2024-09-21T00:59:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/1513625163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28103620 msgr2=0x7fdc2819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28103620 0x7fdc2819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/1513625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc28103fc0 msgr2=0x7fdc2819af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc28103fc0 0x7fdc2819af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.955+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/1513625163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2819b7a0 con 0x7fdc281025a0 2024-09-21T00:59:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.956+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc28103fc0 0x7fdc2819af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.956+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc281025a0 0x7fdc28199d60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400e9f0 tx=0x7fdc2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.956+0000 7fdc1f7fe640 1 -- 172.21.15.47:0/1513625163 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400cd80 con 0x7fdc281025a0 2024-09-21T00:59:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.956+0000 7fdc1f7fe640 1 -- 172.21.15.47:0/1513625163 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc240108e0 con 0x7fdc281025a0 2024-09-21T00:59:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.956+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2819ba90 con 0x7fdc281025a0 2024-09-21T00:59:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.956+0000 7fdc1f7fe640 1 -- 172.21.15.47:0/1513625163 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc24018980 con 0x7fdc281025a0 2024-09-21T00:59:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.956+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc281a2180 con 0x7fdc281025a0 2024-09-21T00:59:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.960+0000 7fdc374c2740 1 Processor -- start 2024-09-21T00:59:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.960+0000 7fdc374c2740 1 -- start start 2024-09-21T00:59:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f90c1b0 0x55924fcb1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8e32f0 0x55924fcb2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc374c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55924fc266f0 con 0x55924f8eb4d0 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc374c2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55924fc15b20 con 0x55924f90c1b0 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc374c2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55924fc19930 con 0x55924f8e32f0 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc2daf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc2daf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55726/0 (socket says 172.21.15.47:55726) 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3162240698 learned_addr learned my addr 172.21.15.47:0/3162240698 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f90c1b0 0x55924fcb1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.961+0000 7fdc1f7fe640 1 -- 172.21.15.47:0/1513625163 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdc24018b20 con 0x7fdc281025a0 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3162240698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8e32f0 msgr2=0x55924fcb2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8e32f0 0x55924fcb2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8e32f0 0x55924fcb2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3162240698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f90c1b0 msgr2=0x55924fcb1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f90c1b0 0x55924fcb1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3162240698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924fbdb530 con 0x55924f8eb4d0 2024-09-21T00:59:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f90c1b0 0x55924fcb1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc3d50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800bcd0 tx=0x7fdc180107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0ef54841d77261 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc1cbfe640 1 -- 172.21.15.47:0/3162240698 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18005220 con 0x55924f8eb4d0 2024-09-21T00:59:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.963+0000 7fdc1f7fe640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdc140b6590 0x7fdc140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.962+0000 7fdc1cbfe640 1 -- 172.21.15.47:0/3162240698 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc18004c50 con 0x55924f8eb4d0 2024-09-21T00:59:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.964+0000 7fdc1cbfe640 1 -- 172.21.15.47:0/3162240698 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc180116e0 con 0x55924f8eb4d0 2024-09-21T00:59:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.964+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdc140b6590 0x7fdc140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.964+0000 7fdc1f7fe640 1 -- 172.21.15.47:0/1513625163 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fdc240e7610 con 0x7fdc281025a0 2024-09-21T00:59:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdc140b6590 0x7fdc140b8aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009c60 tx=0x7fdc200092a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 -- 172.21.15.47:0/3162240698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 msgr2=0x55924fcc3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc3d50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800bcd0 tx=0x7fdc180107a0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 -- 172.21.15.47:0/3162240698 shutdown_connections 2024-09-21T00:59:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc3d50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8e32f0 0x55924fcb2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3162240698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f90c1b0 0x55924fcb1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 -- 172.21.15.47:0/3162240698 >> 172.21.15.47:0/3162240698 conn(0x55924f900300 msgr2=0x55924fcaf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 -- 172.21.15.47:0/3162240698 shutdown_connections 2024-09-21T00:59:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.965+0000 7fdc374c2740 1 -- 172.21.15.47:0/3162240698 wait complete. 2024-09-21T00:59:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.966+0000 7fdc374c2740 1 -- start start 2024-09-21T00:59:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.966+0000 7fdc374c2740 1 Processor -- start 2024-09-21T00:59:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.966+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcc5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.966+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.966+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f90c1b0 0x55924fcc7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.966+0000 7fdc374c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55924fb4dab0 con 0x55924f8eb4d0 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2daf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2daf3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55728/0 (socket says 172.21.15.47:55728) 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2daf3640 1 -- 172.21.15.47:0/1374937649 learned_addr learned my addr 172.21.15.47:0/1374937649 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcc5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f90c1b0 0x55924fcc7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55924fbbb730 con 0x55924f8e32f0 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55924fcc43e0 con 0x55924f90c1b0 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc374c2740 10 client.0 _ll_register_callbacks cb 0x55924fc0f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/1374937649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f90c1b0 msgr2=0x55924fcc7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f90c1b0 0x55924fcc7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/1374937649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 msgr2=0x55924fcc6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/1374937649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924f977790 con 0x55924f8e32f0 2024-09-21T00:59:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.967+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcc5e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c6a0 tx=0x7fdc240a97b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39ff003bc0d58422 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc11ffb640 1 -- 172.21.15.47:0/1374937649 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc240ad360 con 0x55924f8e32f0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc18004c50 con 0x55924f8e32f0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc11ffb640 1 -- 172.21.15.47:0/1374937649 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fdc240acab0 con 0x55924f8e32f0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc11ffb640 1 -- 172.21.15.47:0/1374937649 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdc240b2280 con 0x55924f8e32f0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc374c2740 10 client.25133 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55924f9f0620 con 0x55924f8e32f0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.968+0000 7fdc11ffb640 1 -- 172.21.15.47:0/1374937649 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc18004c50 con 0x55924f8e32f0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.969+0000 7fdc11ffb640 1 -- 172.21.15.47:0/1374937649 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdc240e7070 con 0x55924f8e32f0 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.969+0000 7fdc374c2740 10 client.25133 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.969+0000 7fdc374c2740 10 client.25133 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.969+0000 7fdc374c2740 20 client.25133 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.969+0000 7fdc374c2740 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55924f8cad80 0x55924fcd3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.969+0000 7fdc374c2740 4 client.25133 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.969+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55924fc28640 con 0x55924f8cad80 2024-09-21T00:59:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.969+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55924f8cad80 0x55924fcd3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.970+0000 7fdc11ffb640 10 client.25133 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.970+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55924f8cad80 0x55924fcd3530 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69395d1ec540d1a server_cookie=e76aa61377d3bba6 in_seq=0 out_seq=0 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.970+0000 7fdc11ffb640 1 -- 172.21.15.47:0/1374937649 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55924fc28640 con 0x55924f8cad80 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.970+0000 7fdc11ffb640 10 client.25133 handle_command_reply: tid=0 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.970+0000 7fdc374c2740 1 client.25133 shutdown 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 msgr2=0x55924fcc5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcc5e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c6a0 tx=0x7fdc240a97b0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 shutdown_connections 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55924f8cad80 0x55924fcd3530 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc11ffb640 0 client.25133 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f90c1b0 0x55924fcc7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8eb4d0 0x55924fcc6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 --2- 172.21.15.47:0/1374937649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcc5e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 >> 172.21.15.47:0/1374937649 conn(0x55924f900300 msgr2=0x55924fcb0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 shutdown_connections 2024-09-21T00:59:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 1 -- 172.21.15.47:0/1374937649 wait complete. 2024-09-21T00:59:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:13.971+0000 7fdc374c2740 20 client.25133 trim_cache size 0 max 16384 2024-09-21T00:59:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.000+0000 7fdc374c2740 1 Processor -- start 2024-09-21T00:59:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.000+0000 7fdc374c2740 1 -- start start 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f900300 0x55924fcb20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8cad80 0x55924fcc5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8e32f0 0x55924fcbfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc374c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdc281a6c60 con 0x55924f8e32f0 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc374c2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdc281a94e0 con 0x55924f8cad80 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc374c2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc281a72d0 con 0x55924f900300 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc2e2f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f900300 0x55924fcb20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc2e2f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f900300 0x55924fcb20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:34528/0 (socket says 172.21.15.47:34528) 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/3778531545 learned_addr learned my addr 172.21.15.47:0/3778531545 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8e32f0 0x55924fcbfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8cad80 0x55924fcc5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3778531545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f900300 msgr2=0x55924fcb20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f900300 0x55924fcb20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.001+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3778531545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8e32f0 msgr2=0x55924fcbfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.002+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8e32f0 0x55924fcbfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.002+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3778531545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924fcab0a0 con 0x55924f8cad80 2024-09-21T00:59:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.002+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8e32f0 0x55924fcbfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.002+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8cad80 0x55924fcc5080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55924fcd3ca0 tx=0x7fdc180055b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db41f05b9f11fffd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.002+0000 7fdc13fff640 1 -- 172.21.15.47:0/3778531545 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18004220 con 0x55924f8cad80 2024-09-21T00:59:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.002+0000 7fdc13fff640 1 -- 172.21.15.47:0/3778531545 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc180043c0 con 0x55924f8cad80 2024-09-21T00:59:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.002+0000 7fdc13fff640 1 -- 172.21.15.47:0/3778531545 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1802e450 con 0x55924f8cad80 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 -- 172.21.15.47:0/3778531545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8cad80 msgr2=0x55924fcc5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8cad80 0x55924fcc5080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55924fcd3ca0 tx=0x7fdc180055b0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 -- 172.21.15.47:0/3778531545 shutdown_connections 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f8e32f0 0x55924fcbfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8cad80 0x55924fcc5080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3778531545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f900300 0x55924fcb20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 -- 172.21.15.47:0/3778531545 >> 172.21.15.47:0/3778531545 conn(0x55924fcd3860 msgr2=0x55924fcb19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 -- 172.21.15.47:0/3778531545 shutdown_connections 2024-09-21T00:59:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.004+0000 7fdc374c2740 1 -- 172.21.15.47:0/3778531545 wait complete. 2024-09-21T00:59:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.005+0000 7fdc374c2740 1 -- start start 2024-09-21T00:59:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.005+0000 7fdc374c2740 1 Processor -- start 2024-09-21T00:59:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.005+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8cad80 0x55924fccde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc374c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f900300 0x55924fccd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc2eaf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f900300 0x55924fccd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc2e2f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8cad80 0x55924fccde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc2e2f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8cad80 0x55924fccde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:34532/0 (socket says 172.21.15.47:34532) 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc2daf3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc2eaf5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f900300 0x55924fccd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55744/0 (socket says 172.21.15.47:55744) 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc2daf3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56002/0 (socket says 172.21.15.47:56002) 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc2e2f4640 1 -- 172.21.15.47:0/3090184121 learned_addr learned my addr 172.21.15.47:0/3090184121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdc281a79a0 con 0x55924f900300 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdc281a8e10 con 0x55924f8e32f0 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.006+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc281a8070 con 0x55924f8cad80 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3090184121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8cad80 msgr2=0x55924fccde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8cad80 0x55924fccde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3090184121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f900300 msgr2=0x55924fccd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f900300 0x55924fccd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc2daf3640 1 -- 172.21.15.47:0/3090184121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924fccb750 con 0x55924f8e32f0 2024-09-21T00:59:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc374c2740 10 client.0 _ll_register_callbacks cb 0x7fdc240a7f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc180043c0 con 0x55924f8e32f0 2024-09-21T00:59:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc2eaf5640 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f900300 0x55924fccd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc2daf3640 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcccb10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc18010ca0 tx=0x7fdc18003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7d8bd36ed8fcbf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc11ffb640 10 client.25139 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.007+0000 7fdc11ffb640 1 -- 172.21.15.47:0/3090184121 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800b710 con 0x55924f8e32f0 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc11ffb640 1 -- 172.21.15.47:0/3090184121 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fdc180035f0 con 0x55924f8e32f0 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc11ffb640 1 -- 172.21.15.47:0/3090184121 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdc18003830 con 0x55924f8e32f0 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc374c2740 10 client.25139 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55924fd3df30 con 0x55924f8e32f0 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc11ffb640 1 -- 172.21.15.47:0/3090184121 <== mon.2 v2:172.21.15.114:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdc18011720 con 0x55924f8e32f0 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc374c2740 10 client.25139 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc374c2740 10 client.25139 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc374c2740 20 client.25139 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.008+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55924f8eb4d0 0x55924fd40560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.009+0000 7fdc374c2740 4 client.25139 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.009+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55924fc240f0 con 0x55924f8eb4d0 2024-09-21T00:59:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.009+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55924f8eb4d0 0x55924fd40560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.009+0000 7fdc2e2f4640 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55924f8eb4d0 0x55924fd40560 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e14c69fd3a7b7f2 server_cookie=1bbaa6bd8747895f in_seq=0 out_seq=0 2024-09-21T00:59:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.009+0000 7fdc11ffb640 10 client.25139 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc11ffb640 1 -- 172.21.15.47:0/3090184121 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55924fc240f0 con 0x55924f8eb4d0 2024-09-21T00:59:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc11ffb640 10 client.25139 handle_command_reply: tid=0 2024-09-21T00:59:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 client.25139 shutdown 2024-09-21T00:59:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 msgr2=0x55924fcccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcccb10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc18010ca0 tx=0x7fdc18003f80 comp rx=0 tx=0).stop 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 shutdown_connections 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55924f8eb4d0 0x55924fd40560 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55924f900300 0x55924fccd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55924f8e32f0 0x55924fcccb10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 --2- 172.21.15.47:0/3090184121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55924f8cad80 0x55924fccde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 >> 172.21.15.47:0/3090184121 conn(0x55924fcd3860 msgr2=0x55924fcadea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc11ffb640 0 client.25139 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 shutdown_connections 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.017+0000 7fdc374c2740 1 -- 172.21.15.47:0/3090184121 wait complete. 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.018+0000 7fdc374c2740 20 client.25139 trim_cache size 0 max 16384 2024-09-21T00:59:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T00:59:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T00:59:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T00:59:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T00:59:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdc140b6590 msgr2=0x7fdc140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdc140b6590 0x7fdc140b8aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009c60 tx=0x7fdc200092a0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc281025a0 msgr2=0x7fdc28199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc281025a0 0x7fdc28199d60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400e9f0 tx=0x7fdc2400eeb0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 shutdown_connections 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdc140b6590 0x7fdc140b8aa0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc28103fc0 0x7fdc2819af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28103620 0x7fdc2819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 --2- 172.21.15.47:0/1513625163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc281025a0 0x7fdc28199d60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.019+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 >> 172.21.15.47:0/1513625163 conn(0x7fdc280fdee0 msgr2=0x7fdc28106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.020+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 shutdown_connections 2024-09-21T00:59:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:14.020+0000 7fdc30558640 1 -- 172.21.15.47:0/1513625163 wait complete. 2024-09-21T00:59:14.381 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:14 smithi047 ceph-mon[30960]: pgmap v361: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T00:59:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.513+0000 7f2461e56640 1 -- 172.21.15.47:0/2139207408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 msgr2=0x7f245c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.514+0000 7f2461e56640 1 --2- 172.21.15.47:0/2139207408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 0x7f245c10f560 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2454009ca0 tx=0x7f245402a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.514+0000 7f2461e56640 1 -- 172.21.15.47:0/2139207408 shutdown_connections 2024-09-21T00:59:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.514+0000 7f2461e56640 1 --2- 172.21.15.47:0/2139207408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 0x7f245c10f560 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.514+0000 7f2461e56640 1 --2- 172.21.15.47:0/2139207408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c1083e0 0x7f245c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.514+0000 7f2461e56640 1 --2- 172.21.15.47:0/2139207408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c102aa0 0x7f245c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.514+0000 7f2461e56640 1 -- 172.21.15.47:0/2139207408 >> 172.21.15.47:0/2139207408 conn(0x7f245c079750 msgr2=0x7f245c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.514+0000 7f2461e56640 1 -- 172.21.15.47:0/2139207408 shutdown_connections 2024-09-21T00:59:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.514+0000 7f2461e56640 1 -- 172.21.15.47:0/2139207408 wait complete. 2024-09-21T00:59:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.515+0000 7f2461e56640 1 Processor -- start 2024-09-21T00:59:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.515+0000 7f2461e56640 1 -- start start 2024-09-21T00:59:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.515+0000 7f2461e56640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c102aa0 0x7f245c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.515+0000 7f2461e56640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1083e0 0x7f245c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.515+0000 7f2461e56640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 0x7f245c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 0x7f245c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 0x7f245c19fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55756/0 (socket says 172.21.15.47:55756) 2024-09-21T00:59:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245bfff640 1 -- 172.21.15.47:0/2593706442 learned_addr learned my addr 172.21.15.47:0/2593706442 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f245c113b10 con 0x7f245c108d30 2024-09-21T00:59:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f245c113990 con 0x7f245c102aa0 2024-09-21T00:59:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f245c113c90 con 0x7f245c1083e0 2024-09-21T00:59:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245affd640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1083e0 0x7f245c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245b7fe640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c102aa0 0x7f245c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245b7fe640 1 -- 172.21.15.47:0/2593706442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1083e0 msgr2=0x7f245c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245b7fe640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1083e0 0x7f245c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245b7fe640 1 -- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 msgr2=0x7f245c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245b7fe640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 0x7f245c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245b7fe640 1 -- 172.21.15.47:0/2593706442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c1a01c0 con 0x7f245c102aa0 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.516+0000 7f245bfff640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 0x7f245c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.517+0000 7f245b7fe640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c102aa0 0x7f245c19a250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f244c00e9f0 tx=0x7f244c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.517+0000 7f2458ff9640 1 -- 172.21.15.47:0/2593706442 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c00ccc0 con 0x7f245c102aa0 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.517+0000 7f2458ff9640 1 -- 172.21.15.47:0/2593706442 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244c005020 con 0x7f245c102aa0 2024-09-21T00:59:14.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.517+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c1a04b0 con 0x7f245c102aa0 2024-09-21T00:59:14.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.518+0000 7f2458ff9640 1 -- 172.21.15.47:0/2593706442 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c004a00 con 0x7f245c102aa0 2024-09-21T00:59:14.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.518+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c1a6c10 con 0x7f245c102aa0 2024-09-21T00:59:14.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.521+0000 7f2458ff9640 1 -- 172.21.15.47:0/2593706442 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f244c004c20 con 0x7f245c102aa0 2024-09-21T00:59:14.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.521+0000 7f24683ca740 1 Processor -- start 2024-09-21T00:59:14.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.521+0000 7f24683ca740 1 -- start start 2024-09-21T00:59:14.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f24683ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee2002a350 0x55ee203cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f24683ca740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f24683ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f24683ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ee20347e60 con 0x55ee2002a350 2024-09-21T00:59:14.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f24683ca740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55ee20337290 con 0x55ee20001490 2024-09-21T00:59:14.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f24683ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ee2033b0a0 con 0x55ee20009670 2024-09-21T00:59:14.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f245b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f245bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee2002a350 0x55ee203cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f245b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56042/0 (socket says 172.21.15.47:56042) 2024-09-21T00:59:14.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.522+0000 7f245b7fe640 1 -- 172.21.15.47:0/2061525527 learned_addr learned my addr 172.21.15.47:0/2061525527 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:14.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.523+0000 7f245affd640 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.523+0000 7f245b7fe640 1 -- 172.21.15.47:0/2061525527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 msgr2=0x55ee203e1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.523+0000 7f245b7fe640 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.523+0000 7f245b7fe640 1 -- 172.21.15.47:0/2061525527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee2002a350 msgr2=0x55ee203cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.523+0000 7f245b7fe640 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee2002a350 0x55ee203cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.523+0000 7f245b7fe640 1 -- 172.21.15.47:0/2061525527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee20095930 con 0x55ee20001490 2024-09-21T00:59:14.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.523+0000 7f2458ff9640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b63e0 0x7f24440b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.523+0000 7f245affd640 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:14.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.524+0000 7f2458ff9640 1 -- 172.21.15.47:0/2593706442 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f244c0ea170 con 0x7f245c102aa0 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.524+0000 7f245bfff640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b63e0 0x7f24440b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.524+0000 7f245b7fe640 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203cf3d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f244c0e4370 tx=0x7f244c0eaf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ea9d90f0746da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.524+0000 7f2441ffb640 1 -- 172.21.15.47:0/2061525527 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c01c070 con 0x55ee20001490 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.524+0000 7f2441ffb640 1 -- 172.21.15.47:0/2061525527 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244c0ac5d0 con 0x55ee20001490 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.524+0000 7f2441ffb640 1 -- 172.21.15.47:0/2061525527 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0eb060 con 0x55ee20001490 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 -- 172.21.15.47:0/2061525527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 msgr2=0x55ee203cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203cf3d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f244c0e4370 tx=0x7f244c0eaf00 comp rx=0 tx=0).stop 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f245bfff640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b63e0 0x7f24440b88f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2454009a60 tx=0x7f2454009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 -- 172.21.15.47:0/2061525527 shutdown_connections 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203cf3d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 --2- 172.21.15.47:0/2061525527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee2002a350 0x55ee203cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 -- 172.21.15.47:0/2061525527 >> 172.21.15.47:0/2061525527 conn(0x55ee2001e740 msgr2=0x55ee203d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 -- 172.21.15.47:0/2061525527 shutdown_connections 2024-09-21T00:59:14.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.525+0000 7f24683ca740 1 -- 172.21.15.47:0/2061525527 wait complete. 2024-09-21T00:59:14.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.526+0000 7f24683ca740 1 -- start start 2024-09-21T00:59:14.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.526+0000 7f24683ca740 1 Processor -- start 2024-09-21T00:59:14.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f24683ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f24683ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f24683ca740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee2002a350 0x55ee203eb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f24683ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ee20198890 con 0x55ee20001490 2024-09-21T00:59:14.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f24683ca740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55ee202d1d40 con 0x55ee2002a350 2024-09-21T00:59:14.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f24683ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ee203e2240 con 0x55ee20009670 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f24683ca740 10 client.0 _ll_register_callbacks cb 0x55ee20335c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f245b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f245b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55772/0 (socket says 172.21.15.47:55772) 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f245b7fe640 1 -- 172.21.15.47:0/3812437832 learned_addr learned my addr 172.21.15.47:0/3812437832 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f245bfff640 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee2002a350 0x55ee203eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f245affd640 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f245b7fe640 1 -- 172.21.15.47:0/3812437832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 msgr2=0x55ee203e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.527+0000 7f245b7fe640 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.528+0000 7f245b7fe640 1 -- 172.21.15.47:0/3812437832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee2002a350 msgr2=0x55ee203eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.528+0000 7f245b7fe640 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee2002a350 0x55ee203eb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.528+0000 7f245b7fe640 1 -- 172.21.15.47:0/3812437832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee203eb9b0 con 0x55ee20001490 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.528+0000 7f245b7fe640 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e5d40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f244c009230 tx=0x7f244c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9869d9cdb90fc76e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.528+0000 7f243affd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.528+0000 7f243affd640 1 -- 172.21.15.47:0/3812437832 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c01c070 con 0x55ee20001490 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.528+0000 7f243affd640 1 -- 172.21.15.47:0/3812437832 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f244c0054f0 con 0x55ee20001490 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.528+0000 7f24683ca740 1 -- 172.21.15.47:0/3812437832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f244c0ac5d0 con 0x55ee20001490 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f243affd640 1 -- 172.21.15.47:0/3812437832 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f244c0ac890 con 0x55ee20001490 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f24683ca740 10 client.15426 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f24683ca740 1 -- 172.21.15.47:0/3812437832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ee203f43c0 con 0x55ee20001490 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f243affd640 1 -- 172.21.15.47:0/3812437832 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244c0ac5d0 con 0x55ee20001490 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f243affd640 1 -- 172.21.15.47:0/3812437832 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f244c0b6050 con 0x55ee20001490 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f24683ca740 10 client.15426 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f24683ca740 10 client.15426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f24683ca740 20 client.15426 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f24683ca740 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ee1ffe8cd0 0x55ee203f7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f24683ca740 4 client.15426 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:14.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.529+0000 7f24683ca740 1 -- 172.21.15.47:0/3812437832 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee20349db0 con 0x55ee1ffe8cd0 2024-09-21T00:59:14.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.530+0000 7f245affd640 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ee1ffe8cd0 0x55ee203f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.531+0000 7f245affd640 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ee1ffe8cd0 0x55ee203f7720 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe6539b955f6ea8 server_cookie=f004c66152e90505 in_seq=0 out_seq=0 2024-09-21T00:59:14.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.531+0000 7f243affd640 10 client.15426 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:14.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f243affd640 1 -- 172.21.15.47:0/3812437832 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee20349db0 con 0x55ee1ffe8cd0 2024-09-21T00:59:14.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f243affd640 10 client.15426 handle_command_reply: tid=0 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 client.15426 shutdown 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 -- 172.21.15.47:0/3812437832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 msgr2=0x55ee203e5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e5d40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f244c009230 tx=0x7f244c00c840 comp rx=0 tx=0).stop 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 -- 172.21.15.47:0/3812437832 shutdown_connections 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ee1ffe8cd0 0x55ee203f7720 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee2002a350 0x55ee203eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee203e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f243affd640 0 client.15426 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 --2- 172.21.15.47:0/3812437832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e5d40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 -- 172.21.15.47:0/3812437832 >> 172.21.15.47:0/3812437832 conn(0x55ee2001e740 msgr2=0x55ee203ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 -- 172.21.15.47:0/3812437832 shutdown_connections 2024-09-21T00:59:14.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.532+0000 7f24683ca740 1 -- 172.21.15.47:0/3812437832 wait complete. 2024-09-21T00:59:14.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.533+0000 7f24683ca740 20 client.15426 trim_cache size 0 max 16384 2024-09-21T00:59:14.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.568+0000 7f24683ca740 1 Processor -- start 2024-09-21T00:59:14.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.568+0000 7f24683ca740 1 -- start start 2024-09-21T00:59:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f24683ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee1ffe8cd0 0x55ee203e3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f24683ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f24683ca740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20009670 0x55ee203e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f24683ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1aaf10 con 0x55ee20001490 2024-09-21T00:59:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f24683ca740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1ad770 con 0x55ee20009670 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f24683ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1ab560 con 0x55ee1ffe8cd0 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55778/0 (socket says 172.21.15.47:55778) 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245affd640 1 -- 172.21.15.47:0/2326781659 learned_addr learned my addr 172.21.15.47:0/2326781659 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245b7fe640 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee1ffe8cd0 0x55ee203e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245bfff640 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20009670 0x55ee203e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245affd640 1 -- 172.21.15.47:0/2326781659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee1ffe8cd0 msgr2=0x55ee203e3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245affd640 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee1ffe8cd0 0x55ee203e3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245affd640 1 -- 172.21.15.47:0/2326781659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20009670 msgr2=0x55ee203e0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245affd640 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20009670 0x55ee203e0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.569+0000 7f245affd640 1 -- 172.21.15.47:0/2326781659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee203cfc40 con 0x55ee20001490 2024-09-21T00:59:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.570+0000 7f245affd640 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e0590 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f245c06ab20 tx=0x7f2450013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e719fe3f1c21e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.570+0000 7f24417fa640 1 -- 172.21.15.47:0/2326781659 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450009dc0 con 0x55ee20001490 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.570+0000 7f24417fa640 1 -- 172.21.15.47:0/2326781659 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2450013110 con 0x55ee20001490 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.570+0000 7f24417fa640 1 -- 172.21.15.47:0/2326781659 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450003e50 con 0x55ee20001490 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 -- 172.21.15.47:0/2326781659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 msgr2=0x55ee203e0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e0590 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f245c06ab20 tx=0x7f2450013830 comp rx=0 tx=0).stop 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 -- 172.21.15.47:0/2326781659 shutdown_connections 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20009670 0x55ee203e0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee20001490 0x55ee203e0590 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 --2- 172.21.15.47:0/2326781659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee1ffe8cd0 0x55ee203e3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 -- 172.21.15.47:0/2326781659 >> 172.21.15.47:0/2326781659 conn(0x55ee2001e740 msgr2=0x55ee203cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 -- 172.21.15.47:0/2326781659 shutdown_connections 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.571+0000 7f24683ca740 1 -- 172.21.15.47:0/2326781659 wait complete. 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.572+0000 7f24683ca740 1 -- start start 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.572+0000 7f24683ca740 1 Processor -- start 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.572+0000 7f24683ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee1ffe8cd0 0x55ee203f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.572+0000 7f24683ca740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f24683ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee2045b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f24683ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1abc30 con 0x55ee1ffe8cd0 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f24683ca740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1ad0a0 con 0x55ee20001490 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f24683ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f245c1ac300 con 0x55ee20009670 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f24683ca740 10 client.0 _ll_register_callbacks cb 0x7f244c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:14.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203f0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56070/0 (socket says 172.21.15.47:56070) 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245affd640 1 -- 172.21.15.47:0/3371840769 learned_addr learned my addr 172.21.15.47:0/3371840769 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245b7fe640 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee1ffe8cd0 0x55ee203f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245bfff640 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee2045b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245affd640 1 -- 172.21.15.47:0/3371840769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 msgr2=0x55ee2045b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245affd640 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee2045b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245affd640 1 -- 172.21.15.47:0/3371840769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee1ffe8cd0 msgr2=0x55ee203f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245affd640 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee1ffe8cd0 0x55ee203f05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245affd640 1 -- 172.21.15.47:0/3371840769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2045b710 con 0x55ee20001490 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.573+0000 7f245b7fe640 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee1ffe8cd0 0x55ee203f05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.574+0000 7f245affd640 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203f0bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2450003a30 tx=0x7f24500133b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6631b8d0fc279be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.574+0000 7f243affd640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.574+0000 7f243affd640 1 -- 172.21.15.47:0/3371840769 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450003d90 con 0x55ee20001490 2024-09-21T00:59:14.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.574+0000 7f243affd640 1 -- 172.21.15.47:0/3371840769 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f2450004050 con 0x55ee20001490 2024-09-21T00:59:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.574+0000 7f24683ca740 1 -- 172.21.15.47:0/3371840769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2450013110 con 0x55ee20001490 2024-09-21T00:59:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.574+0000 7f243affd640 1 -- 172.21.15.47:0/3371840769 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2450034050 con 0x55ee20001490 2024-09-21T00:59:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.574+0000 7f24683ca740 10 client.25157 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.574+0000 7f24683ca740 1 -- 172.21.15.47:0/3371840769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ee20462b70 con 0x55ee20001490 2024-09-21T00:59:14.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.575+0000 7f243affd640 1 -- 172.21.15.47:0/3371840769 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24500054e0 con 0x55ee20001490 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.576+0000 7f243affd640 1 -- 172.21.15.47:0/3371840769 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2450004930 con 0x55ee20001490 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.576+0000 7f24683ca740 10 client.25157 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.576+0000 7f24683ca740 10 client.25157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.576+0000 7f24683ca740 20 client.25157 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.576+0000 7f24683ca740 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ee2002a350 0x55ee20465300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.576+0000 7f24683ca740 4 client.25157 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.576+0000 7f24683ca740 1 -- 172.21.15.47:0/3371840769 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f2450013110 con 0x55ee2002a350 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.576+0000 7f245b7fe640 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ee2002a350 0x55ee20465300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.577+0000 7f243affd640 10 client.25157 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:14.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.577+0000 7f245b7fe640 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ee2002a350 0x55ee20465300 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8165122e9f875d36 server_cookie=d256610800a28c8e in_seq=0 out_seq=0 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.578+0000 7f243affd640 1 -- 172.21.15.47:0/3371840769 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f2450013110 con 0x55ee2002a350 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.578+0000 7f243affd640 10 client.25157 handle_command_reply: tid=0 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.578+0000 7f24683ca740 1 client.25157 shutdown 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 -- 172.21.15.47:0/3371840769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 msgr2=0x55ee203f0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203f0bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2450003a30 tx=0x7f24500133b0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 -- 172.21.15.47:0/3371840769 shutdown_connections 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ee2002a350 0x55ee20465300 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ee20009670 0x55ee2045b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f243affd640 0 client.25157 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ee20001490 0x55ee203f0bc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 --2- 172.21.15.47:0/3371840769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ee1ffe8cd0 0x55ee203f05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 -- 172.21.15.47:0/3371840769 >> 172.21.15.47:0/3371840769 conn(0x55ee2001e740 msgr2=0x55ee203cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 -- 172.21.15.47:0/3371840769 shutdown_connections 2024-09-21T00:59:14.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.579+0000 7f24683ca740 1 -- 172.21.15.47:0/3371840769 wait complete. 2024-09-21T00:59:14.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.580+0000 7f24683ca740 20 client.25157 trim_cache size 0 max 16384 2024-09-21T00:59:14.583 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:59:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-09-21T00:59:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "3d075403-3cfd-47a8-ab47-0d01b5c16c0a", 2024-09-21T00:59:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-09-21T00:59:14.583 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:59:14.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.580+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b63e0 msgr2=0x7f24440b88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.580+0000 7f2461e56640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b63e0 0x7f24440b88f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2454009a60 tx=0x7f2454009800 comp rx=0 tx=0).stop 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.580+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c102aa0 msgr2=0x7f245c19a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.580+0000 7f2461e56640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c102aa0 0x7f245c19a250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f244c00e9f0 tx=0x7f244c00eeb0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.581+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 shutdown_connections 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.581+0000 7f2461e56640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f24440b63e0 0x7f24440b88f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.581+0000 7f2461e56640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f245c108d30 0x7f245c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.581+0000 7f2461e56640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f245c1083e0 0x7f245c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.581+0000 7f2461e56640 1 --2- 172.21.15.47:0/2593706442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c102aa0 0x7f245c19a250 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.581+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 >> 172.21.15.47:0/2593706442 conn(0x7f245c079750 msgr2=0x7f245c1061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.581+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 shutdown_connections 2024-09-21T00:59:14.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:14.581+0000 7f2461e56640 1 -- 172.21.15.47:0/2593706442 wait complete. 2024-09-21T00:59:14.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:14 smithi114 ceph-mon[34309]: pgmap v361: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T00:59:14.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:14 smithi134 ceph-mon[34785]: pgmap v361: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T00:59:15.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:59:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:16.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 -- 172.21.15.47:0/1926011912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda90105270 msgr2=0x7fda9010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 --2- 172.21.15.47:0/1926011912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda90105270 0x7fda9010d8b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fda80009900 tx=0x7fda8002a410 comp rx=0 tx=0).stop 2024-09-21T00:59:16.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 -- 172.21.15.47:0/1926011912 shutdown_connections 2024-09-21T00:59:16.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 --2- 172.21.15.47:0/1926011912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda9010ddf0 0x7fda90110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 --2- 172.21.15.47:0/1926011912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda90105270 0x7fda9010d8b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 --2- 172.21.15.47:0/1926011912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda90104840 0x7fda90104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 -- 172.21.15.47:0/1926011912 >> 172.21.15.47:0/1926011912 conn(0x7fda90079730 msgr2=0x7fda90079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:16.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 -- 172.21.15.47:0/1926011912 shutdown_connections 2024-09-21T00:59:16.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.206+0000 7fda97a50640 1 -- 172.21.15.47:0/1926011912 wait complete. 2024-09-21T00:59:16.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.207+0000 7fda97a50640 1 Processor -- start 2024-09-21T00:59:16.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.207+0000 7fda97a50640 1 -- start start 2024-09-21T00:59:16.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.208+0000 7fda97a50640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda90104840 0x7fda9019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.208+0000 7fda97a50640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda90105270 0x7fda9019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.208+0000 7fda97a50640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda9010ddf0 0x7fda9019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.208+0000 7fda97a50640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fda90113af0 con 0x7fda9010ddf0 2024-09-21T00:59:16.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.208+0000 7fda97a50640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda90113970 con 0x7fda90105270 2024-09-21T00:59:16.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.208+0000 7fda97a50640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda90113c70 con 0x7fda90104840 2024-09-21T00:59:16.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.208+0000 7fda95fed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda9010ddf0 0x7fda9019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda95fed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda9010ddf0 0x7fda9019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55786/0 (socket says 172.21.15.47:55786) 2024-09-21T00:59:16.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda95fed640 1 -- 172.21.15.47:0/2209749361 learned_addr learned my addr 172.21.15.47:0/2209749361 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda94feb640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda90105270 0x7fda9019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda957ec640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda90104840 0x7fda9019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda95fed640 1 -- 172.21.15.47:0/2209749361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda90104840 msgr2=0x7fda9019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda95fed640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda90104840 0x7fda9019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda95fed640 1 -- 172.21.15.47:0/2209749361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda90105270 msgr2=0x7fda9019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda95fed640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda90105270 0x7fda9019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda95fed640 1 -- 172.21.15.47:0/2209749361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda901a04d0 con 0x7fda9010ddf0 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.209+0000 7fda95fed640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda9010ddf0 0x7fda9019fda0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fda8800eb10 tx=0x7fda8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.210+0000 7fda867fc640 1 -- 172.21.15.47:0/2209749361 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88004b20 con 0x7fda9010ddf0 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.210+0000 7fda867fc640 1 -- 172.21.15.47:0/2209749361 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda88004cc0 con 0x7fda9010ddf0 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.210+0000 7fda867fc640 1 -- 172.21.15.47:0/2209749361 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88010670 con 0x7fda9010ddf0 2024-09-21T00:59:16.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.210+0000 7fda97a50640 1 -- 172.21.15.47:0/2209749361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda901a07c0 con 0x7fda9010ddf0 2024-09-21T00:59:16.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.210+0000 7fda97a50640 1 -- 172.21.15.47:0/2209749361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda90102630 con 0x7fda9010ddf0 2024-09-21T00:59:16.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.214+0000 7fda9dfc4740 1 Processor -- start 2024-09-21T00:59:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.215+0000 7fda867fc640 1 -- 172.21.15.47:0/2209749361 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fda88005020 con 0x7fda9010ddf0 2024-09-21T00:59:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.215+0000 7fda9dfc4740 1 -- start start 2024-09-21T00:59:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2e9d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2e9db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2e9e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5588c2e13e50 con 0x5588c2ad5390 2024-09-21T00:59:16.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5588c2e03280 con 0x5588c2af6070 2024-09-21T00:59:16.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5588c2e07090 con 0x5588c2acd1b0 2024-09-21T00:59:16.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda94feb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2e9e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda94feb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2e9e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55790/0 (socket says 172.21.15.47:55790) 2024-09-21T00:59:16.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda94feb640 1 -- 172.21.15.47:0/587929668 learned_addr learned my addr 172.21.15.47:0/587929668 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda94feb640 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2e9d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.216+0000 7fda957ec640 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2e9db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda94feb640 1 -- 172.21.15.47:0/587929668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 msgr2=0x5588c2e9db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda94feb640 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2e9db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda94feb640 1 -- 172.21.15.47:0/587929668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 msgr2=0x5588c2e9d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda94feb640 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2e9d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda94feb640 1 -- 172.21.15.47:0/587929668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588c2b61650 con 0x5588c2ad5390 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda867fc640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fda7c0c7670 0x7fda7c0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda94feb640 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2e9e0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fda80032fd0 tx=0x7fda80000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a38c15d1f8d9ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda957ec640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fda7c0c7670 0x7fda7c0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda867fc640 1 -- 172.21.15.47:0/2209749361 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fda880e77b0 con 0x7fda9010ddf0 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda7b7fe640 1 -- 172.21.15.47:0/587929668 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80035070 con 0x5588c2ad5390 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda7b7fe640 1 -- 172.21.15.47:0/587929668 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda80005030 con 0x5588c2ad5390 2024-09-21T00:59:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.217+0000 7fda7b7fe640 1 -- 172.21.15.47:0/587929668 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80035070 con 0x5588c2ad5390 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda957ec640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fda7c0c7670 0x7fda7c0c9b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5588c2e9c2d0 tx=0x7fda8c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 -- 172.21.15.47:0/587929668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 msgr2=0x5588c2e9e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2e9e0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fda80032fd0 tx=0x7fda80000bc0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 -- 172.21.15.47:0/587929668 shutdown_connections 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2e9e0d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2e9db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/587929668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2e9d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 -- 172.21.15.47:0/587929668 >> 172.21.15.47:0/587929668 conn(0x5588c2aea460 msgr2=0x5588c2e9b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 -- 172.21.15.47:0/587929668 shutdown_connections 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 -- 172.21.15.47:0/587929668 wait complete. 2024-09-21T00:59:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 -- start start 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.219+0000 7fda9dfc4740 1 Processor -- start 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2ea8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2ea9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2eb50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5588c2c64700 con 0x5588c2acd1b0 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5588c2d9e110 con 0x5588c2af6070 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5588c2eabdd0 con 0x5588c2ad5390 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda9dfc4740 10 client.0 _ll_register_callbacks cb 0x5588c2db7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda957ec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2ea8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda957ec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2ea8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55794/0 (socket says 172.21.15.47:55794) 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda957ec640 1 -- 172.21.15.47:0/3178805355 learned_addr learned my addr 172.21.15.47:0/3178805355 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:16.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.220+0000 7fda94feb640 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2ea9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda95fed640 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2eb50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda94feb640 1 -- 172.21.15.47:0/3178805355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 msgr2=0x5588c2eb50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda94feb640 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2eb50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda94feb640 1 -- 172.21.15.47:0/3178805355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 msgr2=0x5588c2ea8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda94feb640 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2ea8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda94feb640 1 -- 172.21.15.47:0/3178805355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588c2dcbc40 con 0x5588c2ad5390 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda957ec640 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2ea8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda94feb640 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2ea9230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda8002a930 tx=0x7fda80031530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9911f8ef7196ec49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda78ff9640 1 -- 172.21.15.47:0/3178805355 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80035070 con 0x5588c2ad5390 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda9dfc4740 1 -- 172.21.15.47:0/3178805355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda80005030 con 0x5588c2ad5390 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.221+0000 7fda78ff9640 1 -- 172.21.15.47:0/3178805355 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fda80005530 con 0x5588c2ad5390 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.222+0000 7fda78ff9640 1 -- 172.21.15.47:0/3178805355 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fda80004750 con 0x5588c2ad5390 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.222+0000 7fda9dfc4740 10 client.25165 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.222+0000 7fda9dfc4740 1 -- 172.21.15.47:0/3178805355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5588c2ec8ad0 con 0x5588c2ad5390 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.222+0000 7fda78ff9640 1 -- 172.21.15.47:0/3178805355 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda80005030 con 0x5588c2ad5390 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.223+0000 7fda78ff9640 1 -- 172.21.15.47:0/3178805355 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fda8003dac0 con 0x5588c2ad5390 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.223+0000 7fda9dfc4740 10 client.25165 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.223+0000 7fda9dfc4740 10 client.25165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:16.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.223+0000 7fda9dfc4740 20 client.25165 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:16.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.223+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5588c2ab49f0 0x5588c2ecbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.223+0000 7fda9dfc4740 4 client.25165 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:16.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.223+0000 7fda9dfc4740 1 -- 172.21.15.47:0/3178805355 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588c2e15da0 con 0x5588c2ab49f0 2024-09-21T00:59:16.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.223+0000 7fda957ec640 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5588c2ab49f0 0x5588c2ecbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.224+0000 7fda957ec640 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5588c2ab49f0 0x5588c2ecbe30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6c4fe298304f6b server_cookie=b3a69c523029eb2b in_seq=0 out_seq=0 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.224+0000 7fda78ff9640 10 client.25165 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.224+0000 7fda78ff9640 1 -- 172.21.15.47:0/3178805355 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588c2e15da0 con 0x5588c2ab49f0 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.224+0000 7fda78ff9640 10 client.25165 handle_command_reply: tid=0 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.224+0000 7fda9dfc4740 1 client.25165 shutdown 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 -- 172.21.15.47:0/3178805355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 msgr2=0x5588c2ea9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2ea9230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda8002a930 tx=0x7fda80031530 comp rx=0 tx=0).stop 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 -- 172.21.15.47:0/3178805355 shutdown_connections 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5588c2ab49f0 0x5588c2ecbe30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2eb50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2ea9230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/3178805355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2ea8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda78ff9640 0 client.25165 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:16.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 -- 172.21.15.47:0/3178805355 >> 172.21.15.47:0/3178805355 conn(0x5588c2aea460 msgr2=0x5588c2ea0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:16.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 -- 172.21.15.47:0/3178805355 shutdown_connections 2024-09-21T00:59:16.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 1 -- 172.21.15.47:0/3178805355 wait complete. 2024-09-21T00:59:16.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.225+0000 7fda9dfc4740 20 client.25165 trim_cache size 0 max 16384 2024-09-21T00:59:16.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda9dfc4740 1 Processor -- start 2024-09-21T00:59:16.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda9dfc4740 1 -- start start 2024-09-21T00:59:16.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2eb5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2e9f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2eaa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fda90071070 con 0x5588c2acd1b0 2024-09-21T00:59:16.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda900738f0 con 0x5588c2af6070 2024-09-21T00:59:16.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda900716e0 con 0x5588c2ad5390 2024-09-21T00:59:16.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda957ec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2eb5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda957ec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2eb5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55796/0 (socket says 172.21.15.47:55796) 2024-09-21T00:59:16.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.260+0000 7fda957ec640 1 -- 172.21.15.47:0/4136998503 learned_addr learned my addr 172.21.15.47:0/4136998503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda95fed640 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2eaa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda94feb640 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2e9f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda957ec640 1 -- 172.21.15.47:0/4136998503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 msgr2=0x5588c2e9f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda957ec640 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2e9f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda957ec640 1 -- 172.21.15.47:0/4136998503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 msgr2=0x5588c2eaa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda957ec640 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2eaa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda957ec640 1 -- 172.21.15.47:0/4136998503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588c2ea9d90 con 0x5588c2acd1b0 2024-09-21T00:59:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda957ec640 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2eb5030 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5588c2e9bfa0 tx=0x7fda8c009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7202e86e71f510e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda7affd640 1 -- 172.21.15.47:0/4136998503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c025730 con 0x5588c2acd1b0 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda7affd640 1 -- 172.21.15.47:0/4136998503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda8c025d80 con 0x5588c2acd1b0 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.261+0000 7fda7affd640 1 -- 172.21.15.47:0/4136998503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c018e60 con 0x5588c2acd1b0 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.262+0000 7fda9dfc4740 1 -- 172.21.15.47:0/4136998503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 msgr2=0x5588c2eb5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.262+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2eb5030 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5588c2e9bfa0 tx=0x7fda8c009070 comp rx=0 tx=0).stop 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.262+0000 7fda9dfc4740 1 -- 172.21.15.47:0/4136998503 shutdown_connections 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.262+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2eaa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.262+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2ad5390 0x5588c2e9f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.262+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/4136998503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2acd1b0 0x5588c2eb5030 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.262+0000 7fda9dfc4740 1 -- 172.21.15.47:0/4136998503 >> 172.21.15.47:0/4136998503 conn(0x5588c2aea460 msgr2=0x5588c2eaa210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.263+0000 7fda9dfc4740 1 -- 172.21.15.47:0/4136998503 shutdown_connections 2024-09-21T00:59:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.263+0000 7fda9dfc4740 1 -- 172.21.15.47:0/4136998503 wait complete. 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.263+0000 7fda9dfc4740 1 -- start start 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.263+0000 7fda9dfc4740 1 Processor -- start 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2ecf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2eccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda9dfc4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2ecd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda94feb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2eccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda957ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2ecf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fda90071db0 con 0x5588c2ad5390 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda94feb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2eccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55810/0 (socket says 172.21.15.47:55810) 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda9dfc4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda90073220 con 0x5588c2af6070 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda94feb640 1 -- 172.21.15.47:0/2637932004 learned_addr learned my addr 172.21.15.47:0/2637932004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda957ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2ecf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:34624/0 (socket says 172.21.15.47:34624) 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda90072480 con 0x5588c2acd1b0 2024-09-21T00:59:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda9dfc4740 10 client.0 _ll_register_callbacks cb 0x7fda80032d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:16.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.264+0000 7fda95fed640 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2ecd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda957ec640 1 -- 172.21.15.47:0/2637932004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 msgr2=0x5588c2ecd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:16.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda957ec640 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2ecd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda957ec640 1 -- 172.21.15.47:0/2637932004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 msgr2=0x5588c2eccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda957ec640 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2eccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda957ec640 1 -- 172.21.15.47:0/2637932004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588c2ecda10 con 0x5588c2acd1b0 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda94feb640 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2eccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda957ec640 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2ecf760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x5588c2e9bfa0 tx=0x7fda8c0047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64395e0c53b70284 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda78ff9640 1 -- 172.21.15.47:0/2637932004 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c03b060 con 0x5588c2acd1b0 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda78ff9640 1 -- 172.21.15.47:0/2637932004 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fda8c0185f0 con 0x5588c2acd1b0 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.265+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda8c025d80 con 0x5588c2acd1b0 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda78ff9640 1 -- 172.21.15.47:0/2637932004 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fda8c0187f0 con 0x5588c2acd1b0 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda9dfc4740 10 client.25171 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:16.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5588c2f365d0 con 0x5588c2acd1b0 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda78ff9640 1 -- 172.21.15.47:0/2637932004 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda8c025d80 con 0x5588c2acd1b0 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda78ff9640 1 -- 172.21.15.47:0/2637932004 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fda8c040070 con 0x5588c2acd1b0 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda9dfc4740 10 client.25171 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda9dfc4740 10 client.25171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda9dfc4740 20 client.25171 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5588c2a89da0 0x5588c2f38cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda9dfc4740 4 client.25171 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.266+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5588c2e11850 con 0x5588c2a89da0 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.267+0000 7fda94feb640 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5588c2a89da0 0x5588c2f38cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.268+0000 7fda94feb640 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5588c2a89da0 0x5588c2f38cb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f3f8cc3ad68755e server_cookie=27d0cf335c65b72 in_seq=0 out_seq=0 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.268+0000 7fda78ff9640 10 client.25171 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.268+0000 7fda78ff9640 1 -- 172.21.15.47:0/2637932004 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x5588c2e11850 con 0x5588c2a89da0 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.268+0000 7fda78ff9640 10 client.25171 handle_command_reply: tid=0 2024-09-21T00:59:16.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.268+0000 7fda9dfc4740 1 client.25171 shutdown 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.268+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 msgr2=0x5588c2ecf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.268+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2ecf760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x5588c2e9bfa0 tx=0x7fda8c0047d0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 shutdown_connections 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5588c2a89da0 0x5588c2f38cb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588c2af6070 0x5588c2ecd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5588c2ad5390 0x5588c2eccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 1 --2- 172.21.15.47:0/2637932004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5588c2acd1b0 0x5588c2ecf760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 >> 172.21.15.47:0/2637932004 conn(0x5588c2aea460 msgr2=0x5588c2e9edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:16.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda78ff9640 0 client.25171 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 shutdown_connections 2024-09-21T00:59:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 1 -- 172.21.15.47:0/2637932004 wait complete. 2024-09-21T00:59:16.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.269+0000 7fda9dfc4740 20 client.25171 trim_cache size 0 max 16384 2024-09-21T00:59:16.273 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:59:16.273 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "3d075403-3cfd-47a8-ab47-0d01b5c16c0a", 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:59:16.274 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:16.275 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:59:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 -- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fda7c0c7670 msgr2=0x7fda7c0c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fda7c0c7670 0x7fda7c0c9b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5588c2e9c2d0 tx=0x7fda8c005a20 comp rx=0 tx=0).stop 2024-09-21T00:59:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 -- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda9010ddf0 msgr2=0x7fda9019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda9010ddf0 0x7fda9019fda0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fda8800eb10 tx=0x7fda8800c2d0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 -- 172.21.15.47:0/2209749361 shutdown_connections 2024-09-21T00:59:16.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fda7c0c7670 0x7fda7c0c9b80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda9010ddf0 0x7fda9019fda0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda90105270 0x7fda9019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 --2- 172.21.15.47:0/2209749361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda90104840 0x7fda9019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.270+0000 7fda97a50640 1 -- 172.21.15.47:0/2209749361 >> 172.21.15.47:0/2209749361 conn(0x7fda90079730 msgr2=0x7fda900ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.271+0000 7fda97a50640 1 -- 172.21.15.47:0/2209749361 shutdown_connections 2024-09-21T00:59:16.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:16.271+0000 7fda97a50640 1 -- 172.21.15.47:0/2209749361 wait complete. 2024-09-21T00:59:16.373 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:16 smithi047 ceph-mon[30960]: scrub queued for path: / 2024-09-21T00:59:16.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:16 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:16.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:16 smithi047 ceph-mon[30960]: scrub summary: active paths [/] 2024-09-21T00:59:16.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:16 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:16.374 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:16 smithi047 ceph-mon[30960]: pgmap v362: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 1 op/s 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:16 smithi114 ceph-mon[34309]: scrub queued for path: / 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:16 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:16 smithi114 ceph-mon[34309]: scrub summary: active paths [/] 2024-09-21T00:59:16.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:16 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:16.660 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:16 smithi114 ceph-mon[34309]: pgmap v362: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 1 op/s 2024-09-21T00:59:16.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:16 smithi134 ceph-mon[34785]: scrub queued for path: / 2024-09-21T00:59:16.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:16 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:16.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:16 smithi134 ceph-mon[34785]: scrub summary: active paths [/] 2024-09-21T00:59:16.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:16 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:16.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:16 smithi134 ceph-mon[34785]: pgmap v362: 97 pgs: 97 active+clean; 666 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 1 op/s 2024-09-21T00:59:17.062 INFO:tasks.cephfs.filesystem:scrub status for tag:3d075403-3cfd-47a8-ab47-0d01b5c16c0a - {'path': '/', 'tag': '3d075403-3cfd-47a8-ab47-0d01b5c16c0a', 'options': 'recursive,force'} 2024-09-21T00:59:18.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:18 smithi114 ceph-mon[34309]: pgmap v363: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T00:59:18.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:18 smithi047 ceph-mon[30960]: pgmap v363: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T00:59:18.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:18 smithi134 ceph-mon[34785]: pgmap v363: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T00:59:20.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:20 smithi114 ceph-mon[34309]: pgmap v364: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T00:59:20.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:20 smithi114 ceph-mon[34309]: scrub summary: idle 2024-09-21T00:59:20.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:20 smithi047 ceph-mon[30960]: pgmap v364: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T00:59:20.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:20 smithi047 ceph-mon[30960]: scrub summary: idle 2024-09-21T00:59:20.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:20 smithi134 ceph-mon[34785]: pgmap v364: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T00:59:20.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:20 smithi134 ceph-mon[34785]: scrub summary: idle 2024-09-21T00:59:22.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:22 smithi114 ceph-mon[34309]: pgmap v365: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T00:59:22.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:22 smithi047 ceph-mon[30960]: pgmap v365: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T00:59:22.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:22 smithi134 ceph-mon[34785]: pgmap v365: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T00:59:24.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:24 smithi114 ceph-mon[34309]: pgmap v366: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T00:59:24.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:24 smithi047 ceph-mon[30960]: pgmap v366: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T00:59:24.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:24 smithi134 ceph-mon[34785]: pgmap v366: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T00:59:26.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:26 smithi114 ceph-mon[34309]: pgmap v367: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T00:59:26.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:26 smithi047 ceph-mon[30960]: pgmap v367: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T00:59:26.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:26 smithi134 ceph-mon[34785]: pgmap v367: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T00:59:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2223802889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b41025c0 msgr2=0x7f61b4102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2223802889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b41025c0 0x7f61b4102a30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009900 tx=0x7f61a402a410 comp rx=0 tx=0).stop 2024-09-21T00:59:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2223802889 shutdown_connections 2024-09-21T00:59:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2223802889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b4103fe0 0x7f61b410a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2223802889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b4103640 0x7f61b4103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2223802889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b41025c0 0x7f61b4102a30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2223802889 >> 172.21.15.47:0/2223802889 conn(0x7f61b40fdf00 msgr2=0x7f61b41003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2223802889 shutdown_connections 2024-09-21T00:59:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.169+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2223802889 wait complete. 2024-09-21T00:59:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.170+0000 7f61b8ccc640 1 Processor -- start 2024-09-21T00:59:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.170+0000 7f61b8ccc640 1 -- start start 2024-09-21T00:59:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b8ccc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b41025c0 0x7f61b4197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b8ccc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b4103640 0x7f61b41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b8ccc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b4103fe0 0x7f61b4198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b8ccc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f61b410d140 con 0x7f61b4103fe0 2024-09-21T00:59:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b8ccc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f61b410cfc0 con 0x7f61b4103640 2024-09-21T00:59:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b8ccc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61b410d2c0 con 0x7f61b41025c0 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b4103640 0x7f61b41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b4103640 0x7f61b41983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:39308/0 (socket says 172.21.15.47:39308) 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b1d9b640 1 -- 172.21.15.47:0/2521735820 learned_addr learned my addr 172.21.15.47:0/2521735820 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b259c640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b41025c0 0x7f61b4197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b4103fe0 0x7f61b4198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b1d9b640 1 -- 172.21.15.47:0/2521735820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b41025c0 msgr2=0x7f61b4197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.171+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b41025c0 0x7f61b4197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61b1d9b640 1 -- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b4103fe0 msgr2=0x7f61b4198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b4103fe0 0x7f61b4198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61b1d9b640 1 -- 172.21.15.47:0/2521735820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b41997c0 con 0x7f61b4103640 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b4103640 0x7f61b41983f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009be0 tx=0x7f61a80071c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61a37fe640 1 -- 172.21.15.47:0/2521735820 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8007e00 con 0x7f61b4103640 2024-09-21T00:59:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61a37fe640 1 -- 172.21.15.47:0/2521735820 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a801e070 con 0x7f61b4103640 2024-09-21T00:59:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2521735820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b4199ab0 con 0x7f61b4103640 2024-09-21T00:59:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61a37fe640 1 -- 172.21.15.47:0/2521735820 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8018730 con 0x7f61b4103640 2024-09-21T00:59:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.172+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2521735820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b41a01a0 con 0x7f61b4103640 2024-09-21T00:59:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.176+0000 7f61bfc38740 1 Processor -- start 2024-09-21T00:59:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.176+0000 7f61bfc38740 1 -- start start 2024-09-21T00:59:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.176+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab1ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.176+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 0x55841ab1b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.176+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7524d0 0x55841ab1c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.176+0000 7f61bfc38740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55841aa8d6f0 con 0x55841a7524d0 2024-09-21T00:59:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.176+0000 7f61bfc38740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55841aa7cb20 con 0x55841a7731b0 2024-09-21T00:59:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.176+0000 7f61bfc38740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55841aa80930 con 0x55841a74a2f0 2024-09-21T00:59:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.177+0000 7f61a37fe640 1 -- 172.21.15.47:0/2521735820 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f61a80188d0 con 0x7f61b4103640 2024-09-21T00:59:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.177+0000 7f61b2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab1ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.177+0000 7f61b2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab1ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:39318/0 (socket says 172.21.15.47:39318) 2024-09-21T00:59:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.177+0000 7f61b2d9d640 1 -- 172.21.15.47:0/3841953487 learned_addr learned my addr 172.21.15.47:0/3841953487 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.177+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7524d0 0x55841ab1c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b259c640 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 0x55841ab1b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b2d9d640 1 -- 172.21.15.47:0/3841953487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 msgr2=0x55841ab1b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 0x55841ab1b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b2d9d640 1 -- 172.21.15.47:0/3841953487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7524d0 msgr2=0x55841ab1c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7524d0 0x55841ab1c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b2d9d640 1 -- 172.21.15.47:0/3841953487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841aa42530 con 0x55841a7731b0 2024-09-21T00:59:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7524d0 0x55841ab1c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61a37fe640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f619c0b6590 0x7f619c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b259c640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f619c0b6590 0x7f619c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.178+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab1ae50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00bfa0 tx=0x7f61ac00b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e1bc076c7835ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.179+0000 7f61a37fe640 1 -- 172.21.15.47:0/2521735820 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f61a80ead10 con 0x7f61b4103640 2024-09-21T00:59:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.179+0000 7f61a0ff9640 1 -- 172.21.15.47:0/3841953487 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac019020 con 0x55841a7731b0 2024-09-21T00:59:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.179+0000 7f61a0ff9640 1 -- 172.21.15.47:0/3841953487 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61ac015cc0 con 0x55841a7731b0 2024-09-21T00:59:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 -- 172.21.15.47:0/3841953487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 msgr2=0x55841ab1ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61b259c640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f619c0b6590 0x7f619c0b8aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61a4000c00 tx=0x7f61a4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab1ae50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00bfa0 tx=0x7f61ac00b730 comp rx=0 tx=0).stop 2024-09-21T00:59:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 -- 172.21.15.47:0/3841953487 shutdown_connections 2024-09-21T00:59:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7524d0 0x55841ab1c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 0x55841ab1b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 --2- 172.21.15.47:0/3841953487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab1ae50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 -- 172.21.15.47:0/3841953487 >> 172.21.15.47:0/3841953487 conn(0x55841a767300 msgr2=0x55841ab168e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 -- 172.21.15.47:0/3841953487 shutdown_connections 2024-09-21T00:59:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.180+0000 7f61bfc38740 1 -- 172.21.15.47:0/3841953487 wait complete. 2024-09-21T00:59:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 1 -- start start 2024-09-21T00:59:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 1 Processor -- start 2024-09-21T00:59:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab24580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab24c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7731b0 0x55841ab257b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55841a9b4ab0 con 0x55841a74a2f0 2024-09-21T00:59:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55841aa22730 con 0x55841a7524d0 2024-09-21T00:59:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55841ab1cb80 con 0x55841a7731b0 2024-09-21T00:59:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.181+0000 7f61bfc38740 10 client.0 _ll_register_callbacks cb 0x55841aa766b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7731b0 0x55841ab257b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7731b0 0x55841ab257b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:35680/0 (socket says 172.21.15.47:35680) 2024-09-21T00:59:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 -- 172.21.15.47:0/2343565792 learned_addr learned my addr 172.21.15.47:0/2343565792 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab24c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b259c640 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab24580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 -- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 msgr2=0x55841ab24c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab24c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 -- 172.21.15.47:0/2343565792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 msgr2=0x55841ab24580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab24580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 -- 172.21.15.47:0/2343565792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841a7de790 con 0x55841a7731b0 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab24c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7731b0 0x55841ab257b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00bdc0 tx=0x7f61ac00aee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b7ece84566812c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.182+0000 7f6199ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f6199ffb640 1 -- 172.21.15.47:0/2343565792 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac019040 con 0x55841a7731b0 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f6199ffb640 1 -- 172.21.15.47:0/2343565792 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f61ac003d80 con 0x55841a7731b0 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 1 -- 172.21.15.47:0/2343565792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61ac015cc0 con 0x55841a7731b0 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f6199ffb640 1 -- 172.21.15.47:0/2343565792 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f61ac015610 con 0x55841a7731b0 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 10 client.25183 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 1 -- 172.21.15.47:0/2343565792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55841a857620 con 0x55841a7731b0 2024-09-21T00:59:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f6199ffb640 1 -- 172.21.15.47:0/2343565792 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61ac005070 con 0x55841a7731b0 2024-09-21T00:59:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f6199ffb640 1 -- 172.21.15.47:0/2343565792 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f61ac026070 con 0x55841a7731b0 2024-09-21T00:59:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 10 client.25183 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 10 client.25183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 20 client.25183 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55841a731d80 0x55841ab3a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 4 client.25183 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.183+0000 7f61bfc38740 1 -- 172.21.15.47:0/2343565792 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f61ac015cc0 con 0x55841a731d80 2024-09-21T00:59:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.184+0000 7f61b259c640 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55841a731d80 0x55841ab3a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.184+0000 7f6199ffb640 10 client.25183 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.184+0000 7f61b259c640 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55841a731d80 0x55841ab3a3e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e858682466dc8884 server_cookie=51b18a75f72dc281 in_seq=0 out_seq=0 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.185+0000 7f6199ffb640 1 -- 172.21.15.47:0/2343565792 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f61ac015cc0 con 0x55841a731d80 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.185+0000 7f6199ffb640 10 client.25183 handle_command_reply: tid=0 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.185+0000 7f61bfc38740 1 client.25183 shutdown 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.185+0000 7f61bfc38740 1 -- 172.21.15.47:0/2343565792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7731b0 msgr2=0x55841ab257b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.185+0000 7f61bfc38740 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7731b0 0x55841ab257b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00bdc0 tx=0x7f61ac00aee0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.185+0000 7f61bfc38740 1 -- 172.21.15.47:0/2343565792 shutdown_connections 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.185+0000 7f61bfc38740 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55841a731d80 0x55841ab3a3e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.185+0000 7f61bfc38740 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7731b0 0x55841ab257b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.186+0000 7f6199ffb640 0 client.25183 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.186+0000 7f61bfc38740 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab24c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.186+0000 7f61bfc38740 1 --2- 172.21.15.47:0/2343565792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab24580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.186+0000 7f61bfc38740 1 -- 172.21.15.47:0/2343565792 >> 172.21.15.47:0/2343565792 conn(0x55841a767300 msgr2=0x55841ab14ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.186+0000 7f61bfc38740 1 -- 172.21.15.47:0/2343565792 shutdown_connections 2024-09-21T00:59:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.186+0000 7f61bfc38740 1 -- 172.21.15.47:0/2343565792 wait complete. 2024-09-21T00:59:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.186+0000 7f61bfc38740 20 client.25183 trim_cache size 0 max 16384 2024-09-21T00:59:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.215+0000 7f61bfc38740 1 Processor -- start 2024-09-21T00:59:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.215+0000 7f61bfc38740 1 -- start start 2024-09-21T00:59:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.215+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab256f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.215+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7524d0 0x55841ab2c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.215+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab116d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.215+0000 7f61bfc38740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f61b41a6d00 con 0x55841a74a2f0 2024-09-21T00:59:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.215+0000 7f61bfc38740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f61b41a9580 con 0x55841a7731b0 2024-09-21T00:59:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.215+0000 7f61bfc38740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61b41a7370 con 0x55841a7524d0 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab256f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab256f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38358/0 (socket says 172.21.15.47:38358) 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 -- 172.21.15.47:0/32938956 learned_addr learned my addr 172.21.15.47:0/32938956 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7524d0 0x55841ab2c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 -- 172.21.15.47:0/32938956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7524d0 msgr2=0x55841ab2c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7524d0 0x55841ab2c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 -- 172.21.15.47:0/32938956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 msgr2=0x55841ab116d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 -- 172.21.15.47:0/32938956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841ab22660 con 0x55841a74a2f0 2024-09-21T00:59:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.216+0000 7f61b259c640 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab256f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009900 tx=0x7f61a403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0ecdfa1bb22a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.217+0000 7f619bfff640 1 -- 172.21.15.47:0/32938956 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4035070 con 0x55841a74a2f0 2024-09-21T00:59:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.217+0000 7f619bfff640 1 -- 172.21.15.47:0/32938956 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a4004270 con 0x55841a74a2f0 2024-09-21T00:59:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.217+0000 7f619bfff640 1 -- 172.21.15.47:0/32938956 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a403c770 con 0x55841a74a2f0 2024-09-21T00:59:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 -- 172.21.15.47:0/32938956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 msgr2=0x55841ab256f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab256f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009900 tx=0x7f61a403e040 comp rx=0 tx=0).stop 2024-09-21T00:59:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 -- 172.21.15.47:0/32938956 shutdown_connections 2024-09-21T00:59:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7731b0 0x55841ab116d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a7524d0 0x55841ab2c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 --2- 172.21.15.47:0/32938956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a74a2f0 0x55841ab256f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 -- 172.21.15.47:0/32938956 >> 172.21.15.47:0/32938956 conn(0x55841a767300 msgr2=0x55841ab25de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 -- 172.21.15.47:0/32938956 shutdown_connections 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 -- 172.21.15.47:0/32938956 wait complete. 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.218+0000 7f61bfc38740 1 -- start start 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61bfc38740 1 Processor -- start 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 0x55841ab292e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab299a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61bfc38740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7731b0 0x55841ab2a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61bfc38740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f61b41a7a40 con 0x55841a7731b0 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61b2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7731b0 0x55841ab2a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61b2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7731b0 0x55841ab2a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38372/0 (socket says 172.21.15.47:38372) 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61b2d9d640 1 -- 172.21.15.47:0/1370693370 learned_addr learned my addr 172.21.15.47:0/1370693370 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f61b41a8eb0 con 0x55841a7524d0 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61b41a8110 con 0x55841a74a2f0 2024-09-21T00:59:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61b259c640 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 0x55841ab292e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.219+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61b2d9d640 1 -- 172.21.15.47:0/1370693370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 msgr2=0x55841ab292e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 0x55841ab292e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61b2d9d640 1 -- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 msgr2=0x55841ab299a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab299a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61b2d9d640 1 -- 172.21.15.47:0/1370693370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841ab2ac70 con 0x55841a7731b0 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61b1d9b640 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab299a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61bfc38740 10 client.0 _ll_register_callbacks cb 0x7f61a80ee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61a4004270 con 0x55841a7731b0 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f61b2d9d640 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7731b0 0x55841ab2a510 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00aeb0 tx=0x7f61ac028930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30526c4025655f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f6199ffb640 10 client.15468 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f6199ffb640 1 -- 172.21.15.47:0/1370693370 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac037060 con 0x55841a7731b0 2024-09-21T00:59:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.220+0000 7f6199ffb640 1 -- 172.21.15.47:0/1370693370 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f61ac005b50 con 0x55841a7731b0 2024-09-21T00:59:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f6199ffb640 1 -- 172.21.15.47:0/1370693370 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f61ac019070 con 0x55841a7731b0 2024-09-21T00:59:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f61bfc38740 10 client.15468 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55841ab2be40 con 0x55841a7731b0 2024-09-21T00:59:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f6199ffb640 1 -- 172.21.15.47:0/1370693370 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f61ac026040 con 0x55841a7731b0 2024-09-21T00:59:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f61bfc38740 10 client.15468 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f61bfc38740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f61bfc38740 20 client.15468 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f61bfc38740 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55841a7071c0 0x55841aba6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f61bfc38740 4 client.15468 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.221+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55841aa8f640 con 0x55841a7071c0 2024-09-21T00:59:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.222+0000 7f61b259c640 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55841a7071c0 0x55841aba6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.222+0000 7f6199ffb640 10 client.15468 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.222+0000 7f61b259c640 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55841a7071c0 0x55841aba6d80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ecb86d00cd20b03 server_cookie=c20961b163b727af in_seq=0 out_seq=0 2024-09-21T00:59:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f6199ffb640 1 -- 172.21.15.47:0/1370693370 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55841aa8f640 con 0x55841a7071c0 2024-09-21T00:59:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f6199ffb640 10 client.15468 handle_command_reply: tid=0 2024-09-21T00:59:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 client.15468 shutdown 2024-09-21T00:59:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7731b0 msgr2=0x55841ab2a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7731b0 0x55841ab2a510 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00aeb0 tx=0x7f61ac028930 comp rx=0 tx=0).stop 2024-09-21T00:59:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 shutdown_connections 2024-09-21T00:59:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55841a7071c0 0x55841aba6d80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f6199ffb640 0 client.15468 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841a7731b0 0x55841ab2a510 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55841a7524d0 0x55841ab299a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 --2- 172.21.15.47:0/1370693370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55841a74a2f0 0x55841ab292e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 >> 172.21.15.47:0/1370693370 conn(0x55841a767300 msgr2=0x55841ab1ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.228+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 shutdown_connections 2024-09-21T00:59:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.229+0000 7f61bfc38740 1 -- 172.21.15.47:0/1370693370 wait complete. 2024-09-21T00:59:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.229+0000 7f61bfc38740 20 client.15468 trim_cache size 0 max 16384 2024-09-21T00:59:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T00:59:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T00:59:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T00:59:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T00:59:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.229+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f619c0b6590 msgr2=0x7f619c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.229+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f619c0b6590 0x7f619c0b8aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61a4000c00 tx=0x7f61a4031400 comp rx=0 tx=0).stop 2024-09-21T00:59:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.229+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2521735820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b4103640 msgr2=0x7f61b41983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b4103640 0x7f61b41983f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009be0 tx=0x7f61a80071c0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2521735820 shutdown_connections 2024-09-21T00:59:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f619c0b6590 0x7f619c0b8aa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61b4103fe0 0x7f61b4198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b4103640 0x7f61b41983f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 --2- 172.21.15.47:0/2521735820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b41025c0 0x7f61b4197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2521735820 >> 172.21.15.47:0/2521735820 conn(0x7f61b40fdf00 msgr2=0x7f61b4106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2521735820 shutdown_connections 2024-09-21T00:59:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:27.230+0000 7f61b8ccc640 1 -- 172.21.15.47:0/2521735820 wait complete. 2024-09-21T00:59:28.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:28 smithi114 ceph-mon[34309]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T00:59:28.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:28 smithi047 ceph-mon[30960]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T00:59:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:28 smithi134 ceph-mon[34785]: pgmap v368: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T00:59:30.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:30 smithi114 ceph-mon[34309]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T00:59:30.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:30 smithi047 ceph-mon[30960]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T00:59:30.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:30 smithi134 ceph-mon[34785]: pgmap v369: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T00:59:32.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:32 smithi114 ceph-mon[34309]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:59:32.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:32 smithi047 ceph-mon[30960]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:59:32.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:32 smithi134 ceph-mon[34785]: pgmap v370: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T00:59:34.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:34 smithi114 ceph-mon[34309]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:34.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:34 smithi047 ceph-mon[30960]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:34.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:34 smithi134 ceph-mon[34785]: pgmap v371: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:36.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:36 smithi114 ceph-mon[34309]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:36.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:36 smithi047 ceph-mon[30960]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:36.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:36 smithi134 ceph-mon[34785]: pgmap v372: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:37.124 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 91% (11572/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T00:59:37.549 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T00:59:37.549 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-09-21T00:59:37.549 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T00:59:37.549 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T00:59:37.549 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T00:59:37.549 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-09-21T00:59:37.550 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:59:37.555 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T00:59:37.582 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T00:59:37.584 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T00:59:37.584 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T00:59:38.308 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T00:59:38.380 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T00:59:38.421 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T00:59:38.423 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T00:59:38.424 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T00:59:38.464 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T00:59:38.467 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T00:59:38.468 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T00:59:38.539 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-21T00:59:38.540 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-21T00:59:38.541 DEBUG:teuthology.orchestra.run.smithi047:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-21T00:59:38.603 INFO:tasks.workunit.client.0.smithi047.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-21T00:59:38.604 INFO:tasks.workunit.client.0.smithi047.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-21T00:59:38.604 INFO:tasks.workunit.client.0.smithi047.stderr:+ trap -- retry EXIT 2024-09-21T00:59:38.604 INFO:tasks.workunit.client.0.smithi047.stderr:+ rm -rf ffsb 2024-09-21T00:59:38.604 INFO:tasks.workunit.client.0.smithi047.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-21T00:59:38.608 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into 'ffsb'... 2024-09-21T00:59:38.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:38 smithi114 ceph-mon[34309]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:38.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:38 smithi047 ceph-mon[30960]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:38 smithi134 ceph-mon[34785]: pgmap v373: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T00:59:39.507 INFO:tasks.workunit.client.0.smithi047.stderr:+ trap - EXIT 2024-09-21T00:59:39.508 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd ffsb 2024-09-21T00:59:39.508 INFO:tasks.workunit.client.0.smithi047.stderr:+ ./configure 2024-09-21T00:59:39.623 INFO:tasks.workunit.client.0.smithi047.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T00:59:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 -- 172.21.15.47:0/244991898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 msgr2=0x7f49d4102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 --2- 172.21.15.47:0/244991898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 0x7f49d4102a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009900 tx=0x7f49c402a410 comp rx=0 tx=0).stop 2024-09-21T00:59:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 -- 172.21.15.47:0/244991898 shutdown_connections 2024-09-21T00:59:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 --2- 172.21.15.47:0/244991898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d4103fc0 0x7f49d410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 --2- 172.21.15.47:0/244991898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4103620 0x7f49d4103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 --2- 172.21.15.47:0/244991898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 0x7f49d4102a10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 -- 172.21.15.47:0/244991898 >> 172.21.15.47:0/244991898 conn(0x7f49d40fdee0 msgr2=0x7f49d4100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 -- 172.21.15.47:0/244991898 shutdown_connections 2024-09-21T00:59:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.341+0000 7f49d9069640 1 -- 172.21.15.47:0/244991898 wait complete. 2024-09-21T00:59:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d9069640 1 Processor -- start 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d9069640 1 -- start start 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d9069640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 0x7f49d406b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d9069640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d4103620 0x7f49d419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d9069640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4103fc0 0x7f49d41a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d9069640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f49d410e1f0 con 0x7f49d41025a0 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d9069640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f49d410e070 con 0x7f49d4103fc0 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d9069640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49d410e370 con 0x7f49d4103620 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 0x7f49d406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 0x7f49d406b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37624/0 (socket says 172.21.15.47:37624) 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.342+0000 7f49d2d9d640 1 -- 172.21.15.47:0/955604900 learned_addr learned my addr 172.21.15.47:0/955604900 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d259c640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d4103620 0x7f49d419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d359e640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4103fc0 0x7f49d41a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d2d9d640 1 -- 172.21.15.47:0/955604900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d4103620 msgr2=0x7f49d419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d2d9d640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d4103620 0x7f49d419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d2d9d640 1 -- 172.21.15.47:0/955604900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4103fc0 msgr2=0x7f49d41a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d2d9d640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4103fc0 0x7f49d41a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d2d9d640 1 -- 172.21.15.47:0/955604900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d41a19e0 con 0x7f49d41025a0 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d2d9d640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 0x7f49d406b490 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006010 tx=0x7f49c4032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49bbfff640 1 -- 172.21.15.47:0/955604900 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c403f030 con 0x7f49d41025a0 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d9069640 1 -- 172.21.15.47:0/955604900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d41a1c70 con 0x7f49d41025a0 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49bbfff640 1 -- 172.21.15.47:0/955604900 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c4003aa0 con 0x7f49d41025a0 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49bbfff640 1 -- 172.21.15.47:0/955604900 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4035070 con 0x7f49d41025a0 2024-09-21T00:59:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.343+0000 7f49d9069640 1 -- 172.21.15.47:0/955604900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d41a2160 con 0x7f49d41025a0 2024-09-21T00:59:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.346+0000 7f49dffd8740 1 Processor -- start 2024-09-21T00:59:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.346+0000 7f49dffd8740 1 -- start start 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9d74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d60e4d0 0x56232d9d8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49dffd8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56232d9496f0 con 0x56232d6062f0 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49dffd8740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56232d938b20 con 0x56232d60e4d0 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49dffd8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56232d93c930 con 0x56232d62f1b0 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49bbfff640 1 -- 172.21.15.47:0/955604900 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f49c4042030 con 0x7f49d41025a0 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:60128/0 (socket says 172.21.15.47:60128) 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 -- 172.21.15.47:0/1054232666 learned_addr learned my addr 172.21.15.47:0/1054232666 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d259c640 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d60e4d0 0x56232d9d8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d2d9d640 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9d74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 -- 172.21.15.47:0/1054232666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d60e4d0 msgr2=0x56232d9d8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d60e4d0 0x56232d9d8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 -- 172.21.15.47:0/1054232666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 msgr2=0x56232d9d74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9d74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 -- 172.21.15.47:0/1054232666 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232d8fe530 con 0x56232d62f1b0 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d2d9d640 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9d74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.347+0000 7f49d359e640 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d6e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009f80 tx=0x7f49cc011870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=517247f085da3729 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.348+0000 7f49b97fa640 1 -- 172.21.15.47:0/1054232666 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc012710 con 0x56232d62f1b0 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.348+0000 7f49bbfff640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f49bc0b6510 0x7f49bc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.348+0000 7f49b97fa640 1 -- 172.21.15.47:0/1054232666 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49cc012d60 con 0x56232d62f1b0 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.348+0000 7f49b97fa640 1 -- 172.21.15.47:0/1054232666 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00fea0 con 0x56232d62f1b0 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.348+0000 7f49d2d9d640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f49bc0b6510 0x7f49bc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.348+0000 7f49bbfff640 1 -- 172.21.15.47:0/955604900 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f49c4107900 con 0x7f49d41025a0 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 -- 172.21.15.47:0/1054232666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 msgr2=0x56232d9d6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49d2d9d640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f49bc0b6510 0x7f49bc0b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f49c40ca100 tx=0x7f49c402a410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d6e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009f80 tx=0x7f49cc011870 comp rx=0 tx=0).stop 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 -- 172.21.15.47:0/1054232666 shutdown_connections 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d60e4d0 0x56232d9d8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9d74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1054232666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d6e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 -- 172.21.15.47:0/1054232666 >> 172.21.15.47:0/1054232666 conn(0x56232d623300 msgr2=0x56232d9d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 -- 172.21.15.47:0/1054232666 shutdown_connections 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 -- 172.21.15.47:0/1054232666 wait complete. 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 -- start start 2024-09-21T00:59:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 Processor -- start 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.349+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 0x56232d9e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 0x56232d9e17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49dffd8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56232d870ab0 con 0x56232d6062f0 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49dffd8740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56232d8de730 con 0x56232d62f1b0 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49dffd8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56232d9d8b30 con 0x56232d60e4d0 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49dffd8740 10 client.0 _ll_register_callbacks cb 0x56232d9326b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37646/0 (socket says 172.21.15.47:37646) 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 -- 172.21.15.47:0/3710480059 learned_addr learned my addr 172.21.15.47:0/3710480059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d259c640 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 0x56232d9e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 0x56232d9e17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 -- 172.21.15.47:0/3710480059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 msgr2=0x56232d9e0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 0x56232d9e0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 -- 172.21.15.47:0/3710480059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 msgr2=0x56232d9e17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 0x56232d9e17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 -- 172.21.15.47:0/3710480059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56232d69a790 con 0x56232d6062f0 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49d359e640 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e05a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f49cc01c040 tx=0x7f49cc00f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1112bb0588edb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49b6ff5640 1 -- 172.21.15.47:0/3710480059 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc003bd0 con 0x56232d6062f0 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49b6ff5640 1 -- 172.21.15.47:0/3710480059 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f49cc003d70 con 0x56232d6062f0 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.350+0000 7f49dffd8740 1 -- 172.21.15.47:0/3710480059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49cc012d60 con 0x56232d6062f0 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49b6ff5640 1 -- 172.21.15.47:0/3710480059 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f49cc004a90 con 0x56232d6062f0 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49dffd8740 10 client.15480 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49dffd8740 1 -- 172.21.15.47:0/3710480059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56232d713620 con 0x56232d6062f0 2024-09-21T00:59:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49b6ff5640 1 -- 172.21.15.47:0/3710480059 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49cc012d60 con 0x56232d6062f0 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49b6ff5640 1 -- 172.21.15.47:0/3710480059 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f49cc030020 con 0x56232d6062f0 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49dffd8740 10 client.15480 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49dffd8740 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49dffd8740 20 client.15480 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49dffd8740 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56232d5edd80 0x56232d9ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49dffd8740 4 client.15480 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49dffd8740 1 -- 172.21.15.47:0/3710480059 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56232d94b640 con 0x56232d5edd80 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.351+0000 7f49d259c640 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56232d5edd80 0x56232d9ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.352+0000 7f49d259c640 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56232d5edd80 0x56232d9ed9c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a424a5d83546cc server_cookie=f35193f7945037c3 in_seq=0 out_seq=0 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.352+0000 7f49b6ff5640 10 client.15480 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49b6ff5640 1 -- 172.21.15.47:0/3710480059 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56232d94b640 con 0x56232d5edd80 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49b6ff5640 10 client.15480 handle_command_reply: tid=0 2024-09-21T00:59:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 client.15480 shutdown 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 -- 172.21.15.47:0/3710480059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 msgr2=0x56232d9e05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e05a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f49cc01c040 tx=0x7f49cc00f7c0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 -- 172.21.15.47:0/3710480059 shutdown_connections 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56232d5edd80 0x56232d9ed9c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 0x56232d9e17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 0x56232d9e0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 --2- 172.21.15.47:0/3710480059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e05a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 -- 172.21.15.47:0/3710480059 >> 172.21.15.47:0/3710480059 conn(0x56232d623300 msgr2=0x56232d9d7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49b6ff5640 0 client.15480 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 -- 172.21.15.47:0/3710480059 shutdown_connections 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 1 -- 172.21.15.47:0/3710480059 wait complete. 2024-09-21T00:59:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.353+0000 7f49dffd8740 20 client.15480 trim_cache size 0 max 16384 2024-09-21T00:59:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.367+0000 7f49dffd8740 1 Processor -- start 2024-09-21T00:59:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.367+0000 7f49dffd8740 1 -- start start 2024-09-21T00:59:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d6062f0 0x56232d9df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d60e4d0 0x56232d9d8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49dffd8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41a8da0 con 0x56232d60e4d0 2024-09-21T00:59:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49dffd8740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41ab620 con 0x56232d6062f0 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49dffd8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41a9410 con 0x56232d62f1b0 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d60e4d0 0x56232d9d8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d60e4d0 0x56232d9d8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37652/0 (socket says 172.21.15.47:37652) 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 -- 172.21.15.47:0/932219058 learned_addr learned my addr 172.21.15.47:0/932219058 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d359e640 1 --2- 172.21.15.47:0/932219058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d6062f0 0x56232d9df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 -- 172.21.15.47:0/932219058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 msgr2=0x56232d9d94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 --2- 172.21.15.47:0/932219058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 -- 172.21.15.47:0/932219058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d6062f0 msgr2=0x56232d9df1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 --2- 172.21.15.47:0/932219058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d6062f0 0x56232d9df1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 -- 172.21.15.47:0/932219058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232d9dbd50 con 0x56232d60e4d0 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49d259c640 1 --2- 172.21.15.47:0/932219058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d60e4d0 0x56232d9d8f90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x56232d9ee000 tx=0x7f49c80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72491e9473ca91e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49b8ff9640 1 -- 172.21.15.47:0/932219058 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8004230 con 0x56232d60e4d0 2024-09-21T00:59:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49b8ff9640 1 -- 172.21.15.47:0/932219058 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c80043d0 con 0x56232d60e4d0 2024-09-21T00:59:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.368+0000 7f49b8ff9640 1 -- 172.21.15.47:0/932219058 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c801c790 con 0x56232d60e4d0 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 -- 172.21.15.47:0/932219058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d60e4d0 msgr2=0x56232d9d8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 --2- 172.21.15.47:0/932219058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d60e4d0 0x56232d9d8f90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x56232d9ee000 tx=0x7f49c80118d0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 -- 172.21.15.47:0/932219058 shutdown_connections 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 --2- 172.21.15.47:0/932219058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d62f1b0 0x56232d9d94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 --2- 172.21.15.47:0/932219058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d60e4d0 0x56232d9d8f90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 --2- 172.21.15.47:0/932219058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d6062f0 0x56232d9df1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 -- 172.21.15.47:0/932219058 >> 172.21.15.47:0/932219058 conn(0x56232d623300 msgr2=0x56232d9deab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 -- 172.21.15.47:0/932219058 shutdown_connections 2024-09-21T00:59:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 -- 172.21.15.47:0/932219058 wait complete. 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.369+0000 7f49dffd8740 1 -- start start 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49dffd8740 1 Processor -- start 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 0x56232d9e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49dffd8740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 0x56232d9e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49dffd8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41a9ae0 con 0x56232d6062f0 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49dffd8740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41aaf50 con 0x56232d62f1b0 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49dffd8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41aa1b0 con 0x56232d60e4d0 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49dffd8740 10 client.0 _ll_register_callbacks cb 0x7f49c800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37664/0 (socket says 172.21.15.47:37664) 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 -- 172.21.15.47:0/1833030163 learned_addr learned my addr 172.21.15.47:0/1833030163 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d259c640 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 0x56232d9e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 -- 172.21.15.47:0/1833030163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 msgr2=0x56232d9e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 0x56232d9e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 -- 172.21.15.47:0/1833030163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 msgr2=0x56232d9e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 0x56232d9e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 -- 172.21.15.47:0/1833030163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56232d9e5e90 con 0x56232d6062f0 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49d359e640 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e8530 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00fef0 tx=0x7f49cc011fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc92b3b0545eb543 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.370+0000 7f49b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49b6ff5640 1 -- 172.21.15.47:0/1833030163 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc009e50 con 0x56232d6062f0 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49b6ff5640 1 -- 172.21.15.47:0/1833030163 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f49cc004790 con 0x56232d6062f0 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 1 -- 172.21.15.47:0/1833030163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c80043d0 con 0x56232d6062f0 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49b6ff5640 1 -- 172.21.15.47:0/1833030163 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f49cc00f490 con 0x56232d6062f0 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 10 client.15486 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 1 -- 172.21.15.47:0/1833030163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56232da583e0 con 0x56232d6062f0 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49b6ff5640 1 -- 172.21.15.47:0/1833030163 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c80043d0 con 0x56232d6062f0 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49b6ff5640 1 -- 172.21.15.47:0/1833030163 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f49cc026040 con 0x56232d6062f0 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 10 client.15486 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 10 client.15486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 20 client.15486 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56232d5c31c0 0x56232da5acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 4 client.15486 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49dffd8740 1 -- 172.21.15.47:0/1833030163 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56232d9470f0 con 0x56232d5c31c0 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.371+0000 7f49d259c640 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56232d5c31c0 0x56232da5acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.372+0000 7f49d259c640 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56232d5c31c0 0x56232da5acf0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f906fb5b0ea80ae1 server_cookie=f149c3a07e717788 in_seq=0 out_seq=0 2024-09-21T00:59:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.372+0000 7f49b6ff5640 10 client.15486 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49b6ff5640 1 -- 172.21.15.47:0/1833030163 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56232d9470f0 con 0x56232d5c31c0 2024-09-21T00:59:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49b6ff5640 10 client.15486 handle_command_reply: tid=0 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 client.15486 shutdown 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 -- 172.21.15.47:0/1833030163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 msgr2=0x56232d9e8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e8530 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00fef0 tx=0x7f49cc011fa0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 -- 172.21.15.47:0/1833030163 shutdown_connections 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56232d5c31c0 0x56232da5acf0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56232d62f1b0 0x56232d9e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56232d60e4d0 0x56232d9e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49b6ff5640 0 client.15486 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 --2- 172.21.15.47:0/1833030163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232d6062f0 0x56232d9e8530 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 -- 172.21.15.47:0/1833030163 >> 172.21.15.47:0/1833030163 conn(0x56232d623300 msgr2=0x56232d9d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 -- 172.21.15.47:0/1833030163 shutdown_connections 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 1 -- 172.21.15.47:0/1833030163 wait complete. 2024-09-21T00:59:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.444+0000 7f49dffd8740 20 client.15486 trim_cache size 0 max 16384 2024-09-21T00:59:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T00:59:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T00:59:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T00:59:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 -- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f49bc0b6510 msgr2=0x7f49bc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f49bc0b6510 0x7f49bc0b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f49c40ca100 tx=0x7f49c402a410 comp rx=0 tx=0).stop 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 -- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 msgr2=0x7f49d406b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 0x7f49d406b490 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006010 tx=0x7f49c4032f90 comp rx=0 tx=0).stop 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 -- 172.21.15.47:0/955604900 shutdown_connections 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f49bc0b6510 0x7f49bc0b8a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4103fc0 0x7f49d41a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d4103620 0x7f49d419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 --2- 172.21.15.47:0/955604900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d41025a0 0x7f49d406b490 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 -- 172.21.15.47:0/955604900 >> 172.21.15.47:0/955604900 conn(0x7f49d40fdee0 msgr2=0x7f49d4106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 -- 172.21.15.47:0/955604900 shutdown_connections 2024-09-21T00:59:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:40.445+0000 7f49d9069640 1 -- 172.21.15.47:0/955604900 wait complete. 2024-09-21T00:59:40.630 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether build environment is sane... yes 2024-09-21T00:59:40.639 INFO:tasks.workunit.client.0.smithi047.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-21T00:59:40.639 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gawk... gawk 2024-09-21T00:59:40.652 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether make sets $(MAKE)... yes 2024-09-21T00:59:40.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:40 smithi114 ceph-mon[34309]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:40.683 INFO:tasks.workunit.client.0.smithi047.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-21T00:59:40.683 INFO:tasks.workunit.client.0.smithi047.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-21T00:59:40.693 INFO:tasks.workunit.client.0.smithi047.stdout:checking for style of include used by make... GNU 2024-09-21T00:59:40.698 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc... gcc 2024-09-21T00:59:40.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:40 smithi047 ceph-mon[30960]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:40.749 INFO:tasks.workunit.client.0.smithi047.stdout:checking for C compiler default output file name... a.out 2024-09-21T00:59:40.750 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether the C compiler works... yes 2024-09-21T00:59:40.753 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are cross compiling... no 2024-09-21T00:59:40.789 INFO:tasks.workunit.client.0.smithi047.stdout:checking for suffix of executables... 2024-09-21T00:59:40.822 INFO:tasks.workunit.client.0.smithi047.stdout:checking for suffix of object files... o 2024-09-21T00:59:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:40 smithi134 ceph-mon[34785]: pgmap v374: 97 pgs: 97 active+clean; 667 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T00:59:40.852 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T00:59:40.883 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether gcc accepts -g... yes 2024-09-21T00:59:40.954 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T00:59:41.056 INFO:tasks.workunit.client.0.smithi047.stdout:checking dependency style of gcc... gcc3 2024-09-21T00:59:41.118 INFO:tasks.workunit.client.0.smithi047.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T00:59:41.161 INFO:tasks.workunit.client.0.smithi047.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-21T00:59:41.163 INFO:tasks.workunit.client.0.smithi047.stdout:checking for egrep... /usr/bin/grep -E 2024-09-21T00:59:41.172 INFO:tasks.workunit.client.0.smithi047.stdout:checking for AIX... no 2024-09-21T00:59:41.192 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc... (cached) gcc 2024-09-21T00:59:41.200 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T00:59:41.201 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T00:59:41.201 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T00:59:41.202 INFO:tasks.workunit.client.0.smithi047.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-21T00:59:41.257 INFO:tasks.workunit.client.0.smithi047.stdout:checking for main in -lm... yes 2024-09-21T00:59:41.308 INFO:tasks.workunit.client.0.smithi047.stdout:checking for main in -lpthread... yes 2024-09-21T00:59:41.473 INFO:tasks.workunit.client.0.smithi047.stdout:checking for ANSI C header files... yes 2024-09-21T00:59:41.532 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-21T00:59:41.577 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/types.h... yes 2024-09-21T00:59:41.624 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/stat.h... yes 2024-09-21T00:59:41.671 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdlib.h... yes 2024-09-21T00:59:41.719 INFO:tasks.workunit.client.0.smithi047.stdout:checking for string.h... yes 2024-09-21T00:59:41.767 INFO:tasks.workunit.client.0.smithi047.stdout:checking for memory.h... yes 2024-09-21T00:59:41.815 INFO:tasks.workunit.client.0.smithi047.stdout:checking for strings.h... yes 2024-09-21T00:59:41.865 INFO:tasks.workunit.client.0.smithi047.stdout:checking for inttypes.h... yes 2024-09-21T00:59:41.913 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdint.h... yes 2024-09-21T00:59:41.964 INFO:tasks.workunit.client.0.smithi047.stdout:checking for unistd.h... yes 2024-09-21T00:59:42.021 INFO:tasks.workunit.client.0.smithi047.stdout:checking pthread.h usability... yes 2024-09-21T00:59:42.043 INFO:tasks.workunit.client.0.smithi047.stdout:checking pthread.h presence... yes 2024-09-21T00:59:42.044 INFO:tasks.workunit.client.0.smithi047.stdout:checking for pthread.h... yes 2024-09-21T00:59:42.100 INFO:tasks.workunit.client.0.smithi047.stdout:checking fcntl.h usability... yes 2024-09-21T00:59:42.121 INFO:tasks.workunit.client.0.smithi047.stdout:checking fcntl.h presence... yes 2024-09-21T00:59:42.121 INFO:tasks.workunit.client.0.smithi047.stdout:checking for fcntl.h... yes 2024-09-21T00:59:42.178 INFO:tasks.workunit.client.0.smithi047.stdout:checking limits.h usability... yes 2024-09-21T00:59:42.198 INFO:tasks.workunit.client.0.smithi047.stdout:checking limits.h presence... yes 2024-09-21T00:59:42.198 INFO:tasks.workunit.client.0.smithi047.stdout:checking for limits.h... yes 2024-09-21T00:59:42.218 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdint.h... (cached) yes 2024-09-21T00:59:42.269 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/time.h usability... yes 2024-09-21T00:59:42.291 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/time.h presence... yes 2024-09-21T00:59:42.291 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/time.h... yes 2024-09-21T00:59:42.311 INFO:tasks.workunit.client.0.smithi047.stdout:checking for unistd.h... (cached) yes 2024-09-21T00:59:42.365 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/vfs.h usability... yes 2024-09-21T00:59:42.386 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/vfs.h presence... yes 2024-09-21T00:59:42.386 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/vfs.h... yes 2024-09-21T00:59:42.438 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/limits.h usability... no 2024-09-21T00:59:42.459 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/limits.h presence... no 2024-09-21T00:59:42.459 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/limits.h... no 2024-09-21T00:59:42.494 INFO:tasks.workunit.client.0.smithi047.stdout:checking for an ANSI C-conforming const... yes 2024-09-21T00:59:42.528 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-21T00:59:42.529 INFO:tasks.workunit.client.0.smithi047.stdout:checking for function prototypes... yes 2024-09-21T00:59:42.557 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether setvbuf arguments are reversed... no 2024-09-21T00:59:42.643 INFO:tasks.workunit.client.0.smithi047.stdout:checking for system... yes 2024-09-21T00:59:42.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:42 smithi047 ceph-mon[30960]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:59:42.711 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gettimeofday... yes 2024-09-21T00:59:42.779 INFO:tasks.workunit.client.0.smithi047.stdout:checking for mkdir... yes 2024-09-21T00:59:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:42 smithi134 ceph-mon[34785]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:59:42.845 INFO:tasks.workunit.client.0.smithi047.stdout:checking for strerror... yes 2024-09-21T00:59:42.907 INFO:tasks.workunit.client.0.smithi047.stdout:checking for open64... yes 2024-09-21T00:59:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:42 smithi114 ceph-mon[34309]: pgmap v375: 97 pgs: 97 active+clean; 667 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T00:59:42.969 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stat64... yes 2024-09-21T00:59:43.031 INFO:tasks.workunit.client.0.smithi047.stdout:checking for fseeko64... yes 2024-09-21T00:59:43.094 INFO:tasks.workunit.client.0.smithi047.stdout:checking for lrand48_r... yes 2024-09-21T00:59:43.156 INFO:tasks.workunit.client.0.smithi047.stdout:checking for srand48_r... yes 2024-09-21T00:59:43.180 INFO:tasks.workunit.client.0.smithi047.stdout:configure: creating ./config.status 2024-09-21T00:59:43.278 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating Makefile 2024-09-21T00:59:43.291 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating config.h 2024-09-21T00:59:43.310 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: executing depfiles commands 2024-09-21T00:59:43.358 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: executing default commands 2024-09-21T00:59:43.408 INFO:tasks.workunit.client.0.smithi047.stderr:+ make 2024-09-21T00:59:43.415 INFO:tasks.workunit.client.0.smithi047.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-21T00:59:43.417 INFO:tasks.workunit.client.0.smithi047.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-21T00:59:43.418 INFO:tasks.workunit.client.0.smithi047.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-21T00:59:43.418 INFO:tasks.workunit.client.0.smithi047.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-21T00:59:43.418 INFO:tasks.workunit.client.0.smithi047.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-21T00:59:43.418 INFO:tasks.workunit.client.0.smithi047.stderr: any GNU archive site. 2024-09-21T00:59:43.419 INFO:tasks.workunit.client.0.smithi047.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-21T00:59:43.421 INFO:tasks.workunit.client.0.smithi047.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-21T00:59:43.422 INFO:tasks.workunit.client.0.smithi047.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-21T00:59:43.422 INFO:tasks.workunit.client.0.smithi047.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-21T00:59:43.422 INFO:tasks.workunit.client.0.smithi047.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-21T00:59:43.422 INFO:tasks.workunit.client.0.smithi047.stderr: Grab them from any GNU archive site. 2024-09-21T00:59:43.464 INFO:tasks.workunit.client.0.smithi047.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-21T00:59:43.784 INFO:tasks.workunit.client.0.smithi047.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-21T00:59:43.784 INFO:tasks.workunit.client.0.smithi047.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-21T00:59:43.784 INFO:tasks.workunit.client.0.smithi047.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-21T00:59:43.784 INFO:tasks.workunit.client.0.smithi047.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-21T00:59:43.903 INFO:tasks.workunit.client.0.smithi047.stdout:/bin/sh ./config.status --recheck 2024-09-21T00:59:44.037 INFO:tasks.workunit.client.0.smithi047.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-21T00:59:44.137 INFO:tasks.workunit.client.0.smithi047.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T00:59:44.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:44 smithi047 ceph-mon[30960]: pgmap v376: 97 pgs: 97 active+clean; 2.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 203 KiB/s wr, 67 op/s 2024-09-21T00:59:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:44 smithi134 ceph-mon[34785]: pgmap v376: 97 pgs: 97 active+clean; 2.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 203 KiB/s wr, 67 op/s 2024-09-21T00:59:44.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:44 smithi114 ceph-mon[34309]: pgmap v376: 97 pgs: 97 active+clean; 2.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 203 KiB/s wr, 67 op/s 2024-09-21T00:59:45.145 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether build environment is sane... yes 2024-09-21T00:59:45.150 INFO:tasks.workunit.client.0.smithi047.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-21T00:59:45.150 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gawk... gawk 2024-09-21T00:59:45.175 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether make sets $(MAKE)... yes 2024-09-21T00:59:45.209 INFO:tasks.workunit.client.0.smithi047.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-21T00:59:45.210 INFO:tasks.workunit.client.0.smithi047.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-21T00:59:45.222 INFO:tasks.workunit.client.0.smithi047.stdout:checking for style of include used by make... GNU 2024-09-21T00:59:45.226 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc... gcc 2024-09-21T00:59:45.317 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether the C compiler works... yes 2024-09-21T00:59:45.317 INFO:tasks.workunit.client.0.smithi047.stdout:checking for C compiler default output file name... a.out 2024-09-21T00:59:45.357 INFO:tasks.workunit.client.0.smithi047.stdout:checking for suffix of executables... 2024-09-21T00:59:45.396 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are cross compiling... no 2024-09-21T00:59:45.433 INFO:tasks.workunit.client.0.smithi047.stdout:checking for suffix of object files... o 2024-09-21T00:59:45.458 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T00:59:45.482 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether gcc accepts -g... yes 2024-09-21T00:59:45.525 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T00:59:45.624 INFO:tasks.workunit.client.0.smithi047.stdout:checking dependency style of gcc... gcc3 2024-09-21T00:59:45.671 INFO:tasks.workunit.client.0.smithi047.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T00:59:45.720 INFO:tasks.workunit.client.0.smithi047.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-21T00:59:45.721 INFO:tasks.workunit.client.0.smithi047.stdout:checking for egrep... /usr/bin/grep -E 2024-09-21T00:59:45.846 INFO:tasks.workunit.client.0.smithi047.stdout:checking for ANSI C header files... yes 2024-09-21T00:59:45.881 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/types.h... yes 2024-09-21T00:59:45.919 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/stat.h... yes 2024-09-21T00:59:45.958 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdlib.h... yes 2024-09-21T00:59:45.998 INFO:tasks.workunit.client.0.smithi047.stdout:checking for string.h... yes 2024-09-21T00:59:46.037 INFO:tasks.workunit.client.0.smithi047.stdout:checking for memory.h... yes 2024-09-21T00:59:46.077 INFO:tasks.workunit.client.0.smithi047.stdout:checking for strings.h... yes 2024-09-21T00:59:46.117 INFO:tasks.workunit.client.0.smithi047.stdout:checking for inttypes.h... yes 2024-09-21T00:59:46.157 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdint.h... yes 2024-09-21T00:59:46.199 INFO:tasks.workunit.client.0.smithi047.stdout:checking for unistd.h... yes 2024-09-21T00:59:46.247 INFO:tasks.workunit.client.0.smithi047.stdout:checking minix/config.h usability... no 2024-09-21T00:59:46.276 INFO:tasks.workunit.client.0.smithi047.stdout:checking minix/config.h presence... no 2024-09-21T00:59:46.276 INFO:tasks.workunit.client.0.smithi047.stdout:checking for minix/config.h... no 2024-09-21T00:59:46.312 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-21T00:59:46.312 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc... (cached) gcc 2024-09-21T00:59:46.347 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T00:59:46.347 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T00:59:46.347 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T00:59:46.347 INFO:tasks.workunit.client.0.smithi047.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-21T00:59:46.390 INFO:tasks.workunit.client.0.smithi047.stdout:checking for main in -lm... yes 2024-09-21T00:59:46.435 INFO:tasks.workunit.client.0.smithi047.stdout:checking for main in -lpthread... yes 2024-09-21T00:59:46.436 INFO:tasks.workunit.client.0.smithi047.stdout:checking for ANSI C header files... (cached) yes 2024-09-21T00:59:46.469 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-21T00:59:46.534 INFO:tasks.workunit.client.0.smithi047.stdout:checking pthread.h usability... yes 2024-09-21T00:59:46.553 INFO:tasks.workunit.client.0.smithi047.stdout:checking pthread.h presence... yes 2024-09-21T00:59:46.553 INFO:tasks.workunit.client.0.smithi047.stdout:checking for pthread.h... yes 2024-09-21T00:59:46.601 INFO:tasks.workunit.client.0.smithi047.stdout:checking fcntl.h usability... yes 2024-09-21T00:59:46.619 INFO:tasks.workunit.client.0.smithi047.stdout:checking fcntl.h presence... yes 2024-09-21T00:59:46.619 INFO:tasks.workunit.client.0.smithi047.stdout:checking for fcntl.h... yes 2024-09-21T00:59:46.667 INFO:tasks.workunit.client.0.smithi047.stdout:checking limits.h usability... yes 2024-09-21T00:59:46.683 INFO:tasks.workunit.client.0.smithi047.stdout:checking limits.h presence... yes 2024-09-21T00:59:46.684 INFO:tasks.workunit.client.0.smithi047.stdout:checking for limits.h... yes 2024-09-21T00:59:46.698 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stdint.h... (cached) yes 2024-09-21T00:59:46.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:46 smithi047 ceph-mon[30960]: pgmap v377: 97 pgs: 97 active+clean; 3.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 245 KiB/s wr, 80 op/s 2024-09-21T00:59:46.735 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/time.h usability... yes 2024-09-21T00:59:46.751 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/time.h presence... yes 2024-09-21T00:59:46.751 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/time.h... yes 2024-09-21T00:59:46.765 INFO:tasks.workunit.client.0.smithi047.stdout:checking for unistd.h... (cached) yes 2024-09-21T00:59:46.803 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/vfs.h usability... yes 2024-09-21T00:59:46.819 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/vfs.h presence... yes 2024-09-21T00:59:46.820 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/vfs.h... yes 2024-09-21T00:59:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:46 smithi134 ceph-mon[34785]: pgmap v377: 97 pgs: 97 active+clean; 3.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 245 KiB/s wr, 80 op/s 2024-09-21T00:59:46.871 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/limits.h usability... no 2024-09-21T00:59:46.900 INFO:tasks.workunit.client.0.smithi047.stdout:checking sys/limits.h presence... no 2024-09-21T00:59:46.900 INFO:tasks.workunit.client.0.smithi047.stdout:checking for sys/limits.h... no 2024-09-21T00:59:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:46 smithi114 ceph-mon[34309]: pgmap v377: 97 pgs: 97 active+clean; 3.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 245 KiB/s wr, 80 op/s 2024-09-21T00:59:46.926 INFO:tasks.workunit.client.0.smithi047.stdout:checking for an ANSI C-conforming const... yes 2024-09-21T00:59:46.954 INFO:tasks.workunit.client.0.smithi047.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-21T00:59:47.013 INFO:tasks.workunit.client.0.smithi047.stdout:checking for system... yes 2024-09-21T00:59:47.064 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:59:47.070 INFO:tasks.workunit.client.0.smithi047.stdout:checking for gettimeofday... yes 2024-09-21T00:59:47.127 INFO:tasks.workunit.client.0.smithi047.stdout:checking for mkdir... yes 2024-09-21T00:59:47.182 INFO:tasks.workunit.client.0.smithi047.stdout:checking for strerror... yes 2024-09-21T00:59:47.237 INFO:tasks.workunit.client.0.smithi047.stdout:checking for open64... yes 2024-09-21T00:59:47.300 INFO:tasks.workunit.client.0.smithi047.stdout:checking for stat64... yes 2024-09-21T00:59:47.339 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:47.361 INFO:tasks.workunit.client.0.smithi047.stdout:checking for fseeko64... yes 2024-09-21T00:59:47.418 INFO:tasks.workunit.client.0.smithi047.stdout:checking for lrand48_r... yes 2024-09-21T00:59:47.475 INFO:tasks.workunit.client.0.smithi047.stdout:checking for srand48_r... yes 2024-09-21T00:59:47.498 INFO:tasks.workunit.client.0.smithi047.stdout:configure: creating ./config.status 2024-09-21T00:59:47.559 INFO:tasks.workunit.client.0.smithi047.stdout: /bin/sh ./config.status 2024-09-21T00:59:47.608 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating Makefile 2024-09-21T00:59:47.620 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating config.h 2024-09-21T00:59:47.643 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: executing depfiles commands 2024-09-21T00:59:47.655 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: executing default commands 2024-09-21T00:59:47.678 INFO:tasks.workunit.client.0.smithi047.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-21T00:59:47.839 INFO:tasks.workunit.client.0.smithi047.stdout:rm -f stamp-h1 2024-09-21T00:59:47.841 INFO:tasks.workunit.client.0.smithi047.stdout:touch config.h.in 2024-09-21T00:59:47.843 INFO:tasks.workunit.client.0.smithi047.stdout:cd . && /bin/sh ./config.status config.h 2024-09-21T00:59:47.887 INFO:tasks.workunit.client.0.smithi047.stdout:config.status: creating config.h 2024-09-21T00:59:47.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 -- 172.21.15.47:0/592368706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f8108d20 msgr2=0x7f48f810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/592368706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f8108d20 0x7f48f810f550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009ca0 tx=0x7f48f002a8c0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 -- 172.21.15.47:0/592368706 shutdown_connections 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/592368706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f8108d20 0x7f48f810f550 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/592368706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f81083d0 0x7f48f81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/592368706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f8102a90 0x7f48f8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 -- 172.21.15.47:0/592368706 >> 172.21.15.47:0/592368706 conn(0x7f48f8079730 msgr2=0x7f48f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 -- 172.21.15.47:0/592368706 shutdown_connections 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.874+0000 7f48fd4f6640 1 -- 172.21.15.47:0/592368706 wait complete. 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.875+0000 7f48fd4f6640 1 Processor -- start 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.875+0000 7f48fd4f6640 1 -- start start 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48fd4f6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8102a90 0x7f48f819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48fd4f6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f81083d0 0x7f48f819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48fd4f6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f8108d20 0x7f48f819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48fd4f6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81129e0 con 0x7f48f81083d0 2024-09-21T00:59:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48fd4f6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8112860 con 0x7f48f8108d20 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48fd4f6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48f8112b60 con 0x7f48f8102a90 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f81083d0 0x7f48f819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8102a90 0x7f48f819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f8108d20 0x7f48f819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f81083d0 0x7f48f819b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34542/0 (socket says 172.21.15.47:34542) 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8102a90 0x7f48f819b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:58390/0 (socket says 172.21.15.47:58390) 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f67fc640 1 -- 172.21.15.47:0/3529875503 learned_addr learned my addr 172.21.15.47:0/3529875503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f8108d20 0x7f48f819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:54672/0 (socket says 172.21.15.47:54672) 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f77fe640 1 -- 172.21.15.47:0/3529875503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8102a90 msgr2=0x7f48f819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f77fe640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8102a90 0x7f48f819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f77fe640 1 -- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f81083d0 msgr2=0x7f48f819b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f77fe640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f81083d0 0x7f48f819b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f77fe640 1 -- 172.21.15.47:0/3529875503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f81a6510 con 0x7f48f8108d20 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.876+0000 7f48f67fc640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f81083d0 0x7f48f819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.877+0000 7f48f77fe640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f8108d20 0x7f48f819bd90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48f002ade0 tx=0x7f48f00316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.877+0000 7f48effff640 1 -- 172.21.15.47:0/3529875503 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0003b70 con 0x7f48f8108d20 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.877+0000 7f48fd4f6640 1 -- 172.21.15.47:0/3529875503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f8199100 con 0x7f48f8108d20 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.877+0000 7f48effff640 1 -- 172.21.15.47:0/3529875503 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48f0003d10 con 0x7f48f8108d20 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.877+0000 7f48fd4f6640 1 -- 172.21.15.47:0/3529875503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f8199640 con 0x7f48f8108d20 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.877+0000 7f48effff640 1 -- 172.21.15.47:0/3529875503 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f002f9e0 con 0x7f48f8108d20 2024-09-21T00:59:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.880+0000 7f48effff640 1 -- 172.21.15.47:0/3529875503 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f48f0004040 con 0x7f48f8108d20 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.880+0000 7f4903a6a740 1 Processor -- start 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.880+0000 7f4903a6a740 1 -- start start 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd48b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd48bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 0x5593dd48c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f4903a6a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5593dd401e50 con 0x5593dd0bb1b0 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48effff640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f48e40b6540 0x7f48e40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f4903a6a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5593dd3f1280 con 0x5593dd0c3390 2024-09-21T00:59:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f4903a6a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5593dd3f5090 con 0x5593dd0e4070 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd48bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f77fe640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f48e40b6540 0x7f48e40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd48bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34552/0 (socket says 172.21.15.47:34552) 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f6ffd640 1 -- 172.21.15.47:0/3487385668 learned_addr learned my addr 172.21.15.47:0/3487385668 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f67fc640 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd48b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f67fc640 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 0x5593dd48c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48effff640 1 -- 172.21.15.47:0/3529875503 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f48f0108320 con 0x7f48f8108d20 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f6ffd640 1 -- 172.21.15.47:0/3487385668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 msgr2=0x5593dd48b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd48b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f6ffd640 1 -- 172.21.15.47:0/3487385668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 msgr2=0x5593dd48c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 0x5593dd48c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f6ffd640 1 -- 172.21.15.47:0/3487385668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593dd14f650 con 0x5593dd0bb1b0 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.881+0000 7f48f77fe640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f48e40b6540 0x7f48e40b8a50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48f00cb720 tx=0x7f48f00c8980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.882+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd48bb90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009c90 tx=0x7f48e0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d058d905b0bff24a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.882+0000 7f48ed7fa640 1 -- 172.21.15.47:0/3487385668 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0005220 con 0x5593dd0bb1b0 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.882+0000 7f48ed7fa640 1 -- 172.21.15.47:0/3487385668 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48e0004c50 con 0x5593dd0bb1b0 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.882+0000 7f48ed7fa640 1 -- 172.21.15.47:0/3487385668 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0019670 con 0x5593dd0bb1b0 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 -- 172.21.15.47:0/3487385668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 msgr2=0x5593dd48bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd48bb90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009c90 tx=0x7f48e0011810 comp rx=0 tx=0).stop 2024-09-21T00:59:47.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 -- 172.21.15.47:0/3487385668 shutdown_connections 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 0x5593dd48c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd48bb90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 --2- 172.21.15.47:0/3487385668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd48b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 -- 172.21.15.47:0/3487385668 >> 172.21.15.47:0/3487385668 conn(0x5593dd0d8460 msgr2=0x5593dd489540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 -- 172.21.15.47:0/3487385668 shutdown_connections 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 -- 172.21.15.47:0/3487385668 wait complete. 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 -- start start 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.883+0000 7f4903a6a740 1 Processor -- start 2024-09-21T00:59:47.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd496d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd497280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd4a3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f4903a6a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5593dd252700 con 0x5593dd0c3390 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f4903a6a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5593dd38c110 con 0x5593dd0bb1b0 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f4903a6a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5593dd499e30 con 0x5593dd0e4070 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f4903a6a740 10 client.0 _ll_register_callbacks cb 0x5593dd3a5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd497280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd496d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd497280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34562/0 (socket says 172.21.15.47:34562) 2024-09-21T00:59:47.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f6ffd640 1 -- 172.21.15.47:0/581351182 learned_addr learned my addr 172.21.15.47:0/581351182 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd496d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:54694/0 (socket says 172.21.15.47:54694) 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd4a3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 -- 172.21.15.47:0/581351182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 msgr2=0x5593dd4a3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd4a3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 -- 172.21.15.47:0/581351182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 msgr2=0x5593dd497280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd497280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 -- 172.21.15.47:0/581351182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593dd3b9c40 con 0x5593dd0bb1b0 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd497280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:47.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48f67fc640 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd496d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48e800afd0 tx=0x7f48e8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fabc8228f11c6e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.884+0000 7f48de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.885+0000 7f48de7fc640 1 -- 172.21.15.47:0/581351182 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e800eb10 con 0x5593dd0bb1b0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.885+0000 7f48de7fc640 1 -- 172.21.15.47:0/581351182 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f48e800ecb0 con 0x5593dd0bb1b0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.885+0000 7f4903a6a740 1 -- 172.21.15.47:0/581351182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e0004c50 con 0x5593dd0bb1b0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.885+0000 7f48de7fc640 1 -- 172.21.15.47:0/581351182 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f48e8005020 con 0x5593dd0bb1b0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.885+0000 7f4903a6a740 10 client.25214 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.885+0000 7f4903a6a740 1 -- 172.21.15.47:0/581351182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5593dd4a5ba0 con 0x5593dd0bb1b0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.885+0000 7f48de7fc640 1 -- 172.21.15.47:0/581351182 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48e0004c50 con 0x5593dd0bb1b0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f48de7fc640 1 -- 172.21.15.47:0/581351182 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f48e8004b10 con 0x5593dd0bb1b0 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f4903a6a740 10 client.25214 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f4903a6a740 10 client.25214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f4903a6a740 20 client.25214 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f4903a6a740 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5593dd0a29f0 0x5593dd4a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f4903a6a740 4 client.25214 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:47.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f4903a6a740 1 -- 172.21.15.47:0/581351182 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593dd403da0 con 0x5593dd0a29f0 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5593dd0a29f0 0x5593dd4a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5593dd0a29f0 0x5593dd4a90d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=529db7f496baa584 server_cookie=e8f5efb6b0c56f59 in_seq=0 out_seq=0 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.886+0000 7f48de7fc640 10 client.25214 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f48de7fc640 1 -- 172.21.15.47:0/581351182 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593dd403da0 con 0x5593dd0a29f0 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f48de7fc640 10 client.25214 handle_command_reply: tid=0 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 client.25214 shutdown 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 -- 172.21.15.47:0/581351182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 msgr2=0x5593dd496d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd496d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48e800afd0 tx=0x7f48e8004730 comp rx=0 tx=0).stop 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 -- 172.21.15.47:0/581351182 shutdown_connections 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5593dd0a29f0 0x5593dd4a90d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd4a3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd497280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 --2- 172.21.15.47:0/581351182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd496d40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f48de7fc640 0 client.25214 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:47.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.887+0000 7f4903a6a740 1 -- 172.21.15.47:0/581351182 >> 172.21.15.47:0/581351182 conn(0x5593dd0d8460 msgr2=0x5593dd48e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.888+0000 7f4903a6a740 1 -- 172.21.15.47:0/581351182 shutdown_connections 2024-09-21T00:59:47.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.888+0000 7f4903a6a740 1 -- 172.21.15.47:0/581351182 wait complete. 2024-09-21T00:59:47.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.888+0000 7f4903a6a740 20 client.25214 trim_cache size 0 max 16384 2024-09-21T00:59:47.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.905+0000 7f4903a6a740 1 Processor -- start 2024-09-21T00:59:47.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.905+0000 7f4903a6a740 1 -- start start 2024-09-21T00:59:47.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.905+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd498970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd488b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd4890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f4903a6a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81af440 con 0x5593dd0c3390 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f4903a6a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b1ca0 con 0x5593dd0bb1b0 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f4903a6a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81afa90 con 0x5593dd0e4070 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd488b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd498970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd488b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34566/0 (socket says 172.21.15.47:34566) 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd498970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:54700/0 (socket says 172.21.15.47:54700) 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 -- 172.21.15.47:0/1395738677 learned_addr learned my addr 172.21.15.47:0/1395738677 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f67fc640 1 --2- 172.21.15.47:0/1395738677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd4890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 -- 172.21.15.47:0/1395738677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 msgr2=0x5593dd4890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/1395738677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd4890b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 -- 172.21.15.47:0/1395738677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 msgr2=0x5593dd498970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/1395738677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd498970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 -- 172.21.15.47:0/1395738677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593dd48e4b0 con 0x5593dd0c3390 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/1395738677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd488b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f48e0013010 tx=0x7f48e00056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8a7d488a25b3ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.906+0000 7f48ecff9640 1 -- 172.21.15.47:0/1395738677 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0004fc0 con 0x5593dd0c3390 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.907+0000 7f48ecff9640 1 -- 172.21.15.47:0/1395738677 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48e0004040 con 0x5593dd0c3390 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.907+0000 7f48ecff9640 1 -- 172.21.15.47:0/1395738677 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0003830 con 0x5593dd0c3390 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.907+0000 7f4903a6a740 1 -- 172.21.15.47:0/1395738677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 msgr2=0x5593dd488b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.907+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1395738677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd488b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f48e0013010 tx=0x7f48e00056c0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.907+0000 7f4903a6a740 1 -- 172.21.15.47:0/1395738677 shutdown_connections 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1395738677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd4890b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1395738677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0c3390 0x5593dd488b70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1395738677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0bb1b0 0x5593dd498970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 -- 172.21.15.47:0/1395738677 >> 172.21.15.47:0/1395738677 conn(0x5593dd0d8460 msgr2=0x5593dd498260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 -- 172.21.15.47:0/1395738677 shutdown_connections 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 -- 172.21.15.47:0/1395738677 wait complete. 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 -- start start 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 Processor -- start 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd49f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 0x5593dd49abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd49b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b0160 con 0x5593dd0bb1b0 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b15d0 con 0x5593dd0c3390 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48f81b0830 con 0x5593dd0e4070 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f4903a6a740 10 client.0 _ll_register_callbacks cb 0x7f48e80114c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:47.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.908+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd49f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd49f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34578/0 (socket says 172.21.15.47:34578) 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 -- 172.21.15.47:0/1004675418 learned_addr learned my addr 172.21.15.47:0/1004675418 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 0x5593dd49abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd49b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 -- 172.21.15.47:0/1004675418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 msgr2=0x5593dd49b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd49b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 -- 172.21.15.47:0/1004675418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 msgr2=0x5593dd49abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 0x5593dd49abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 -- 172.21.15.47:0/1004675418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593dd49b720 con 0x5593dd0bb1b0 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48f67fc640 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd49f720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f48e8004f30 tx=0x7f48e800aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdcaf5d0588099c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48de7fc640 1 -- 172.21.15.47:0/1004675418 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e803d060 con 0x5593dd0bb1b0 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48de7fc640 1 -- 172.21.15.47:0/1004675418 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f48e801a040 con 0x5593dd0bb1b0 2024-09-21T00:59:47.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f4903a6a740 1 -- 172.21.15.47:0/1004675418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e0004040 con 0x5593dd0bb1b0 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f48de7fc640 1 -- 172.21.15.47:0/1004675418 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f48e800ee80 con 0x5593dd0bb1b0 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f4903a6a740 10 client.15504 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.909+0000 7f4903a6a740 1 -- 172.21.15.47:0/1004675418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5593dd513870 con 0x5593dd0bb1b0 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f48de7fc640 1 -- 172.21.15.47:0/1004675418 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48e0004040 con 0x5593dd0bb1b0 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f48de7fc640 1 -- 172.21.15.47:0/1004675418 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f48e8035040 con 0x5593dd0bb1b0 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f4903a6a740 10 client.15504 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f4903a6a740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f4903a6a740 20 client.15504 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5593dd077da0 0x5593dd515ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f4903a6a740 4 client.15504 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f4903a6a740 1 -- 172.21.15.47:0/1004675418 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5593dd3ff850 con 0x5593dd077da0 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.910+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5593dd077da0 0x5593dd515ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:47.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f48f6ffd640 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5593dd077da0 0x5593dd515ef0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d47577d5064a0cfd server_cookie=44f54459f0e11d59 in_seq=0 out_seq=0 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f48de7fc640 10 client.15504 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f48de7fc640 1 -- 172.21.15.47:0/1004675418 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x5593dd3ff850 con 0x5593dd077da0 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f48de7fc640 10 client.15504 handle_command_reply: tid=0 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 client.15504 shutdown 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 -- 172.21.15.47:0/1004675418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 msgr2=0x5593dd49f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd49f720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f48e8004f30 tx=0x7f48e800aee0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 -- 172.21.15.47:0/1004675418 shutdown_connections 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5593dd077da0 0x5593dd515ef0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5593dd0e4070 0x5593dd49b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593dd0c3390 0x5593dd49abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f48de7fc640 0 client.15504 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 --2- 172.21.15.47:0/1004675418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593dd0bb1b0 0x5593dd49f720 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 -- 172.21.15.47:0/1004675418 >> 172.21.15.47:0/1004675418 conn(0x5593dd0d8460 msgr2=0x5593dd498af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 -- 172.21.15.47:0/1004675418 shutdown_connections 2024-09-21T00:59:47.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 1 -- 172.21.15.47:0/1004675418 wait complete. 2024-09-21T00:59:47.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.911+0000 7f4903a6a740 20 client.15504 trim_cache size 0 max 16384 2024-09-21T00:59:47.926 INFO:tasks.workunit.client.0.smithi047.stdout:make all-am 2024-09-21T00:59:47.926 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:59:47.926 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-09-21T00:59:47.926 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-09-21T00:59:47.926 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:59:47.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:59:47.928 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:59:47.928 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:59:47.928 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:47.928 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:47.928 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 -- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f48e40b6540 msgr2=0x7f48e40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f48e40b6540 0x7f48e40b8a50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48f00cb720 tx=0x7f48f00c8980 comp rx=0 tx=0).stop 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 -- 172.21.15.47:0/3529875503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f8108d20 msgr2=0x7f48f819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f8108d20 0x7f48f819bd90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48f002ade0 tx=0x7f48f00316f0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 -- 172.21.15.47:0/3529875503 shutdown_connections 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f48e40b6540 0x7f48e40b8a50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f8108d20 0x7f48f819bd90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f81083d0 0x7f48f819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 --2- 172.21.15.47:0/3529875503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8102a90 0x7f48f819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:47.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 -- 172.21.15.47:0/3529875503 >> 172.21.15.47:0/3529875503 conn(0x7f48f8079730 msgr2=0x7f48f81043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:47.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 -- 172.21.15.47:0/3529875503 shutdown_connections 2024-09-21T00:59:47.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:47.912+0000 7f48fd4f6640 1 -- 172.21.15.47:0/3529875503 wait complete. 2024-09-21T00:59:47.930 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-21T00:59:47.930 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-21T00:59:48.155 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-21T00:59:48.158 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-21T00:59:48.339 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-21T00:59:48.342 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-21T00:59:48.458 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-21T00:59:48.461 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-21T00:59:48.553 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-21T00:59:48.556 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-21T00:59:48.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:48 smithi047 ceph-mon[30960]: pgmap v378: 97 pgs: 97 active+clean; 5.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 491 KiB/s wr, 110 op/s 2024-09-21T00:59:48.729 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-21T00:59:48.732 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-21T00:59:48.793 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-21T00:59:48.797 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-21T00:59:48.843 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-21T00:59:48.843 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:48 smithi134 ceph-mon[34785]: pgmap v378: 97 pgs: 97 active+clean; 5.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 491 KiB/s wr, 110 op/s 2024-09-21T00:59:48.847 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-21T00:59:48.893 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T00:59:48.893 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T00:59:48.895 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-21T00:59:48.899 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-21T00:59:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:48 smithi114 ceph-mon[34309]: pgmap v378: 97 pgs: 97 active+clean; 5.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 491 KiB/s wr, 110 op/s 2024-09-21T00:59:49.112 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-21T00:59:49.116 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-21T00:59:49.157 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:49.251 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-21T00:59:49.254 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-21T00:59:49.411 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-21T00:59:49.414 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-21T00:59:49.483 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-21T00:59:49.485 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-21T00:59:49.575 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-21T00:59:49.578 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-21T00:59:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 -- 172.21.15.47:0/403215723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79341083a0 msgr2=0x7f79341087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 --2- 172.21.15.47:0/403215723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79341083a0 0x7f79341087b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7924009900 tx=0x7f792402a410 comp rx=0 tx=0).stop 2024-09-21T00:59:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 -- 172.21.15.47:0/403215723 shutdown_connections 2024-09-21T00:59:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 --2- 172.21.15.47:0/403215723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7934108cf0 0x7f793410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 --2- 172.21.15.47:0/403215723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79341083a0 0x7f79341087b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 --2- 172.21.15.47:0/403215723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7934102a60 0x7f7934102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 -- 172.21.15.47:0/403215723 >> 172.21.15.47:0/403215723 conn(0x7f7934079730 msgr2=0x7f7934079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 -- 172.21.15.47:0/403215723 shutdown_connections 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.665+0000 7f793b4f7640 1 -- 172.21.15.47:0/403215723 wait complete. 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.666+0000 7f793b4f7640 1 Processor -- start 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.666+0000 7f793b4f7640 1 -- start start 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.666+0000 7f793b4f7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7934102a60 0x7f793419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f793b4f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79341083a0 0x7f793419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f793b4f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7934108cf0 0x7f793419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f793b4f7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112960 con 0x7f7934102a60 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f793b4f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f79341127e0 con 0x7f7934108cf0 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f793b4f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112ae0 con 0x7f79341083a0 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7934102a60 0x7f793419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7934102a60 0x7f793419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34606/0 (socket says 172.21.15.47:34606) 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 -- 172.21.15.47:0/1531249815 learned_addr learned my addr 172.21.15.47:0/1531249815 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:49.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939a94640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7934108cf0 0x7f793419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7938a92640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79341083a0 0x7f793419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 -- 172.21.15.47:0/1531249815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79341083a0 msgr2=0x7f793419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79341083a0 0x7f793419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 -- 172.21.15.47:0/1531249815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7934108cf0 msgr2=0x7f793419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7934108cf0 0x7f793419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 -- 172.21.15.47:0/1531249815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79341a0390 con 0x7f7934102a60 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f7939293640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7934102a60 0x7f793419a4e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f793000d950 tx=0x7f793000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.667+0000 7f792a7fc640 1 -- 172.21.15.47:0/1531249815 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930017030 con 0x7f7934102a60 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.668+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79341a0680 con 0x7f7934102a60 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.668+0000 7f792a7fc640 1 -- 172.21.15.47:0/1531249815 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7930004020 con 0x7f7934102a60 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.668+0000 7f792a7fc640 1 -- 172.21.15.47:0/1531249815 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79300047a0 con 0x7f7934102a60 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.668+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341a6ea0 con 0x7f7934102a60 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.669+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7934102e70 con 0x7f7934102a60 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.670+0000 7f792a7fc640 1 -- 172.21.15.47:0/1531249815 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7930009a30 con 0x7f7934102a60 2024-09-21T00:59:49.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.671+0000 7f792a7fc640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79200b6540 0x7f79200b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:49.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.671+0000 7f7938a92640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79200b6540 0x7f79200b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:49.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.671+0000 7f792a7fc640 1 -- 172.21.15.47:0/1531249815 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f79300e72a0 con 0x7f7934102a60 2024-09-21T00:59:49.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.672+0000 7f7938a92640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79200b6540 0x7f79200b8a50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7924000c00 tx=0x7f7924031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:49.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.674+0000 7f792a7fc640 1 -- 172.21.15.47:0/1531249815 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79300adbd0 con 0x7f7934102a60 2024-09-21T00:59:49.685 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-21T00:59:49.688 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-21T00:59:49.716 INFO:tasks.workunit.client.0.smithi047.stderr:In file included from parser.h:22, 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr: from parser.c:25: 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c: In function ‘init_filesys’: 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T00:59:49.717 INFO:tasks.workunit.client.0.smithi047.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T00:59:49.718 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T00:59:49.719 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T00:59:49.720 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.721 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T00:59:49.722 INFO:tasks.workunit.client.0.smithi047.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T00:59:49.723 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-09-21T00:59:49.724 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr: | ^ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~ 2024-09-21T00:59:49.725 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-21T00:59:49.726 INFO:tasks.workunit.client.0.smithi047.stderr: 36 | container_of(ptr, type, member) 2024-09-21T00:59:49.726 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~ 2024-09-21T00:59:49.726 INFO:tasks.workunit.client.0.smithi047.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-21T00:59:49.726 INFO:tasks.workunit.client.0.smithi047.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-21T00:59:49.726 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~ 2024-09-21T00:59:49.726 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-21T00:59:49.726 INFO:tasks.workunit.client.0.smithi047.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-21T00:59:49.726 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.777 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c: In function ‘get_optstr’: 2024-09-21T00:59:49.777 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-21T00:59:49.777 INFO:tasks.workunit.client.0.smithi047.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-21T00:59:49.777 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.777 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:200:14: note: source object declared here 2024-09-21T00:59:49.777 INFO:tasks.workunit.client.0.smithi047.stderr: 200 | char temp[BUFSIZE]; 2024-09-21T00:59:49.777 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~ 2024-09-21T00:59:49.783 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c: In function ‘size64_convert’: 2024-09-21T00:59:49.784 INFO:tasks.workunit.client.0.smithi047.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-21T00:59:49.784 INFO:tasks.workunit.client.0.smithi047.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-21T00:59:49.784 INFO:tasks.workunit.client.0.smithi047.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-21T00:59:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.905+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f793410bad0 con 0x7f7934102a60 2024-09-21T00:59:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.906+0000 7f792a7fc640 1 -- 172.21.15.47:0/1531249815 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f79300b1fb0 con 0x7f7934102a60 2024-09-21T00:59:49.907 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T00:59:49.907 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T00:59:49.908 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T00:59:49.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79200b6540 msgr2=0x7f79200b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79200b6540 0x7f79200b8a50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7924000c00 tx=0x7f7924031400 comp rx=0 tx=0).stop 2024-09-21T00:59:49.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7934102a60 msgr2=0x7f793419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:49.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7934102a60 0x7f793419a4e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f793000d950 tx=0x7f793000de10 comp rx=0 tx=0).stop 2024-09-21T00:59:49.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 shutdown_connections 2024-09-21T00:59:49.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f79200b6540 0x7f79200b8a50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7934108cf0 0x7f793419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79341083a0 0x7f793419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 --2- 172.21.15.47:0/1531249815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7934102a60 0x7f793419a4e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:49.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.909+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 >> 172.21.15.47:0/1531249815 conn(0x7f7934079730 msgr2=0x7f793406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:49.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.910+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 shutdown_connections 2024-09-21T00:59:49.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:49.910+0000 7f793b4f7640 1 -- 172.21.15.47:0/1531249815 wait complete. 2024-09-21T00:59:50.096 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-21T00:59:50.100 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-21T00:59:50.159 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-21T00:59:50.162 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-21T00:59:50.253 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-21T00:59:50.256 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-21T00:59:50.286 INFO:tasks.workunit.client.0.smithi047.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-21T00:59:50.290 INFO:tasks.workunit.client.0.smithi047.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-21T00:59:50.325 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-21T00:59:50.325 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd .. 2024-09-21T00:59:50.325 INFO:tasks.workunit.client.0.smithi047.stderr:+ mkdir tmp 2024-09-21T00:59:50.327 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd tmp 2024-09-21T00:59:50.327 INFO:tasks.workunit.client.0.smithi047.stderr:+ for f in $mydir/*.ffsb 2024-09-21T00:59:50.327 INFO:tasks.workunit.client.0.smithi047.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-21T00:59:50.327 INFO:tasks.workunit.client.0.smithi047.stdout:FFSB version 6.0-RC2 started 2024-09-21T00:59:50.327 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T00:59:50.330 INFO:tasks.workunit.client.0.smithi047.stdout:benchmark time = 300 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout:ThreadGroup 0 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout:================ 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: num_threads = 32 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: read_random = off 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: read_size = 0 (0B) 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: read_blocksize = 0 (0B) 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: read_skip = off 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: read_skipsize = 0 (0B) 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: write_random = on 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: write_size = 5242880 (5MB) 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: fsync_file = 0 2024-09-21T00:59:50.331 INFO:tasks.workunit.client.0.smithi047.stdout: write_blocksize = 4096 (4KB) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: wait time = 0 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: op weights 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: read = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: readall = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: write = 1 (100.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: create = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: append = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: delete = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: metaop = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: createdir = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: stat = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: writeall = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: writeall_fsync = 0 (0.00%) 2024-09-21T00:59:50.332 INFO:tasks.workunit.client.0.smithi047.stdout: open_close = 0 (0.00%) 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: write_fsync = 0 (0.00%) 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: create_fsync = 0 (0.00%) 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: append_fsync = 0 (0.00%) 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout:FileSystem . 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout:========== 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: num_dirs = 0 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: starting files = 128 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: min file size = 104857600 (100MB) 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: max file size = 104857600 (100MB) 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: directio = off 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: alignedio = on 2024-09-21T00:59:50.333 INFO:tasks.workunit.client.0.smithi047.stdout: bufferedio = off 2024-09-21T00:59:50.334 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T00:59:50.334 INFO:tasks.workunit.client.0.smithi047.stdout: aging is off 2024-09-21T00:59:50.334 INFO:tasks.workunit.client.0.smithi047.stdout: current utilization = 0.00% 2024-09-21T00:59:50.334 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T00:59:50.334 INFO:tasks.workunit.client.0.smithi047.stdout:checking existing fs: . 2024-09-21T00:59:50.334 INFO:tasks.workunit.client.0.smithi047.stdout:recreating new fileset 2024-09-21T00:59:50.334 INFO:tasks.workunit.client.0.smithi047.stderr:opendir: No such file or directory 2024-09-21T00:59:50.620 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:50 smithi047 ceph-mon[30960]: pgmap v379: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 511 KiB/s wr, 116 op/s 2024-09-21T00:59:50.620 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:50 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1531249815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:50.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T00:59:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:50 smithi134 ceph-mon[34785]: pgmap v379: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 511 KiB/s wr, 116 op/s 2024-09-21T00:59:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:50 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1531249815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:50 smithi114 ceph-mon[34309]: pgmap v379: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 511 KiB/s wr, 116 op/s 2024-09-21T00:59:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:50 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1531249815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T00:59:50.968 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.418+0000 7fe1d99dd640 1 -- 172.21.15.47:0/4139615583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 msgr2=0x7fe1d410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.418+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/4139615583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 0x7fe1d410d930 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009900 tx=0x7fe1c402a410 comp rx=0 tx=0).stop 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.418+0000 7fe1d99dd640 1 -- 172.21.15.47:0/4139615583 shutdown_connections 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.418+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/4139615583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d410de70 0x7fe1d4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.418+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/4139615583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 0x7fe1d410d930 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.418+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/4139615583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1d41048c0 0x7fe1d4104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.418+0000 7fe1d99dd640 1 -- 172.21.15.47:0/4139615583 >> 172.21.15.47:0/4139615583 conn(0x7fe1d4079790 msgr2=0x7fe1d4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.419+0000 7fe1d99dd640 1 -- 172.21.15.47:0/4139615583 shutdown_connections 2024-09-21T00:59:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.419+0000 7fe1d99dd640 1 -- 172.21.15.47:0/4139615583 wait complete. 2024-09-21T00:59:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.419+0000 7fe1d99dd640 1 Processor -- start 2024-09-21T00:59:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d99dd640 1 -- start start 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d99dd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1d41048c0 0x7fe1d419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d99dd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 0x7fe1d419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d99dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d410de70 0x7fe1d419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d99dd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4113ab0 con 0x7fe1d41052a0 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d99dd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4113930 con 0x7fe1d41048c0 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d99dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4113c30 con 0x7fe1d410de70 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 0x7fe1d419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1d41048c0 0x7fe1d419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 0x7fe1d419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34624/0 (socket says 172.21.15.47:34624) 2024-09-21T00:59:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d410de70 0x7fe1d419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1d41048c0 0x7fe1d419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:54750/0 (socket says 172.21.15.47:54750) 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.420+0000 7fe1d2ffd640 1 -- 172.21.15.47:0/2339639082 learned_addr learned my addr 172.21.15.47:0/2339639082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.421+0000 7fe1d2ffd640 1 -- 172.21.15.47:0/2339639082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d410de70 msgr2=0x7fe1d419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.421+0000 7fe1d2ffd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d410de70 0x7fe1d419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.421+0000 7fe1d2ffd640 1 -- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 msgr2=0x7fe1d419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.421+0000 7fe1d2ffd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 0x7fe1d419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.421+0000 7fe1d2ffd640 1 -- 172.21.15.47:0/2339639082 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d41a03f0 con 0x7fe1d41048c0 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.421+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d410de70 0x7fe1d419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.421+0000 7fe1d2ffd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1d41048c0 0x7fe1d419a480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00e9f0 tx=0x7fe1bc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.423+0000 7fe1d89db640 1 -- 172.21.15.47:0/2339639082 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc00cd80 con 0x7fe1d41048c0 2024-09-21T00:59:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.423+0000 7fe1d89db640 1 -- 172.21.15.47:0/2339639082 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1bc0108e0 con 0x7fe1d41048c0 2024-09-21T00:59:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.423+0000 7fe1d99dd640 1 -- 172.21.15.47:0/2339639082 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d41a06e0 con 0x7fe1d41048c0 2024-09-21T00:59:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.423+0000 7fe1d89db640 1 -- 172.21.15.47:0/2339639082 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc018980 con 0x7fe1d41048c0 2024-09-21T00:59:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.423+0000 7fe1d99dd640 1 -- 172.21.15.47:0/2339639082 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d41a6e40 con 0x7fe1d41048c0 2024-09-21T00:59:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1dff51740 1 Processor -- start 2024-09-21T00:59:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1dff51740 1 -- start start 2024-09-21T00:59:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f42206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 0x55e7f4220be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4221120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1dff51740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7f4196ea0 con 0x55e7f3e79070 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1dff51740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55e7f41862d0 con 0x55e7f3e58390 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1dff51740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e7f418a0e0 con 0x55e7f3e501b0 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f42206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f42206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34634/0 (socket says 172.21.15.47:34634) 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1d37fe640 1 -- 172.21.15.47:0/545064993 learned_addr learned my addr 172.21.15.47:0/545064993 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.426+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4221120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d89db640 1 -- 172.21.15.47:0/2339639082 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe1bc010430 con 0x7fe1d41048c0 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d37fe640 1 -- 172.21.15.47:0/545064993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 msgr2=0x55e7f4220be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:59:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 0x55e7f4220be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d37fe640 1 -- 172.21.15.47:0/545064993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 msgr2=0x55e7f4221120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4221120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d37fe640 1 -- 172.21.15.47:0/545064993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f3ee4650 con 0x55e7f3e79070 2024-09-21T00:59:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4221120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:51.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f42206a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0117e0 tx=0x7fe1cc011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4131a51d4015e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1c9ffb640 1 -- 172.21.15.47:0/545064993 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc011310 con 0x55e7f3e79070 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1c9ffb640 1 -- 172.21.15.47:0/545064993 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1cc003e20 con 0x55e7f3e79070 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1c9ffb640 1 -- 172.21.15.47:0/545064993 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0044f0 con 0x55e7f3e79070 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.427+0000 7fe1d89db640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c00b6590 0x7fe1c00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.428+0000 7fe1d2ffd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c00b6590 0x7fe1c00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.428+0000 7fe1d89db640 1 -- 172.21.15.47:0/2339639082 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fe1bc0e74d0 con 0x7fe1d41048c0 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1d2ffd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c00b6590 0x7fe1c00b8aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0ad740 tx=0x7fe1bc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 -- 172.21.15.47:0/545064993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 msgr2=0x55e7f42206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f42206a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0117e0 tx=0x7fe1cc011ca0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 -- 172.21.15.47:0/545064993 shutdown_connections 2024-09-21T00:59:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4221120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 0x55e7f4220be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 --2- 172.21.15.47:0/545064993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f42206a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 -- 172.21.15.47:0/545064993 >> 172.21.15.47:0/545064993 conn(0x55e7f3e6d460 msgr2=0x55e7f421e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 -- 172.21.15.47:0/545064993 shutdown_connections 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 -- 172.21.15.47:0/545064993 wait complete. 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.429+0000 7fe1dff51740 1 -- start start 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1dff51740 1 Processor -- start 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e501b0 0x55e7f422bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f422c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f422c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1dff51740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7f3fe7700 con 0x55e7f3e79070 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1dff51740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55e7f4121160 con 0x55e7f3e501b0 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1dff51740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e7f422ee80 con 0x55e7f3e58390 2024-09-21T00:59:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1dff51740 10 client.0 _ll_register_callbacks cb 0x55e7f413a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f422c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f422c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34650/0 (socket says 172.21.15.47:34650) 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1d37fe640 1 -- 172.21.15.47:0/3978322196 learned_addr learned my addr 172.21.15.47:0/3978322196 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f422c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.430+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e501b0 0x55e7f422bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1d27fc640 1 -- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e501b0 msgr2=0x55e7f422bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e501b0 0x55e7f422bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1d27fc640 1 -- 172.21.15.47:0/3978322196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 msgr2=0x55e7f422c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f422c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1d27fc640 1 -- 172.21.15.47:0/3978322196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f414ec90 con 0x55e7f3e58390 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e501b0 0x55e7f422bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f422c260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe1c402a930 tx=0x7fe1c4032e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6448bff2377b30b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3978322196 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4035040 con 0x55e7f3e58390 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3978322196 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fe1c4031770 con 0x55e7f3e58390 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.431+0000 7fe1dff51740 1 -- 172.21.15.47:0/3978322196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1cc003e20 con 0x55e7f3e58390 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3978322196 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe1c4004040 con 0x55e7f3e58390 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1dff51740 10 client.25231 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1dff51740 1 -- 172.21.15.47:0/3978322196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e7f423ab30 con 0x55e7f3e58390 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3978322196 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1cc003e20 con 0x55e7f3e58390 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3978322196 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe1c404f050 con 0x55e7f3e58390 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1dff51740 10 client.25231 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1dff51740 10 client.25231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1dff51740 20 client.25231 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e7f3e379f0 0x55e7f423e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.432+0000 7fe1dff51740 4 client.25231 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:51.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.433+0000 7fe1dff51740 1 -- 172.21.15.47:0/3978322196 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7f4198df0 con 0x55e7f3e379f0 2024-09-21T00:59:51.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.433+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e7f3e379f0 0x55e7f423e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.433+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e7f3e379f0 0x55e7f423e020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39afe441aee0742 server_cookie=cfb3a900f96dc2d4 in_seq=0 out_seq=0 2024-09-21T00:59:51.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.433+0000 7fe1b2ffd640 10 client.25231 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.434+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3978322196 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e7f4198df0 con 0x55e7f3e379f0 2024-09-21T00:59:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.434+0000 7fe1b2ffd640 10 client.25231 handle_command_reply: tid=0 2024-09-21T00:59:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.434+0000 7fe1dff51740 1 client.25231 shutdown 2024-09-21T00:59:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.434+0000 7fe1dff51740 1 -- 172.21.15.47:0/3978322196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 msgr2=0x55e7f422c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.434+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f422c260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe1c402a930 tx=0x7fe1c4032e90 comp rx=0 tx=0).stop 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.434+0000 7fe1dff51740 1 -- 172.21.15.47:0/3978322196 shutdown_connections 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.434+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e7f3e379f0 0x55e7f423e020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.434+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e79070 0x55e7f422c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.435+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f422c260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.435+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3978322196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e501b0 0x55e7f422bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.435+0000 7fe1b2ffd640 0 client.25231 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.435+0000 7fe1dff51740 1 -- 172.21.15.47:0/3978322196 >> 172.21.15.47:0/3978322196 conn(0x55e7f3e6d460 msgr2=0x55e7f4223880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.435+0000 7fe1dff51740 1 -- 172.21.15.47:0/3978322196 shutdown_connections 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.435+0000 7fe1dff51740 1 -- 172.21.15.47:0/3978322196 wait complete. 2024-09-21T00:59:51.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.435+0000 7fe1dff51740 20 client.25231 trim_cache size 0 max 16384 2024-09-21T00:59:51.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.448+0000 7fe1dff51740 1 Processor -- start 2024-09-21T00:59:51.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1dff51740 1 -- start start 2024-09-21T00:59:51.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e379f0 0x55e7f422d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e501b0 0x55e7f4228f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f4229450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1dff51740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d41ab080 con 0x55e7f3e501b0 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1dff51740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d41ad900 con 0x55e7f3e379f0 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1dff51740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d41ab6f0 con 0x55e7f3e58390 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e501b0 0x55e7f4228f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f4229450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f4229450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:58488/0 (socket says 172.21.15.47:58488) 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e501b0 0x55e7f4228f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34660/0 (socket says 172.21.15.47:34660) 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 -- 172.21.15.47:0/843045359 learned_addr learned my addr 172.21.15.47:0/843045359 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/843045359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e379f0 0x55e7f422d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 -- 172.21.15.47:0/843045359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e379f0 msgr2=0x55e7f422d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/843045359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e379f0 0x55e7f422d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 -- 172.21.15.47:0/843045359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e501b0 msgr2=0x55e7f4228f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/843045359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e501b0 0x55e7f4228f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.449+0000 7fe1d37fe640 1 -- 172.21.15.47:0/843045359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f422cb30 con 0x55e7f3e58390 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.450+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/843045359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f4229450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc005c40 tx=0x7fe1cc009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31a11ade49525606 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.450+0000 7fe1c97fa640 1 -- 172.21.15.47:0/843045359 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00fc00 con 0x55e7f3e58390 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.450+0000 7fe1c97fa640 1 -- 172.21.15.47:0/843045359 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1cc00fda0 con 0x55e7f3e58390 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.450+0000 7fe1c97fa640 1 -- 172.21.15.47:0/843045359 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc02b830 con 0x55e7f3e58390 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 -- 172.21.15.47:0/843045359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 msgr2=0x55e7f4229450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 --2- 172.21.15.47:0/843045359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f4229450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc005c40 tx=0x7fe1cc009500 comp rx=0 tx=0).stop 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 -- 172.21.15.47:0/843045359 shutdown_connections 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 --2- 172.21.15.47:0/843045359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e58390 0x55e7f4229450 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 --2- 172.21.15.47:0/843045359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e501b0 0x55e7f4228f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 --2- 172.21.15.47:0/843045359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e379f0 0x55e7f422d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 -- 172.21.15.47:0/843045359 >> 172.21.15.47:0/843045359 conn(0x55e7f3e6d460 msgr2=0x55e7f422d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 -- 172.21.15.47:0/843045359 shutdown_connections 2024-09-21T00:59:51.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 -- 172.21.15.47:0/843045359 wait complete. 2024-09-21T00:59:51.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.451+0000 7fe1dff51740 1 -- start start 2024-09-21T00:59:51.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1dff51740 1 Processor -- start 2024-09-21T00:59:51.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e379f0 0x55e7f4230040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 0x55e7f4230580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1dff51740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4230ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1dff51740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d41abdc0 con 0x55e7f3e379f0 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1dff51740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d41ad230 con 0x55e7f3e58390 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1dff51740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d41ac490 con 0x55e7f3e501b0 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1dff51740 10 client.0 _ll_register_callbacks cb 0x7fe1c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e379f0 0x55e7f4230040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e379f0 0x55e7f4230040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34666/0 (socket says 172.21.15.47:34666) 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1d37fe640 1 -- 172.21.15.47:0/3389997339 learned_addr learned my addr 172.21.15.47:0/3389997339 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 0x55e7f4230580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.452+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4230ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1d27fc640 1 -- 172.21.15.47:0/3389997339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 msgr2=0x55e7f4230ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4230ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1d27fc640 1 -- 172.21.15.47:0/3389997339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e379f0 msgr2=0x55e7f4230040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e379f0 0x55e7f4230040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1d27fc640 1 -- 172.21.15.47:0/3389997339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f42a79e0 con 0x55e7f3e501b0 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e379f0 0x55e7f4230040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1d27fc640 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 0x55e7f4230580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009850 tx=0x7fe1c403dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=215681e8677bea8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3389997339 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4055030 con 0x55e7f3e501b0 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3389997339 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fe1c4043040 con 0x55e7f3e501b0 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1dff51740 1 -- 172.21.15.47:0/3389997339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1cc00fda0 con 0x55e7f3e501b0 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3389997339 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe1c4035070 con 0x55e7f3e501b0 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1dff51740 10 client.25237 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1dff51740 1 -- 172.21.15.47:0/3389997339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e7f42a8bc0 con 0x55e7f3e501b0 2024-09-21T00:59:51.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.453+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3389997339 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1cc00fda0 con 0x55e7f3e501b0 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3389997339 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe1c404f040 con 0x55e7f3e501b0 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1dff51740 10 client.25237 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1dff51740 10 client.25237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1dff51740 20 client.25237 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e7f3e79070 0x55e7f42ab370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1dff51740 4 client.25237 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1dff51740 1 -- 172.21.15.47:0/3389997339 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e7f41948a0 con 0x55e7f3e79070 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e7f3e79070 0x55e7f42ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1b2ffd640 10 client.25237 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.454+0000 7fe1d37fe640 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e7f3e79070 0x55e7f42ab370 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28691167f247ecd0 server_cookie=3515182fa37a05fa in_seq=0 out_seq=0 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1b2ffd640 1 -- 172.21.15.47:0/3389997339 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e7f41948a0 con 0x55e7f3e79070 2024-09-21T00:59:51.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1b2ffd640 10 client.25237 handle_command_reply: tid=0 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 client.25237 shutdown 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 -- 172.21.15.47:0/3389997339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 msgr2=0x55e7f4230580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 0x55e7f4230580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009850 tx=0x7fe1c403dc00 comp rx=0 tx=0).stop 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 -- 172.21.15.47:0/3389997339 shutdown_connections 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e7f3e79070 0x55e7f42ab370 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e7f3e58390 0x55e7f4230ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e7f3e501b0 0x55e7f4230580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1b2ffd640 0 client.25237 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 --2- 172.21.15.47:0/3389997339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7f3e379f0 0x55e7f4230040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 -- 172.21.15.47:0/3389997339 >> 172.21.15.47:0/3389997339 conn(0x55e7f3e6d460 msgr2=0x55e7f4222090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 -- 172.21.15.47:0/3389997339 shutdown_connections 2024-09-21T00:59:51.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 1 -- 172.21.15.47:0/3389997339 wait complete. 2024-09-21T00:59:51.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.455+0000 7fe1dff51740 20 client.25237 trim_cache size 0 max 16384 2024-09-21T00:59:51.464 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-09-21T00:59:51.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 -- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c00b6590 msgr2=0x7fe1c00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c00b6590 0x7fe1c00b8aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0ad740 tx=0x7fe1bc000bc0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 -- 172.21.15.47:0/2339639082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1d41048c0 msgr2=0x7fe1d419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1d41048c0 0x7fe1d419a480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00e9f0 tx=0x7fe1bc00eeb0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 -- 172.21.15.47:0/2339639082 shutdown_connections 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fe1c00b6590 0x7fe1c00b8aa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1d410de70 0x7fe1d419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d41052a0 0x7fe1d419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 --2- 172.21.15.47:0/2339639082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1d41048c0 0x7fe1d419a480 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 -- 172.21.15.47:0/2339639082 >> 172.21.15.47:0/2339639082 conn(0x7fe1d4079790 msgr2=0x7fe1d4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 -- 172.21.15.47:0/2339639082 shutdown_connections 2024-09-21T00:59:51.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:51.456+0000 7fe1d99dd640 1 -- 172.21.15.47:0/2339639082 wait complete. 2024-09-21T00:59:52.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:52 smithi047 ceph-mon[30960]: pgmap v380: 97 pgs: 97 active+clean; 6.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 623 KiB/s wr, 127 op/s 2024-09-21T00:59:52.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:52 smithi134 ceph-mon[34785]: pgmap v380: 97 pgs: 97 active+clean; 6.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 623 KiB/s wr, 127 op/s 2024-09-21T00:59:52.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:52 smithi114 ceph-mon[34309]: pgmap v380: 97 pgs: 97 active+clean; 6.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 623 KiB/s wr, 127 op/s 2024-09-21T00:59:53.207 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T00:59:53.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T00:59:53.580 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.611+0000 7f99a9a0e640 1 -- 172.21.15.47:0/1041112448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 msgr2=0x7f99a4107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.611+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/1041112448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 0x7f99a4107bb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9998009900 tx=0x7f999802a410 comp rx=0 tx=0).stop 2024-09-21T00:59:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.611+0000 7f99a9a0e640 1 -- 172.21.15.47:0/1041112448 shutdown_connections 2024-09-21T00:59:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.611+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/1041112448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a41082f0 0x7f99a410a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.611+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/1041112448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 0x7f99a4107bb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.611+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/1041112448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a4102c50 0x7f99a4105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.611+0000 7f99a9a0e640 1 -- 172.21.15.47:0/1041112448 >> 172.21.15.47:0/1041112448 conn(0x7f99a40fd680 msgr2=0x7f99a40ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.611+0000 7f99a9a0e640 1 -- 172.21.15.47:0/1041112448 shutdown_connections 2024-09-21T00:59:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.612+0000 7f99a9a0e640 1 -- 172.21.15.47:0/1041112448 wait complete. 2024-09-21T00:59:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.613+0000 7f99a9a0e640 1 Processor -- start 2024-09-21T00:59:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.613+0000 7f99a9a0e640 1 -- start start 2024-09-21T00:59:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.613+0000 7f99a9a0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a4102c50 0x7f99a419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a9a0e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 0x7f99a419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a9a0e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a41082f0 0x7f99a419d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a9a0e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41115c0 con 0x7f99a41056d0 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a9a0e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4111440 con 0x7f99a41082f0 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a9a0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4111740 con 0x7f99a4102c50 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a4102c50 0x7f99a419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 0x7f99a419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 0x7f99a419c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35238/0 (socket says 172.21.15.47:35238) 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 -- 172.21.15.47:0/920644082 learned_addr learned my addr 172.21.15.47:0/920644082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 -- 172.21.15.47:0/920644082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a4102c50 msgr2=0x7f99a419c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a4102c50 0x7f99a419c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 -- 172.21.15.47:0/920644082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a41082f0 msgr2=0x7f99a419d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a41082f0 0x7f99a419d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 -- 172.21.15.47:0/920644082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a419dc30 con 0x7f99a41056d0 2024-09-21T00:59:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.614+0000 7f99a27fc640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 0x7f99a419c860 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9998031440 tx=0x7f9998003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.615+0000 7f99a8a0c640 1 -- 172.21.15.47:0/920644082 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999803f070 con 0x7f99a41056d0 2024-09-21T00:59:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.615+0000 7f99a8a0c640 1 -- 172.21.15.47:0/920644082 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9998031c50 con 0x7f99a41056d0 2024-09-21T00:59:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.615+0000 7f99a9a0e640 1 -- 172.21.15.47:0/920644082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a419dec0 con 0x7f99a41056d0 2024-09-21T00:59:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.615+0000 7f99a8a0c640 1 -- 172.21.15.47:0/920644082 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998035030 con 0x7f99a41056d0 2024-09-21T00:59:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.615+0000 7f99a9a0e640 1 -- 172.21.15.47:0/920644082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a41a4610 con 0x7f99a41056d0 2024-09-21T00:59:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.618+0000 7f99b0a55740 1 Processor -- start 2024-09-21T00:59:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.618+0000 7f99b0a55740 1 -- start start 2024-09-21T00:59:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.618+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259408e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.618+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2594094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f25940a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99b0a55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f25937b6f0 con 0x55f2590611b0 2024-09-21T00:59:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99b0a55740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f25936ab20 con 0x55f2590382f0 2024-09-21T00:59:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99b0a55740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f25936e930 con 0x55f2590404d0 2024-09-21T00:59:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99a8a0c640 1 -- 172.21.15.47:0/920644082 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9998042070 con 0x7f99a41056d0 2024-09-21T00:59:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259408e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2594094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259408e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35244/0 (socket says 172.21.15.47:35244) 2024-09-21T00:59:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99a37fe640 1 -- 172.21.15.47:0/2508684273 learned_addr learned my addr 172.21.15.47:0/2508684273 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99a27fc640 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f25940a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.621 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.619+0000 7f99a37fe640 1 -- 172.21.15.47:0/2508684273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 msgr2=0x55f25940a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.620+0000 7f99a37fe640 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f25940a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.620+0000 7f99a37fe640 1 -- 172.21.15.47:0/2508684273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 msgr2=0x55f2594094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.620+0000 7f99a37fe640 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2594094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.620+0000 7f99a37fe640 1 -- 172.21.15.47:0/2508684273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f259330530 con 0x55f2590611b0 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.620+0000 7f99a27fc640 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f25940a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.621+0000 7f99a37fe640 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259408e50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f999c009d80 tx=0x7f999c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613ab5cd2602203c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.621+0000 7f9989ffb640 1 -- 172.21.15.47:0/2508684273 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c016070 con 0x55f2590611b0 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.621+0000 7f9989ffb640 1 -- 172.21.15.47:0/2508684273 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c005020 con 0x55f2590611b0 2024-09-21T00:59:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.621+0000 7f9989ffb640 1 -- 172.21.15.47:0/2508684273 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c0116d0 con 0x55f2590611b0 2024-09-21T00:59:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.622+0000 7f99a8a0c640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f998c0b6600 0x7f998c0b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.622+0000 7f99b0a55740 1 -- 172.21.15.47:0/2508684273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 msgr2=0x55f259408e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.622+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259408e50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f999c009d80 tx=0x7f999c00e6c0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.622+0000 7f99a8a0c640 1 -- 172.21.15.47:0/920644082 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f9998107bc0 con 0x7f99a41056d0 2024-09-21T00:59:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.623+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f998c0b6600 0x7f998c0b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.623+0000 7f99b0a55740 1 -- 172.21.15.47:0/2508684273 shutdown_connections 2024-09-21T00:59:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.623+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f25940a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.623+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2594094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.623+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2508684273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259408e50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.623+0000 7f99b0a55740 1 -- 172.21.15.47:0/2508684273 >> 172.21.15.47:0/2508684273 conn(0x55f259055300 msgr2=0x55f2594048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.623+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f998c0b6600 0x7f998c0b8b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9994009af0 tx=0x7f9994008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.624+0000 7f99b0a55740 1 -- 172.21.15.47:0/2508684273 shutdown_connections 2024-09-21T00:59:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.624+0000 7f99b0a55740 1 -- 172.21.15.47:0/2508684273 wait complete. 2024-09-21T00:59:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.624+0000 7f99b0a55740 1 -- start start 2024-09-21T00:59:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.624+0000 7f99b0a55740 1 Processor -- start 2024-09-21T00:59:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590382f0 0x55f259412630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590404d0 0x55f259412cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259413860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99b0a55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f2592a2ab0 con 0x55f2590611b0 2024-09-21T00:59:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99b0a55740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f259310730 con 0x55f2590404d0 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99b0a55740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f25940ab30 con 0x55f2590382f0 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99b0a55740 10 client.0 _ll_register_callbacks cb 0x55f2593646b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259413860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590382f0 0x55f259412630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a27fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590404d0 0x55f259412cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259413860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35254/0 (socket says 172.21.15.47:35254) 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a37fe640 1 -- 172.21.15.47:0/3154573430 learned_addr learned my addr 172.21.15.47:0/3154573430 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a2ffd640 1 -- 172.21.15.47:0/3154573430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590404d0 msgr2=0x55f259412cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590404d0 0x55f259412cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a2ffd640 1 -- 172.21.15.47:0/3154573430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 msgr2=0x55f259413860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259413860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a2ffd640 1 -- 172.21.15.47:0/3154573430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2590cc790 con 0x55f2590382f0 2024-09-21T00:59:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.625+0000 7f99a37fe640 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259413860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.626+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590382f0 0x55f259412630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9994011630 tx=0x7f99940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa5ceb5e4b4fdf1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.626+0000 7f9982ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.627+0000 7f9982ffd640 1 -- 172.21.15.47:0/3154573430 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994025020 con 0x55f2590382f0 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.627+0000 7f99b0a55740 1 -- 172.21.15.47:0/3154573430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f999c005020 con 0x55f2590382f0 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.627+0000 7f9982ffd640 1 -- 172.21.15.47:0/3154573430 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f9994021440 con 0x55f2590382f0 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.627+0000 7f9982ffd640 1 -- 172.21.15.47:0/3154573430 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9994021640 con 0x55f2590382f0 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.627+0000 7f99b0a55740 10 client.25246 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.627+0000 7f99b0a55740 1 -- 172.21.15.47:0/3154573430 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f259145620 con 0x55f2590382f0 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.627+0000 7f9982ffd640 1 -- 172.21.15.47:0/3154573430 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c005020 con 0x55f2590382f0 2024-09-21T00:59:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.628+0000 7f9982ffd640 1 -- 172.21.15.47:0/3154573430 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f999402c8f0 con 0x55f2590382f0 2024-09-21T00:59:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.628+0000 7f99b0a55740 10 client.25246 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.628+0000 7f99b0a55740 10 client.25246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.628+0000 7f99b0a55740 20 client.25246 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.628+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f25901fd80 0x55f2594285c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.628+0000 7f99b0a55740 4 client.25246 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.628+0000 7f99b0a55740 1 -- 172.21.15.47:0/3154573430 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f25937d640 con 0x55f25901fd80 2024-09-21T00:59:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.629+0000 7f99a27fc640 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f25901fd80 0x55f2594285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.630+0000 7f9982ffd640 10 client.25246 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.630+0000 7f99a27fc640 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f25901fd80 0x55f2594285c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c09adc1aeb7f57f server_cookie=de995178cd06f37 in_seq=0 out_seq=0 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.631+0000 7f9982ffd640 1 -- 172.21.15.47:0/3154573430 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f25937d640 con 0x55f25901fd80 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.631+0000 7f9982ffd640 10 client.25246 handle_command_reply: tid=0 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.631+0000 7f99b0a55740 1 client.25246 shutdown 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 -- 172.21.15.47:0/3154573430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590382f0 msgr2=0x55f259412630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590382f0 0x55f259412630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9994011630 tx=0x7f99940046c0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 -- 172.21.15.47:0/3154573430 shutdown_connections 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f25901fd80 0x55f2594285c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590611b0 0x55f259413860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590404d0 0x55f259412cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f9982ffd640 0 client.25246 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3154573430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590382f0 0x55f259412630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 -- 172.21.15.47:0/3154573430 >> 172.21.15.47:0/3154573430 conn(0x55f259055300 msgr2=0x55f259402ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 -- 172.21.15.47:0/3154573430 shutdown_connections 2024-09-21T00:59:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 1 -- 172.21.15.47:0/3154573430 wait complete. 2024-09-21T00:59:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.632+0000 7f99b0a55740 20 client.25246 trim_cache size 0 max 16384 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99b0a55740 1 Processor -- start 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99b0a55740 1 -- start start 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f25901fd80 0x55f259411830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2593ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590404d0 0x55f259403610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99b0a55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41a6c90 con 0x55f2590404d0 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99b0a55740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41a94f0 con 0x55f2590382f0 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99b0a55740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41a72e0 con 0x55f25901fd80 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590404d0 0x55f259403610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99a27fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2593ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590404d0 0x55f259403610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35270/0 (socket says 172.21.15.47:35270) 2024-09-21T00:59:53.649 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99a37fe640 1 -- 172.21.15.47:0/3498167686 learned_addr learned my addr 172.21.15.47:0/3498167686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.647+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f25901fd80 0x55f259411830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99a37fe640 1 -- 172.21.15.47:0/3498167686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f25901fd80 msgr2=0x55f259411830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99a37fe640 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f25901fd80 0x55f259411830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99a37fe640 1 -- 172.21.15.47:0/3498167686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 msgr2=0x55f2593ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99a37fe640 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2593ff5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99a37fe640 1 -- 172.21.15.47:0/3498167686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f259424e40 con 0x55f2590404d0 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99a27fc640 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2593ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99a37fe640 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590404d0 0x55f259403610 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ef60 tx=0x7f999c005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36dcac74c841d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99897fa640 1 -- 172.21.15.47:0/3498167686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c027020 con 0x55f2590404d0 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99897fa640 1 -- 172.21.15.47:0/3498167686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c003e20 con 0x55f2590404d0 2024-09-21T00:59:53.650 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.648+0000 7f99897fa640 1 -- 172.21.15.47:0/3498167686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c016040 con 0x55f2590404d0 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 -- 172.21.15.47:0/3498167686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590404d0 msgr2=0x55f259403610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590404d0 0x55f259403610 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ef60 tx=0x7f999c005ac0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 -- 172.21.15.47:0/3498167686 shutdown_connections 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2590404d0 0x55f259403610 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f2593ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 --2- 172.21.15.47:0/3498167686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f25901fd80 0x55f259411830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 -- 172.21.15.47:0/3498167686 >> 172.21.15.47:0/3498167686 conn(0x55f259055300 msgr2=0x55f259404220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 -- 172.21.15.47:0/3498167686 shutdown_connections 2024-09-21T00:59:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.649+0000 7f99b0a55740 1 -- 172.21.15.47:0/3498167686 wait complete. 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 1 -- start start 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 1 Processor -- start 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f25901fd80 0x55f2594174d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f259417b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f259418700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41a79b0 con 0x55f25901fd80 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41a8e20 con 0x55f2590382f0 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41a8080 con 0x55f2590404d0 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99b0a55740 10 client.0 _ll_register_callbacks cb 0x7f9994009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f25901fd80 0x55f2594174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f25901fd80 0x55f2594174d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35282/0 (socket says 172.21.15.47:35282) 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99a2ffd640 1 -- 172.21.15.47:0/2492423814 learned_addr learned my addr 172.21.15.47:0/2492423814 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99a27fc640 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f259417b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.650+0000 7f99a37fe640 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f259418700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99a2ffd640 1 -- 172.21.15.47:0/2492423814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 msgr2=0x55f259418700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f259418700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99a2ffd640 1 -- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 msgr2=0x55f259417b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f259417b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99a2ffd640 1 -- 172.21.15.47:0/2492423814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f259418e60 con 0x55f25901fd80 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99a27fc640 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f259417b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99a2ffd640 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f25901fd80 0x55f2594174d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9994004810 tx=0x7f9994021440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa2cb94813e4096 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f9982ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f9982ffd640 1 -- 172.21.15.47:0/2492423814 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994025040 con 0x55f25901fd80 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f9982ffd640 1 -- 172.21.15.47:0/2492423814 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f999402c640 con 0x55f25901fd80 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99b0a55740 1 -- 172.21.15.47:0/2492423814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f999c003e20 con 0x55f25901fd80 2024-09-21T00:59:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f9982ffd640 1 -- 172.21.15.47:0/2492423814 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9994015e60 con 0x55f25901fd80 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99b0a55740 10 client.15546 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f99b0a55740 1 -- 172.21.15.47:0/2492423814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f25941a180 con 0x55f25901fd80 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.651+0000 7f9982ffd640 1 -- 172.21.15.47:0/2492423814 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c003e20 con 0x55f25901fd80 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f9982ffd640 1 -- 172.21.15.47:0/2492423814 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9994041ba0 con 0x55f25901fd80 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f99b0a55740 10 client.15546 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f99b0a55740 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f99b0a55740 20 client.15546 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2590611b0 0x55f259495410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f99b0a55740 4 client.15546 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f99b0a55740 1 -- 172.21.15.47:0/2492423814 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f2593790f0 con 0x55f2590611b0 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f99a27fc640 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2590611b0 0x55f259495410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f9982ffd640 10 client.15546 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.652+0000 7f99a27fc640 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2590611b0 0x55f259495410 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=657d61c37f46fd5c server_cookie=d9d6a7dfcff796b0 in_seq=0 out_seq=0 2024-09-21T00:59:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f9982ffd640 1 -- 172.21.15.47:0/2492423814 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f2593790f0 con 0x55f2590611b0 2024-09-21T00:59:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f9982ffd640 10 client.15546 handle_command_reply: tid=0 2024-09-21T00:59:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 client.15546 shutdown 2024-09-21T00:59:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 -- 172.21.15.47:0/2492423814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f25901fd80 msgr2=0x55f2594174d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f25901fd80 0x55f2594174d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9994004810 tx=0x7f9994021440 comp rx=0 tx=0).stop 2024-09-21T00:59:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 -- 172.21.15.47:0/2492423814 shutdown_connections 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2590611b0 0x55f259495410 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2590404d0 0x55f259418700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2590382f0 0x55f259417b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f9982ffd640 0 client.15546 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 --2- 172.21.15.47:0/2492423814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f25901fd80 0x55f2594174d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 -- 172.21.15.47:0/2492423814 >> 172.21.15.47:0/2492423814 conn(0x55f259055300 msgr2=0x55f259404220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 -- 172.21.15.47:0/2492423814 shutdown_connections 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 1 -- 172.21.15.47:0/2492423814 wait complete. 2024-09-21T00:59:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.698+0000 7f99b0a55740 20 client.15546 trim_cache size 0 max 16384 2024-09-21T00:59:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T00:59:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T00:59:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T00:59:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T00:59:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 -- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f998c0b6600 msgr2=0x7f998c0b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f998c0b6600 0x7f998c0b8b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9994009af0 tx=0x7f9994008040 comp rx=0 tx=0).stop 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 -- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 msgr2=0x7f99a419c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 0x7f99a419c860 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9998031440 tx=0x7f9998003c10 comp rx=0 tx=0).stop 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 -- 172.21.15.47:0/920644082 shutdown_connections 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f998c0b6600 0x7f998c0b8b10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a41082f0 0x7f99a419d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99a41056d0 0x7f99a419c860 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 --2- 172.21.15.47:0/920644082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99a4102c50 0x7f99a419c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 -- 172.21.15.47:0/920644082 >> 172.21.15.47:0/920644082 conn(0x7f99a40fd680 msgr2=0x7f99a4103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 -- 172.21.15.47:0/920644082 shutdown_connections 2024-09-21T00:59:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T00:59:53.699+0000 7f99a9a0e640 1 -- 172.21.15.47:0/920644082 wait complete. 2024-09-21T00:59:54.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.148+0000 7f44ed356640 1 -- 172.21.15.47:0/2372968470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8109570 msgr2=0x7f44e8109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.148+0000 7f44ed356640 1 --2- 172.21.15.47:0/2372968470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8109570 0x7f44e8109980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009900 tx=0x7f44dc02a410 comp rx=0 tx=0).stop 2024-09-21T00:59:54.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.149+0000 7f44ed356640 1 -- 172.21.15.47:0/2372968470 shutdown_connections 2024-09-21T00:59:54.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.149+0000 7f44ed356640 1 --2- 172.21.15.47:0/2372968470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e8109ec0 0x7f44e81106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.149+0000 7f44ed356640 1 --2- 172.21.15.47:0/2372968470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8109570 0x7f44e8109980 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.149+0000 7f44ed356640 1 --2- 172.21.15.47:0/2372968470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e8103c30 0x7f44e8104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.149+0000 7f44ed356640 1 -- 172.21.15.47:0/2372968470 >> 172.21.15.47:0/2372968470 conn(0x7f44e807b8d0 msgr2=0x7f44e807bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.149+0000 7f44ed356640 1 -- 172.21.15.47:0/2372968470 shutdown_connections 2024-09-21T00:59:54.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.149+0000 7f44ed356640 1 -- 172.21.15.47:0/2372968470 wait complete. 2024-09-21T00:59:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.151+0000 7f44ed356640 1 Processor -- start 2024-09-21T00:59:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.152+0000 7f44ed356640 1 -- start start 2024-09-21T00:59:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.152+0000 7f44ed356640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8103c30 0x7f44e810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.152+0000 7f44ed356640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e8109570 0x7f44e810a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.152+0000 7f44ed356640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e8109ec0 0x7f44e810ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.152+0000 7f44ed356640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8113b00 con 0x7f44e8103c30 2024-09-21T00:59:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.152+0000 7f44ed356640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8113980 con 0x7f44e8109ec0 2024-09-21T00:59:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.152+0000 7f44ed356640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8113c80 con 0x7f44e8109570 2024-09-21T00:59:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8103c30 0x7f44e810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8103c30 0x7f44e810e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35294/0 (socket says 172.21.15.47:35294) 2024-09-21T00:59:54.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e6ffd640 1 -- 172.21.15.47:0/3815974979 learned_addr learned my addr 172.21.15.47:0/3815974979 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e67fc640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e8109570 0x7f44e810a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e77fe640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e8109ec0 0x7f44e810ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e6ffd640 1 -- 172.21.15.47:0/3815974979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e8109570 msgr2=0x7f44e810a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e8109570 0x7f44e810a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e6ffd640 1 -- 172.21.15.47:0/3815974979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e8109ec0 msgr2=0x7f44e810ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e8109ec0 0x7f44e810ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.153+0000 7f44e6ffd640 1 -- 172.21.15.47:0/3815974979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e81acce0 con 0x7f44e8103c30 2024-09-21T00:59:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.154+0000 7f44e77fe640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e8109ec0 0x7f44e810ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T00:59:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.154+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8103c30 0x7f44e810e3e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f44d800b4a0 tx=0x7f44d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.154+0000 7f44cffff640 1 -- 172.21.15.47:0/3815974979 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8014070 con 0x7f44e8103c30 2024-09-21T00:59:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.154+0000 7f44cffff640 1 -- 172.21.15.47:0/3815974979 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44d8010ac0 con 0x7f44e8103c30 2024-09-21T00:59:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.154+0000 7f44cffff640 1 -- 172.21.15.47:0/3815974979 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8017c30 con 0x7f44e8103c30 2024-09-21T00:59:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.154+0000 7f44ed356640 1 -- 172.21.15.47:0/3815974979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e81aceb0 con 0x7f44e8103c30 2024-09-21T00:59:54.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.155+0000 7f44ed356640 1 -- 172.21.15.47:0/3815974979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e81ad330 con 0x7f44e8103c30 2024-09-21T00:59:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.162+0000 7f44cffff640 1 -- 172.21.15.47:0/3815974979 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f44d8017070 con 0x7f44e8103c30 2024-09-21T00:59:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.162+0000 7f44f38ca740 1 Processor -- start 2024-09-21T00:59:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.163+0000 7f44f38ca740 1 -- start start 2024-09-21T00:59:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.165+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775c2350 0x55a777969430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.165+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777599490 0x55a777969970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.165+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777969eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.165+0000 7f44f38ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a7778dfe60 con 0x55a7775a1670 2024-09-21T00:59:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.165+0000 7f44f38ca740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a7778cf290 con 0x55a7775c2350 2024-09-21T00:59:54.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.166+0000 7f44f38ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a7778d30a0 con 0x55a777599490 2024-09-21T00:59:54.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.166+0000 7f44e67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777969eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.166+0000 7f44e67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777969eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35302/0 (socket says 172.21.15.47:35302) 2024-09-21T00:59:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.166+0000 7f44e67fc640 1 -- 172.21.15.47:0/565025690 learned_addr learned my addr 172.21.15.47:0/565025690 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.166+0000 7f44cffff640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f44d00b66e0 0x7f44d00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.166+0000 7f44e77fe640 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775c2350 0x55a777969430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.166+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777599490 0x55a777969970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.167+0000 7f44e77fe640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f44d00b66e0 0x7f44d00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.167+0000 7f44e67fc640 1 -- 172.21.15.47:0/565025690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777599490 msgr2=0x55a777969970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.167+0000 7f44e67fc640 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777599490 0x55a777969970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.167+0000 7f44e67fc640 1 -- 172.21.15.47:0/565025690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775c2350 msgr2=0x55a777969430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.167+0000 7f44e67fc640 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775c2350 0x55a777969430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.167+0000 7f44e67fc640 1 -- 172.21.15.47:0/565025690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77762d930 con 0x55a7775a1670 2024-09-21T00:59:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.167+0000 7f44cffff640 1 -- 172.21.15.47:0/3815974979 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f44d80e64e0 con 0x7f44e8103c30 2024-09-21T00:59:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.168+0000 7f44e67fc640 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777969eb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0096c0 tx=0x7f44dc032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b4965efd28d6e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.168+0000 7f44e77fe640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f44d00b66e0 0x7f44d00b8bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f44e0005fd0 tx=0x7f44e0004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.168+0000 7f44cd7fa640 1 -- 172.21.15.47:0/565025690 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc03f070 con 0x55a7775a1670 2024-09-21T00:59:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.168+0000 7f44cd7fa640 1 -- 172.21.15.47:0/565025690 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44dc0044d0 con 0x55a7775a1670 2024-09-21T00:59:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.168+0000 7f44cd7fa640 1 -- 172.21.15.47:0/565025690 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc035070 con 0x55a7775a1670 2024-09-21T00:59:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.169+0000 7f44f38ca740 1 -- 172.21.15.47:0/565025690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 msgr2=0x55a777969eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.169+0000 7f44f38ca740 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777969eb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0096c0 tx=0x7f44dc032cf0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.170+0000 7f44f38ca740 1 -- 172.21.15.47:0/565025690 shutdown_connections 2024-09-21T00:59:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.170+0000 7f44f38ca740 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777969eb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.170+0000 7f44f38ca740 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777599490 0x55a777969970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.170+0000 7f44f38ca740 1 --2- 172.21.15.47:0/565025690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775c2350 0x55a777969430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.170+0000 7f44f38ca740 1 -- 172.21.15.47:0/565025690 >> 172.21.15.47:0/565025690 conn(0x55a7775b6740 msgr2=0x55a777967320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.170+0000 7f44f38ca740 1 -- 172.21.15.47:0/565025690 shutdown_connections 2024-09-21T00:59:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.170+0000 7f44f38ca740 1 -- 172.21.15.47:0/565025690 wait complete. 2024-09-21T00:59:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.171+0000 7f44f38ca740 1 -- start start 2024-09-21T00:59:54.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.171+0000 7f44f38ca740 1 Processor -- start 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.171+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777975000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.171+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777975540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775c2350 0x55a777980ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44f38ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a777730890 con 0x55a7775a1670 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44f38ca740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a777869d40 con 0x55a777599490 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44f38ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a777977bb0 con 0x55a7775c2350 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44f38ca740 10 client.0 _ll_register_callbacks cb 0x55a7778cdc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777975000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777975540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777975000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:37392/0 (socket says 172.21.15.47:37392) 2024-09-21T00:59:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e6ffd640 1 -- 172.21.15.47:0/1542004456 learned_addr learned my addr 172.21.15.47:0/1542004456 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e77fe640 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775c2350 0x55a777980ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e67fc640 1 -- 172.21.15.47:0/1542004456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775c2350 msgr2=0x55a777980ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e67fc640 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775c2350 0x55a777980ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e67fc640 1 -- 172.21.15.47:0/1542004456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 msgr2=0x55a777975000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e67fc640 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777975000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.172+0000 7f44e67fc640 1 -- 172.21.15.47:0/1542004456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a777981490 con 0x55a7775a1670 2024-09-21T00:59:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.173+0000 7f44e67fc640 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777975540 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f44dc02a930 tx=0x7f44dc02aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1628c2bbc36ed6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.173+0000 7f44caff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.173+0000 7f44caff5640 1 -- 172.21.15.47:0/1542004456 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc03f070 con 0x55a7775a1670 2024-09-21T00:59:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.173+0000 7f44caff5640 1 -- 172.21.15.47:0/1542004456 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f44dc005460 con 0x55a7775a1670 2024-09-21T00:59:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.174+0000 7f44f38ca740 1 -- 172.21.15.47:0/1542004456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44dc0044d0 con 0x55a7775a1670 2024-09-21T00:59:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.174+0000 7f44caff5640 1 -- 172.21.15.47:0/1542004456 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f44dc035040 con 0x55a7775a1670 2024-09-21T00:59:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.174+0000 7f44f38ca740 10 client.15558 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.174+0000 7f44f38ca740 1 -- 172.21.15.47:0/1542004456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a777983da0 con 0x55a7775a1670 2024-09-21T00:59:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.175+0000 7f44caff5640 1 -- 172.21.15.47:0/1542004456 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44dc047030 con 0x55a7775a1670 2024-09-21T00:59:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.175+0000 7f44caff5640 1 -- 172.21.15.47:0/1542004456 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f44dc03b6d0 con 0x55a7775a1670 2024-09-21T00:59:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.175+0000 7f44f38ca740 10 client.15558 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.175+0000 7f44f38ca740 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.175+0000 7f44f38ca740 20 client.15558 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.175+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a777580cd0 0x55a777987100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.175+0000 7f44f38ca740 4 client.15558 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.175+0000 7f44f38ca740 1 -- 172.21.15.47:0/1542004456 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f44dc0044d0 con 0x55a777580cd0 2024-09-21T00:59:54.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.176+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a777580cd0 0x55a777987100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.179+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a777580cd0 0x55a777987100 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e939ccb1fe838d0 server_cookie=3be99af55bd32c38 in_seq=0 out_seq=0 2024-09-21T00:59:54.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.179+0000 7f44caff5640 10 client.15558 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:54.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.180+0000 7f44caff5640 1 -- 172.21.15.47:0/1542004456 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f44dc0044d0 con 0x55a777580cd0 2024-09-21T00:59:54.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.180+0000 7f44caff5640 10 client.15558 handle_command_reply: tid=0 2024-09-21T00:59:54.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.180+0000 7f44f38ca740 1 client.15558 shutdown 2024-09-21T00:59:54.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44f38ca740 1 -- 172.21.15.47:0/1542004456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 msgr2=0x55a777975540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777975540 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f44dc02a930 tx=0x7f44dc02aa90 comp rx=0 tx=0).stop 2024-09-21T00:59:54.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44f38ca740 1 -- 172.21.15.47:0/1542004456 shutdown_connections 2024-09-21T00:59:54.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a777580cd0 0x55a777987100 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44caff5640 0 client.15558 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:54.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775c2350 0x55a777980ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a7775a1670 0x55a777975540 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1542004456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777975000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.181+0000 7f44f38ca740 1 -- 172.21.15.47:0/1542004456 >> 172.21.15.47:0/1542004456 conn(0x55a7775b6740 msgr2=0x55a77796c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.182+0000 7f44f38ca740 1 -- 172.21.15.47:0/1542004456 shutdown_connections 2024-09-21T00:59:54.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.182+0000 7f44f38ca740 1 -- 172.21.15.47:0/1542004456 wait complete. 2024-09-21T00:59:54.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.182+0000 7f44f38ca740 20 client.15558 trim_cache size 0 max 16384 2024-09-21T00:59:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.208+0000 7f44f38ca740 1 Processor -- start 2024-09-21T00:59:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.208+0000 7f44f38ca740 1 -- start start 2024-09-21T00:59:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.208+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777580cd0 0x55a77796f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.208+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777974690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775a1670 0x55a777976a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44f38ca740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81b3960 con 0x55a777580cd0 2024-09-21T00:59:54.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777974690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777974690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:37408/0 (socket says 172.21.15.47:37408) 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e67fc640 1 -- 172.21.15.47:0/3200606184 learned_addr learned my addr 172.21.15.47:0/3200606184 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777580cd0 0x55a77796f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44f38ca740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81b6190 con 0x55a777599490 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44f38ca740 1 -- 172.21.15.47:0/3200606184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81b3fd0 con 0x55a7775a1670 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e77fe640 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775a1670 0x55a777976a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e6ffd640 1 -- 172.21.15.47:0/3200606184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775a1670 msgr2=0x55a777976a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775a1670 0x55a777976a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e6ffd640 1 -- 172.21.15.47:0/3200606184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 msgr2=0x55a777974690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777974690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.209+0000 7f44e6ffd640 1 -- 172.21.15.47:0/3200606184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7779760c0 con 0x55a777580cd0 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.210+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777580cd0 0x55a77796f550 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f44d80ac370 tx=0x7f44d8076190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd8c67d0e3f0cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.210+0000 7f44ccff9640 1 -- 172.21.15.47:0/3200606184 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d801e040 con 0x55a777580cd0 2024-09-21T00:59:54.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.210+0000 7f44ccff9640 1 -- 172.21.15.47:0/3200606184 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44d8070c90 con 0x55a777580cd0 2024-09-21T00:59:54.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.210+0000 7f44ccff9640 1 -- 172.21.15.47:0/3200606184 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8010c70 con 0x55a777580cd0 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.211+0000 7f44f38ca740 1 -- 172.21.15.47:0/3200606184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777580cd0 msgr2=0x55a77796f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.211+0000 7f44f38ca740 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777580cd0 0x55a77796f550 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f44d80ac370 tx=0x7f44d8076190 comp rx=0 tx=0).stop 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.211+0000 7f44f38ca740 1 -- 172.21.15.47:0/3200606184 shutdown_connections 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.211+0000 7f44f38ca740 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a7775a1670 0x55a777976a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.211+0000 7f44f38ca740 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a777599490 0x55a777974690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.211+0000 7f44f38ca740 1 --2- 172.21.15.47:0/3200606184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777580cd0 0x55a77796f550 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.212+0000 7f44f38ca740 1 -- 172.21.15.47:0/3200606184 >> 172.21.15.47:0/3200606184 conn(0x55a7775b6740 msgr2=0x55a777976320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.212+0000 7f44f38ca740 1 -- 172.21.15.47:0/3200606184 shutdown_connections 2024-09-21T00:59:54.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.212+0000 7f44f38ca740 1 -- 172.21.15.47:0/3200606184 wait complete. 2024-09-21T00:59:54.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.213+0000 7f44f38ca740 1 -- start start 2024-09-21T00:59:54.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.213+0000 7f44f38ca740 1 Processor -- start 2024-09-21T00:59:54.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.214+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777580cd0 0x55a77798ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.214+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777599490 0x55a777988040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44f38ca740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775a1670 0x55a777988750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44e6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777580cd0 0x55a77798ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44e6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777580cd0 0x55a77798ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:50956/0 (socket says 172.21.15.47:50956) 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44e67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777599490 0x55a777988040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44e67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777599490 0x55a777988040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35326/0 (socket says 172.21.15.47:35326) 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44e6ffd640 1 -- 172.21.15.47:0/1270233469 learned_addr learned my addr 172.21.15.47:0/1270233469 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81b4650 con 0x55a777599490 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81b5ac0 con 0x55a7775a1670 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.215+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81b4d20 con 0x55a777580cd0 2024-09-21T00:59:54.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.216+0000 7f44f38ca740 10 client.0 _ll_register_callbacks cb 0x7f44e0008650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.216+0000 7f44e67fc640 1 -- 172.21.15.47:0/1270233469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777580cd0 msgr2=0x55a77798ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.216+0000 7f44e67fc640 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777580cd0 0x55a77798ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.216+0000 7f44e67fc640 1 -- 172.21.15.47:0/1270233469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775a1670 msgr2=0x55a777988750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.216+0000 7f44e67fc640 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775a1670 0x55a777988750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.216+0000 7f44e67fc640 1 -- 172.21.15.47:0/1270233469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7779f0880 con 0x55a777599490 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.216+0000 7f44e67fc640 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777599490 0x55a777988040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0059d0 tx=0x7f44dc009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35060fe2ede27a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.216+0000 7f44caff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.217+0000 7f44caff5640 1 -- 172.21.15.47:0/1270233469 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc03f040 con 0x55a777599490 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.217+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44d8070c90 con 0x55a777599490 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.217+0000 7f44caff5640 1 -- 172.21.15.47:0/1270233469 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f44dc03b660 con 0x55a777599490 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.217+0000 7f44caff5640 1 -- 172.21.15.47:0/1270233469 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f44dc032bb0 con 0x55a777599490 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.217+0000 7f44f38ca740 10 client.15564 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:54.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.217+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a7779f1a10 con 0x55a777599490 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.217+0000 7f44caff5640 1 -- 172.21.15.47:0/1270233469 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44d8070c90 con 0x55a777599490 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.218+0000 7f44caff5640 1 -- 172.21.15.47:0/1270233469 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f44dc0046c0 con 0x55a777599490 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.218+0000 7f44f38ca740 10 client.15564 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.218+0000 7f44f38ca740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.218+0000 7f44f38ca740 20 client.15564 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.218+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a7775c2350 0x55a7779f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.218+0000 7f44f38ca740 4 client.15564 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.218+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a7778e1db0 con 0x55a7775c2350 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.219+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a7775c2350 0x55a7779f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.219+0000 7f44caff5640 10 client.15564 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:54.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.219+0000 7f44e6ffd640 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a7775c2350 0x55a7779f40e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc66a878fde67303 server_cookie=609ca60b96418d2b in_seq=0 out_seq=0 2024-09-21T00:59:54.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.222+0000 7f44caff5640 1 -- 172.21.15.47:0/1270233469 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a7778e1db0 con 0x55a7775c2350 2024-09-21T00:59:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44caff5640 10 client.15564 handle_command_reply: tid=0 2024-09-21T00:59:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 client.15564 shutdown 2024-09-21T00:59:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777599490 msgr2=0x55a777988040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777599490 0x55a777988040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0059d0 tx=0x7f44dc009560 comp rx=0 tx=0).stop 2024-09-21T00:59:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 shutdown_connections 2024-09-21T00:59:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a7775c2350 0x55a7779f40e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a7775a1670 0x55a777988750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a777599490 0x55a777988040 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 --2- 172.21.15.47:0/1270233469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a777580cd0 0x55a77798ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.223+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 >> 172.21.15.47:0/1270233469 conn(0x55a7775b6740 msgr2=0x55a777976290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.224+0000 7f44caff5640 0 client.15564 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.224+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 shutdown_connections 2024-09-21T00:59:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.224+0000 7f44f38ca740 1 -- 172.21.15.47:0/1270233469 wait complete. 2024-09-21T00:59:54.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.225+0000 7f44f38ca740 20 client.15564 trim_cache size 0 max 16384 2024-09-21T00:59:54.226 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:59:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-09-21T00:59:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "7a754496-3920-4c5b-9027-06e8a64287e6", 2024-09-21T00:59:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-09-21T00:59:54.227 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 -- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f44d00b66e0 msgr2=0x7f44d00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f44d00b66e0 0x7f44d00b8bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f44e0005fd0 tx=0x7f44e0004ab0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 -- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8103c30 msgr2=0x7f44e810e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8103c30 0x7f44e810e3e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f44d800b4a0 tx=0x7f44d800b960 comp rx=0 tx=0).stop 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 -- 172.21.15.47:0/3815974979 shutdown_connections 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f44d00b66e0 0x7f44d00b8bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e8109ec0 0x7f44e810ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e8109570 0x7f44e810a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 --2- 172.21.15.47:0/3815974979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44e8103c30 0x7f44e810e3e0 secure :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f44d800b4a0 tx=0x7f44d800b960 comp rx=0 tx=0).stop 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.226+0000 7f44ed356640 1 -- 172.21.15.47:0/3815974979 >> 172.21.15.47:0/3815974979 conn(0x7f44e807b8d0 msgr2=0x7f44e8107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:54.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.227+0000 7f44ed356640 1 -- 172.21.15.47:0/3815974979 shutdown_connections 2024-09-21T00:59:54.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:54.227+0000 7f44ed356640 1 -- 172.21.15.47:0/3815974979 wait complete. 2024-09-21T00:59:54.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:54 smithi047 ceph-mon[30960]: pgmap v381: 97 pgs: 97 active+clean; 55 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 4.6 MiB/s wr, 125 op/s 2024-09-21T00:59:54.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:54 smithi134 ceph-mon[34785]: pgmap v381: 97 pgs: 97 active+clean; 55 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 4.6 MiB/s wr, 125 op/s 2024-09-21T00:59:54.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:54 smithi114 ceph-mon[34309]: pgmap v381: 97 pgs: 97 active+clean; 55 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 4.6 MiB/s wr, 125 op/s 2024-09-21T00:59:55.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:55 smithi134 ceph-mon[34785]: scrub queued for path: / 2024-09-21T00:59:55.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:55 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:55.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:55 smithi134 ceph-mon[34785]: scrub summary: active paths [/] 2024-09-21T00:59:55.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:55 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:55.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:55 smithi114 ceph-mon[34309]: scrub queued for path: / 2024-09-21T00:59:55.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:55 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:55.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:55 smithi114 ceph-mon[34309]: scrub summary: active paths [/] 2024-09-21T00:59:55.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:55 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:55.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:55 smithi047 ceph-mon[30960]: scrub queued for path: / 2024-09-21T00:59:55.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:55 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:55.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:55 smithi047 ceph-mon[30960]: scrub summary: active paths [/] 2024-09-21T00:59:55.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:55 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T00:59:56.325 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T00:59:56.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:56 smithi047 ceph-mon[30960]: pgmap v382: 97 pgs: 97 active+clean; 383 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 32 MiB/s wr, 90 op/s 2024-09-21T00:59:56.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:59:56.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:56 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.799 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T00:59:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:56 smithi134 ceph-mon[34785]: pgmap v382: 97 pgs: 97 active+clean; 383 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 32 MiB/s wr, 90 op/s 2024-09-21T00:59:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:59:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:56 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:56 smithi114 ceph-mon[34309]: pgmap v382: 97 pgs: 97 active+clean; 383 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 32 MiB/s wr, 90 op/s 2024-09-21T00:59:56.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T00:59:56.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:56.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:56 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.426+0000 7f868512b640 1 -- 172.21.15.47:0/615573896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 msgr2=0x7f868010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.426+0000 7f868512b640 1 --2- 172.21.15.47:0/615573896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 0x7f868010d850 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8670009900 tx=0x7f867002a410 comp rx=0 tx=0).stop 2024-09-21T00:59:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.427+0000 7f868512b640 1 -- 172.21.15.47:0/615573896 shutdown_connections 2024-09-21T00:59:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.427+0000 7f868512b640 1 --2- 172.21.15.47:0/615573896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f868010de10 0x7f8680110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.427+0000 7f868512b640 1 --2- 172.21.15.47:0/615573896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 0x7f868010d850 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.427+0000 7f868512b640 1 --2- 172.21.15.47:0/615573896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86801049b0 0x7f8680104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.427+0000 7f868512b640 1 -- 172.21.15.47:0/615573896 >> 172.21.15.47:0/615573896 conn(0x7f8680079730 msgr2=0x7f8680079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.427+0000 7f868512b640 1 -- 172.21.15.47:0/615573896 shutdown_connections 2024-09-21T00:59:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.427+0000 7f868512b640 1 -- 172.21.15.47:0/615573896 wait complete. 2024-09-21T00:59:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.428+0000 7f868512b640 1 Processor -- start 2024-09-21T00:59:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.428+0000 7f868512b640 1 -- start start 2024-09-21T00:59:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.428+0000 7f868512b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801049b0 0x7f86801026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.428+0000 7f868512b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 0x7f8680102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.428+0000 7f868512b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f868010de10 0x7f8680103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.428+0000 7f868512b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8680113b50 con 0x7f8680105300 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.428+0000 7f868512b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86801139d0 con 0x7f868010de10 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.428+0000 7f868512b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8680113cd0 con 0x7f86801049b0 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.429+0000 7f867e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 0x7f8680102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.429+0000 7f867e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 0x7f8680102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35338/0 (socket says 172.21.15.47:35338) 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.429+0000 7f867e59c640 1 -- 172.21.15.47:0/475633218 learned_addr learned my addr 172.21.15.47:0/475633218 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.429+0000 7f867e59c640 1 -- 172.21.15.47:0/475633218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801049b0 msgr2=0x7f86801026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.429+0000 7f867e59c640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801049b0 0x7f86801026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.429+0000 7f867e59c640 1 -- 172.21.15.47:0/475633218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f868010de10 msgr2=0x7f8680103170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.429+0000 7f867e59c640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f868010de10 0x7f8680103170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.429+0000 7f867e59c640 1 -- 172.21.15.47:0/475633218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86801a88e0 con 0x7f8680105300 2024-09-21T00:59:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.430+0000 7f867e59c640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 0x7f8680102c30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f867002a930 tx=0x7f8670004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.431+0000 7f8667fff640 1 -- 172.21.15.47:0/475633218 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867003f030 con 0x7f8680105300 2024-09-21T00:59:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.431+0000 7f8667fff640 1 -- 172.21.15.47:0/475633218 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8670003cb0 con 0x7f8680105300 2024-09-21T00:59:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.431+0000 7f8667fff640 1 -- 172.21.15.47:0/475633218 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670035070 con 0x7f8680105300 2024-09-21T00:59:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.431+0000 7f868512b640 1 -- 172.21.15.47:0/475633218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86801a8b70 con 0x7f8680105300 2024-09-21T00:59:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.431+0000 7f868512b640 1 -- 172.21.15.47:0/475633218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86801a9000 con 0x7f8680105300 2024-09-21T00:59:57.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.435+0000 7f868b69f740 1 Processor -- start 2024-09-21T00:59:57.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.435+0000 7f868b69f740 1 -- start start 2024-09-21T00:59:57.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.435+0000 7f868b69f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3af070 0x563b4e75ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.435+0000 7f868b69f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e75efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.435+0000 7f868b69f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e75f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.435+0000 7f868b69f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563b4e6cce50 con 0x563b4e3af070 2024-09-21T00:59:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.435+0000 7f868b69f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x563b4e6bc280 con 0x563b4e38e390 2024-09-21T00:59:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.435+0000 7f868b69f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b4e6c0090 con 0x563b4e3861b0 2024-09-21T00:59:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f867f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3af070 0x563b4e75ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f8667fff640 1 -- 172.21.15.47:0/475633218 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8670042030 con 0x7f8680105300 2024-09-21T00:59:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f867f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3af070 0x563b4e75ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35344/0 (socket says 172.21.15.47:35344) 2024-09-21T00:59:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f867f59e640 1 -- 172.21.15.47:0/1452660387 learned_addr learned my addr 172.21.15.47:0/1452660387 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:57.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f867f59e640 1 -- 172.21.15.47:0/1452660387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 msgr2=0x563b4e75efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f867f59e640 1 --2- 172.21.15.47:0/1452660387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e75efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f867f59e640 1 -- 172.21.15.47:0/1452660387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 msgr2=0x563b4e75f500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T00:59:57.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f867f59e640 1 --2- 172.21.15.47:0/1452660387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e75f500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.436+0000 7f867f59e640 1 -- 172.21.15.47:0/1452660387 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4e41a650 con 0x563b4e3af070 2024-09-21T00:59:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.437+0000 7f867f59e640 1 --2- 172.21.15.47:0/1452660387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3af070 0x563b4e75ea80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8678009d00 tx=0x7f867800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11aa67f54eb28ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.437+0000 7f86657fa640 1 -- 172.21.15.47:0/1452660387 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867800bd40 con 0x563b4e3af070 2024-09-21T00:59:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.438+0000 7f86657fa640 1 -- 172.21.15.47:0/1452660387 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8678017070 con 0x563b4e3af070 2024-09-21T00:59:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.438+0000 7f8667fff640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f86680b6590 0x7f86680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.438+0000 7f867ed9d640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f86680b6590 0x7f86680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.438+0000 7f8667fff640 1 -- 172.21.15.47:0/475633218 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8670107200 con 0x7f8680105300 2024-09-21T00:59:57.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.440+0000 7f86657fa640 1 -- 172.21.15.47:0/1452660387 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86780115d0 con 0x563b4e3af070 2024-09-21T00:59:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.440+0000 7f868b69f740 1 -- 172.21.15.47:0/1452660387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3af070 msgr2=0x563b4e75ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.440+0000 7f867ed9d640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f86680b6590 0x7f86680b8aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x563b4e75d700 tx=0x7f8674006cb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.440+0000 7f868b69f740 1 --2- 172.21.15.47:0/1452660387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3af070 0x563b4e75ea80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8678009d00 tx=0x7f867800b420 comp rx=0 tx=0).stop 2024-09-21T00:59:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.441+0000 7f868b69f740 1 -- 172.21.15.47:0/1452660387 shutdown_connections 2024-09-21T00:59:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.441+0000 7f868b69f740 1 --2- 172.21.15.47:0/1452660387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e75f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.441+0000 7f868b69f740 1 --2- 172.21.15.47:0/1452660387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e75efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.441+0000 7f868b69f740 1 --2- 172.21.15.47:0/1452660387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3af070 0x563b4e75ea80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.441+0000 7f868b69f740 1 -- 172.21.15.47:0/1452660387 >> 172.21.15.47:0/1452660387 conn(0x563b4e3a3460 msgr2=0x563b4e75c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.441+0000 7f868b69f740 1 -- 172.21.15.47:0/1452660387 shutdown_connections 2024-09-21T00:59:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.441+0000 7f868b69f740 1 -- 172.21.15.47:0/1452660387 wait complete. 2024-09-21T00:59:57.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.442+0000 7f868b69f740 1 -- start start 2024-09-21T00:59:57.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.442+0000 7f868b69f740 1 Processor -- start 2024-09-21T00:59:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.442+0000 7f868b69f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e76a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.442+0000 7f868b69f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e38e390 0x563b4e76a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f868b69f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e3af070 0x563b4e76ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f868b69f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563b4e51d700 con 0x563b4e38e390 2024-09-21T00:59:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f868b69f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x563b4e657110 con 0x563b4e3af070 2024-09-21T00:59:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f868b69f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b4e76d300 con 0x563b4e3861b0 2024-09-21T00:59:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f868b69f740 10 client.0 _ll_register_callbacks cb 0x563b4e670990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f867ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e76a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f867e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e38e390 0x563b4e76a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f867ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e76a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:50980/0 (socket says 172.21.15.47:50980) 2024-09-21T00:59:57.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.443+0000 7f867ed9d640 1 -- 172.21.15.47:0/484181813 learned_addr learned my addr 172.21.15.47:0/484181813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:57.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.444+0000 7f867e59c640 1 -- 172.21.15.47:0/484181813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 msgr2=0x563b4e76a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.444+0000 7f867e59c640 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e76a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.444+0000 7f867e59c640 1 -- 172.21.15.47:0/484181813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e3af070 msgr2=0x563b4e76ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.444+0000 7f867e59c640 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e3af070 0x563b4e76ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.444+0000 7f867e59c640 1 -- 172.21.15.47:0/484181813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4e684c40 con 0x563b4e38e390 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.445+0000 7f867e59c640 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e38e390 0x563b4e76a6e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8670104df0 tx=0x7f86700c9390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae0c8ab4bac2e7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.445+0000 7f8662ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.445+0000 7f8662ff5640 1 -- 172.21.15.47:0/484181813 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670049040 con 0x563b4e38e390 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.445+0000 7f868b69f740 1 -- 172.21.15.47:0/484181813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8678017070 con 0x563b4e38e390 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.445+0000 7f8662ff5640 1 -- 172.21.15.47:0/484181813 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f867003bde0 con 0x563b4e38e390 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.446+0000 7f8662ff5640 1 -- 172.21.15.47:0/484181813 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f86700ccf40 con 0x563b4e38e390 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.446+0000 7f868b69f740 10 client.15576 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.446+0000 7f868b69f740 1 -- 172.21.15.47:0/484181813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563b4e779020 con 0x563b4e38e390 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.446+0000 7f8662ff5640 1 -- 172.21.15.47:0/484181813 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8678017070 con 0x563b4e38e390 2024-09-21T00:59:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.447+0000 7f8662ff5640 1 -- 172.21.15.47:0/484181813 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f86700c7b30 con 0x563b4e38e390 2024-09-21T00:59:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.447+0000 7f868b69f740 10 client.15576 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.447+0000 7f868b69f740 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.447+0000 7f868b69f740 20 client.15576 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.447+0000 7f868b69f740 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x563b4e36d9f0 0x563b4e77c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.447+0000 7f868b69f740 4 client.15576 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T00:59:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.447+0000 7f868b69f740 1 -- 172.21.15.47:0/484181813 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b4e6ceda0 con 0x563b4e36d9f0 2024-09-21T00:59:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.448+0000 7f867ed9d640 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x563b4e36d9f0 0x563b4e77c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.449+0000 7f867ed9d640 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x563b4e36d9f0 0x563b4e77c4c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25aa3288fb12746 server_cookie=e15c48cdddf1ed33 in_seq=0 out_seq=0 2024-09-21T00:59:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.449+0000 7f8662ff5640 10 client.15576 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:57.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.450+0000 7f8662ff5640 1 -- 172.21.15.47:0/484181813 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b4e6ceda0 con 0x563b4e36d9f0 2024-09-21T00:59:57.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.451+0000 7f8662ff5640 10 client.15576 handle_command_reply: tid=0 2024-09-21T00:59:57.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.451+0000 7f868b69f740 1 client.15576 shutdown 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 -- 172.21.15.47:0/484181813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e38e390 msgr2=0x563b4e76a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e38e390 0x563b4e76a6e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8670104df0 tx=0x7f86700c9390 comp rx=0 tx=0).stop 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 -- 172.21.15.47:0/484181813 shutdown_connections 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x563b4e36d9f0 0x563b4e77c4c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f8662ff5640 0 client.15576 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e3af070 0x563b4e76ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e38e390 0x563b4e76a6e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 --2- 172.21.15.47:0/484181813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e76a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 -- 172.21.15.47:0/484181813 >> 172.21.15.47:0/484181813 conn(0x563b4e3a3460 msgr2=0x563b4e75fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 -- 172.21.15.47:0/484181813 shutdown_connections 2024-09-21T00:59:57.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 1 -- 172.21.15.47:0/484181813 wait complete. 2024-09-21T00:59:57.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.452+0000 7f868b69f740 20 client.15576 trim_cache size 0 max 16384 2024-09-21T00:59:57.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.481+0000 7f868b69f740 1 Processor -- start 2024-09-21T00:59:57.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.481+0000 7f868b69f740 1 -- start start 2024-09-21T00:59:57.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.481+0000 7f868b69f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e36d9f0 0x563b4e75c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.481+0000 7f868b69f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e767540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f868b69f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e767a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f868b69f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86801ab0d0 con 0x563b4e36d9f0 2024-09-21T00:59:57.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f868b69f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86801ad930 con 0x563b4e38e390 2024-09-21T00:59:57.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f868b69f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86801ab720 con 0x563b4e3861b0 2024-09-21T00:59:57.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f867ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e36d9f0 0x563b4e75c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f867ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e36d9f0 0x563b4e75c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35362/0 (socket says 172.21.15.47:35362) 2024-09-21T00:59:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f867ed9d640 1 -- 172.21.15.47:0/74761896 learned_addr learned my addr 172.21.15.47:0/74761896 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f867e59c640 1 --2- 172.21.15.47:0/74761896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e767540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.482+0000 7f867ed9d640 1 -- 172.21.15.47:0/74761896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 msgr2=0x563b4e767540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.483+0000 7f867ed9d640 1 --2- 172.21.15.47:0/74761896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e767540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.483+0000 7f867ed9d640 1 -- 172.21.15.47:0/74761896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 msgr2=0x563b4e767a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.483+0000 7f867ed9d640 1 --2- 172.21.15.47:0/74761896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e767a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.483+0000 7f867ed9d640 1 -- 172.21.15.47:0/74761896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4e7686a0 con 0x563b4e36d9f0 2024-09-21T00:59:57.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.483+0000 7f867ed9d640 1 --2- 172.21.15.47:0/74761896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e36d9f0 0x563b4e75c8d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8674013b80 tx=0x7f8674012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f06f9e4ea17411 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.483+0000 7f8664ff9640 1 -- 172.21.15.47:0/74761896 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867400baa0 con 0x563b4e36d9f0 2024-09-21T00:59:57.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.483+0000 7f8664ff9640 1 -- 172.21.15.47:0/74761896 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f867400bc40 con 0x563b4e36d9f0 2024-09-21T00:59:57.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.483+0000 7f8664ff9640 1 -- 172.21.15.47:0/74761896 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8674020660 con 0x563b4e36d9f0 2024-09-21T00:59:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 -- 172.21.15.47:0/74761896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e36d9f0 msgr2=0x563b4e75c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 --2- 172.21.15.47:0/74761896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e36d9f0 0x563b4e75c8d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8674013b80 tx=0x7f8674012000 comp rx=0 tx=0).stop 2024-09-21T00:59:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 -- 172.21.15.47:0/74761896 shutdown_connections 2024-09-21T00:59:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 --2- 172.21.15.47:0/74761896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e767a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 --2- 172.21.15.47:0/74761896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e3861b0 0x563b4e767540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 --2- 172.21.15.47:0/74761896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e36d9f0 0x563b4e75c8d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 -- 172.21.15.47:0/74761896 >> 172.21.15.47:0/74761896 conn(0x563b4e3a3460 msgr2=0x563b4e75c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 -- 172.21.15.47:0/74761896 shutdown_connections 2024-09-21T00:59:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.485+0000 7f868b69f740 1 -- 172.21.15.47:0/74761896 wait complete. 2024-09-21T00:59:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.486+0000 7f868b69f740 1 -- start start 2024-09-21T00:59:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.486+0000 7f868b69f740 1 Processor -- start 2024-09-21T00:59:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.486+0000 7f868b69f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e36d9f0 0x563b4e76fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.486+0000 7f868b69f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3861b0 0x563b4e7702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.486+0000 7f868b69f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e75b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.486+0000 7f868b69f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86801abdf0 con 0x563b4e3861b0 2024-09-21T00:59:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f868b69f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86801ad260 con 0x563b4e38e390 2024-09-21T00:59:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f868b69f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86801ac4c0 con 0x563b4e36d9f0 2024-09-21T00:59:57.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f868b69f740 10 client.0 _ll_register_callbacks cb 0x7f8670005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T00:59:57.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f867e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3861b0 0x563b4e7702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f867e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3861b0 0x563b4e7702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35378/0 (socket says 172.21.15.47:35378) 2024-09-21T00:59:57.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f867e59c640 1 -- 172.21.15.47:0/3681954496 learned_addr learned my addr 172.21.15.47:0/3681954496 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T00:59:57.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f867e59c640 1 -- 172.21.15.47:0/3681954496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e36d9f0 msgr2=0x563b4e76fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f867e59c640 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e36d9f0 0x563b4e76fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f867e59c640 1 -- 172.21.15.47:0/3681954496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 msgr2=0x563b4e75b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f867e59c640 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e75b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.487+0000 7f867e59c640 1 -- 172.21.15.47:0/3681954496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4e75bd90 con 0x563b4e3861b0 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.488+0000 7f867e59c640 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3861b0 0x563b4e7702f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f86700ca6a0 tx=0x7f86700c98b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efeed8e29415a9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.488+0000 7f8662ff5640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.488+0000 7f8662ff5640 1 -- 172.21.15.47:0/3681954496 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86700ed060 con 0x563b4e3861b0 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.488+0000 7f8662ff5640 1 -- 172.21.15.47:0/3681954496 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f867003bde0 con 0x563b4e3861b0 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.488+0000 7f868b69f740 1 -- 172.21.15.47:0/3681954496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f867400bc40 con 0x563b4e3861b0 2024-09-21T00:59:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.488+0000 7f8662ff5640 1 -- 172.21.15.47:0/3681954496 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f86700ac050 con 0x563b4e3861b0 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.489+0000 7f868b69f740 10 client.15582 fetch_fsmap learned FSMap version 19 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.489+0000 7f868b69f740 1 -- 172.21.15.47:0/3681954496 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563b4e7efe00 con 0x563b4e3861b0 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.489+0000 7f8662ff5640 1 -- 172.21.15.47:0/3681954496 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f867400bc40 con 0x563b4e3861b0 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.489+0000 7f8662ff5640 1 -- 172.21.15.47:0/3681954496 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f86700b4bc0 con 0x563b4e3861b0 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.489+0000 7f868b69f740 10 client.15582 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.489+0000 7f868b69f740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.489+0000 7f868b69f740 20 client.15582 populate_metadata read hostname 'smithi047' 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.489+0000 7f868b69f740 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x563b4e3af070 0x563b4e7f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T00:59:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.490+0000 7f868b69f740 4 client.15582 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T00:59:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.490+0000 7f868b69f740 1 -- 172.21.15.47:0/3681954496 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563b4e6ca850 con 0x563b4e3af070 2024-09-21T00:59:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.491+0000 7f867ed9d640 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x563b4e3af070 0x563b4e7f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T00:59:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.493+0000 7f867ed9d640 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x563b4e3af070 0x563b4e7f2250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae3e1b682625ebc server_cookie=befb9885f3c979d3 in_seq=0 out_seq=0 2024-09-21T00:59:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.493+0000 7f8662ff5640 10 client.15582 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:57.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.494+0000 7f8662ff5640 1 -- 172.21.15.47:0/3681954496 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x563b4e6ca850 con 0x563b4e3af070 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.494+0000 7f8662ff5640 10 client.15582 handle_command_reply: tid=0 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.494+0000 7f868b69f740 1 client.15582 shutdown 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 -- 172.21.15.47:0/3681954496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3861b0 msgr2=0x563b4e7702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3861b0 0x563b4e7702f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f86700ca6a0 tx=0x7f86700c98b0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 -- 172.21.15.47:0/3681954496 shutdown_connections 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x563b4e3af070 0x563b4e7f2250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563b4e38e390 0x563b4e75b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f8662ff5640 0 client.15582 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563b4e3861b0 0x563b4e7702f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 --2- 172.21.15.47:0/3681954496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b4e36d9f0 0x563b4e76fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 -- 172.21.15.47:0/3681954496 >> 172.21.15.47:0/3681954496 conn(0x563b4e3a3460 msgr2=0x563b4e76b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 -- 172.21.15.47:0/3681954496 shutdown_connections 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 1 -- 172.21.15.47:0/3681954496 wait complete. 2024-09-21T00:59:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.495+0000 7f868b69f740 20 client.15582 trim_cache size 0 max 16384 2024-09-21T00:59:57.498 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T00:59:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T00:59:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T00:59:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T00:59:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "7a754496-3920-4c5b-9027-06e8a64287e6", 2024-09-21T00:59:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T00:59:57.498 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T00:59:57.499 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T00:59:57.500 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T00:59:57.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 -- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f86680b6590 msgr2=0x7f86680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f86680b6590 0x7f86680b8aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x563b4e75d700 tx=0x7f8674006cb0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 -- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 msgr2=0x7f8680102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 0x7f8680102c30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f867002a930 tx=0x7f8670004270 comp rx=0 tx=0).stop 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 -- 172.21.15.47:0/475633218 shutdown_connections 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f86680b6590 0x7f86680b8aa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f868010de10 0x7f8680103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8680105300 0x7f8680102c30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 --2- 172.21.15.47:0/475633218 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801049b0 0x7f86801026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.496+0000 7f868512b640 1 -- 172.21.15.47:0/475633218 >> 172.21.15.47:0/475633218 conn(0x7f8680079730 msgr2=0x7f8680100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.497+0000 7f868512b640 1 -- 172.21.15.47:0/475633218 shutdown_connections 2024-09-21T00:59:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T00:59:57.497+0000 7f868512b640 1 -- 172.21.15.47:0/475633218 wait complete. 2024-09-21T00:59:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:59:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:59:57.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:57.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:59:57.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:59:57.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T00:59:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T00:59:57.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T00:59:58.543 INFO:tasks.cephfs.filesystem:scrub status for tag:7a754496-3920-4c5b-9027-06e8a64287e6 - {'path': '/', 'tag': '7a754496-3920-4c5b-9027-06e8a64287e6', 'options': 'recursive,force'} 2024-09-21T00:59:58.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:58 smithi134 ceph-mon[34785]: pgmap v383: 97 pgs: 97 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 163 MiB/s wr, 207 op/s 2024-09-21T00:59:58.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:58 smithi114 ceph-mon[34309]: pgmap v383: 97 pgs: 97 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 163 MiB/s wr, 207 op/s 2024-09-21T00:59:58.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:58 smithi047 ceph-mon[30960]: pgmap v383: 97 pgs: 97 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 163 MiB/s wr, 207 op/s 2024-09-21T00:59:59.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 00:59:59 smithi134 ceph-mon[34785]: scrub summary: idle 2024-09-21T00:59:59.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 00:59:59 smithi114 ceph-mon[34309]: scrub summary: idle 2024-09-21T00:59:59.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 00:59:59 smithi047 ceph-mon[30960]: scrub summary: idle 2024-09-21T01:00:00.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:00 smithi114 ceph-mon[34309]: pgmap v384: 97 pgs: 97 active+clean; 2.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 238 MiB/s wr, 212 op/s 2024-09-21T01:00:00.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:00 smithi114 ceph-mon[34309]: overall HEALTH_OK 2024-09-21T01:00:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:00 smithi047 ceph-mon[30960]: pgmap v384: 97 pgs: 97 active+clean; 2.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 238 MiB/s wr, 212 op/s 2024-09-21T01:00:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:00 smithi047 ceph-mon[30960]: overall HEALTH_OK 2024-09-21T01:00:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:00 smithi134 ceph-mon[34785]: pgmap v384: 97 pgs: 97 active+clean; 2.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 238 MiB/s wr, 212 op/s 2024-09-21T01:00:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:00 smithi134 ceph-mon[34785]: overall HEALTH_OK 2024-09-21T01:00:02.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:02 smithi114 ceph-mon[34309]: pgmap v385: 97 pgs: 97 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 317 MiB/s wr, 257 op/s 2024-09-21T01:00:02.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:02 smithi047 ceph-mon[30960]: pgmap v385: 97 pgs: 97 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 317 MiB/s wr, 257 op/s 2024-09-21T01:00:03.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:02 smithi134 ceph-mon[34785]: pgmap v385: 97 pgs: 97 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 317 MiB/s wr, 257 op/s 2024-09-21T01:00:04.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:04 smithi114 ceph-mon[34309]: pgmap v386: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 463 MiB/s wr, 284 op/s 2024-09-21T01:00:04.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:04 smithi047 ceph-mon[30960]: pgmap v386: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 463 MiB/s wr, 284 op/s 2024-09-21T01:00:05.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:04 smithi134 ceph-mon[34785]: pgmap v386: 97 pgs: 97 active+clean; 5.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 463 MiB/s wr, 284 op/s 2024-09-21T01:00:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.864+0000 7f7822a0a640 1 -- 172.21.15.47:0/1677874163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c108300 msgr2=0x7f781c10a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.864+0000 7f7822a0a640 1 --2- 172.21.15.47:0/1677874163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c108300 0x7f781c10a810 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7814009ca0 tx=0x7f781402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.864+0000 7f7822a0a640 1 -- 172.21.15.47:0/1677874163 shutdown_connections 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.864+0000 7f7822a0a640 1 --2- 172.21.15.47:0/1677874163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c108300 0x7f781c10a810 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.864+0000 7f7822a0a640 1 --2- 172.21.15.47:0/1677874163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c1056e0 0x7f781c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.864+0000 7f7822a0a640 1 --2- 172.21.15.47:0/1677874163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c102c20 0x7f781c1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.864+0000 7f7822a0a640 1 -- 172.21.15.47:0/1677874163 >> 172.21.15.47:0/1677874163 conn(0x7f781c0fd690 msgr2=0x7f781c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.865+0000 7f7822a0a640 1 -- 172.21.15.47:0/1677874163 shutdown_connections 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.865+0000 7f7822a0a640 1 -- 172.21.15.47:0/1677874163 wait complete. 2024-09-21T01:00:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.866+0000 7f7822a0a640 1 Processor -- start 2024-09-21T01:00:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.866+0000 7f7822a0a640 1 -- start start 2024-09-21T01:00:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.867+0000 7f7822a0a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c102c20 0x7f781c10f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.867+0000 7f7822a0a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c1056e0 0x7f781c10e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.867+0000 7f7822a0a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c108300 0x7f781c10e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.867+0000 7f7822a0a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f781c101c00 con 0x7f781c1056e0 2024-09-21T01:00:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.867+0000 7f7822a0a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f781c101a80 con 0x7f781c108300 2024-09-21T01:00:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.867+0000 7f7822a0a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f781c101d80 con 0x7f781c102c20 2024-09-21T01:00:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.867+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c1056e0 0x7f781c10e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c1056e0 0x7f781c10e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50434/0 (socket says 172.21.15.47:50434) 2024-09-21T01:00:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f781b7fe640 1 -- 172.21.15.47:0/2629976321 learned_addr learned my addr 172.21.15.47:0/2629976321 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f781bfff640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c102c20 0x7f781c10f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f7820fa7640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c108300 0x7f781c10e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f781b7fe640 1 -- 172.21.15.47:0/2629976321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c102c20 msgr2=0x7f781c10f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c102c20 0x7f781c10f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f781b7fe640 1 -- 172.21.15.47:0/2629976321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c108300 msgr2=0x7f781c10e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c108300 0x7f781c10e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.868+0000 7f781b7fe640 1 -- 172.21.15.47:0/2629976321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781c10ed30 con 0x7f781c1056e0 2024-09-21T01:00:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.869+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c1056e0 0x7f781c10e0c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f781000b4a0 tx=0x7f781000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.869+0000 7f78197fa640 1 -- 172.21.15.47:0/2629976321 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810015020 con 0x7f781c1056e0 2024-09-21T01:00:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.869+0000 7f78197fa640 1 -- 172.21.15.47:0/2629976321 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7810011ce0 con 0x7f781c1056e0 2024-09-21T01:00:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.869+0000 7f7822a0a640 1 -- 172.21.15.47:0/2629976321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781c1a4090 con 0x7f781c1056e0 2024-09-21T01:00:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.869+0000 7f78197fa640 1 -- 172.21.15.47:0/2629976321 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810010dc0 con 0x7f781c1056e0 2024-09-21T01:00:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.869+0000 7f7822a0a640 1 -- 172.21.15.47:0/2629976321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781c1a45d0 con 0x7f781c1056e0 2024-09-21T01:00:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.873+0000 7f78197fa640 1 -- 172.21.15.47:0/2629976321 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7810018020 con 0x7f781c1056e0 2024-09-21T01:00:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.873+0000 7f7829a50740 1 Processor -- start 2024-09-21T01:00:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f7829a50740 1 -- start start 2024-09-21T01:00:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f7829a50740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dccc1b0 0x55cc4e073e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f7829a50740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dca32f0 0x55cc4e0744c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f7829a50740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e075010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f7829a50740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cc4dfe66f0 con 0x55cc4dcab4d0 2024-09-21T01:00:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f7829a50740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55cc4dfd5b20 con 0x55cc4dccc1b0 2024-09-21T01:00:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f7829a50740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cc4dfd9930 con 0x55cc4dca32f0 2024-09-21T01:00:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e075010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e075010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50440/0 (socket says 172.21.15.47:50440) 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.874+0000 7f781b7fe640 1 -- 172.21.15.47:0/1020020211 learned_addr learned my addr 172.21.15.47:0/1020020211 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f78197fa640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78040b6510 0x7f78040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f78197fa640 1 -- 172.21.15.47:0/2629976321 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f78100e6a80 con 0x7f781c1056e0 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f781b7fe640 1 -- 172.21.15.47:0/1020020211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dca32f0 msgr2=0x55cc4e0744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f781b7fe640 1 --2- 172.21.15.47:0/1020020211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dca32f0 0x55cc4e0744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f781b7fe640 1 -- 172.21.15.47:0/1020020211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dccc1b0 msgr2=0x55cc4e073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f781b7fe640 1 --2- 172.21.15.47:0/1020020211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dccc1b0 0x55cc4e073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f781b7fe640 1 -- 172.21.15.47:0/1020020211 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc4df9b530 con 0x55cc4dcab4d0 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f781b7fe640 1 --2- 172.21.15.47:0/1020020211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e075010 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f78100ac9b0 tx=0x7f7810010380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded52018790b45a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.875+0000 7f7820fa7640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78040b6510 0x7f78040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.876+0000 7f78027fc640 1 -- 172.21.15.47:0/1020020211 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100ac600 con 0x55cc4dcab4d0 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.876+0000 7f78027fc640 1 -- 172.21.15.47:0/1020020211 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78100ac7c0 con 0x55cc4dcab4d0 2024-09-21T01:00:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.876+0000 7f78027fc640 1 -- 172.21.15.47:0/1020020211 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100ac420 con 0x55cc4dcab4d0 2024-09-21T01:00:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 -- 172.21.15.47:0/1020020211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 msgr2=0x55cc4e075010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7820fa7640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78040b6510 0x7f78040b8a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7814031b50 tx=0x7f7814031a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 --2- 172.21.15.47:0/1020020211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e075010 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f78100ac9b0 tx=0x7f7810010380 comp rx=0 tx=0).stop 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 -- 172.21.15.47:0/1020020211 shutdown_connections 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 --2- 172.21.15.47:0/1020020211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e075010 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 --2- 172.21.15.47:0/1020020211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dca32f0 0x55cc4e0744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 --2- 172.21.15.47:0/1020020211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dccc1b0 0x55cc4e073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 -- 172.21.15.47:0/1020020211 >> 172.21.15.47:0/1020020211 conn(0x55cc4dcc0300 msgr2=0x55cc4e06f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 -- 172.21.15.47:0/1020020211 shutdown_connections 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.877+0000 7f7829a50740 1 -- 172.21.15.47:0/1020020211 wait complete. 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.878+0000 7f7829a50740 1 -- start start 2024-09-21T01:00:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.878+0000 7f7829a50740 1 Processor -- start 2024-09-21T01:00:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.878+0000 7f7829a50740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e07d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.878+0000 7f7829a50740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.878+0000 7f7829a50740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f7829a50740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cc4df0dab0 con 0x55cc4dcab4d0 2024-09-21T01:00:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f7829a50740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55cc4df7b730 con 0x55cc4dca32f0 2024-09-21T01:00:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f7829a50740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cc4e075a70 con 0x55cc4dccc1b0 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e07d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50444/0 (socket says 172.21.15.47:50444) 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e07d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:52070/0 (socket says 172.21.15.47:52070) 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781b7fe640 1 -- 172.21.15.47:0/2910337682 learned_addr learned my addr 172.21.15.47:0/2910337682 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f7829a50740 10 client.0 _ll_register_callbacks cb 0x55cc4dfcf6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781b7fe640 1 -- 172.21.15.47:0/2910337682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 msgr2=0x55cc4e07e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781b7fe640 1 -- 172.21.15.47:0/2910337682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 msgr2=0x55cc4e07d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e07d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f781b7fe640 1 -- 172.21.15.47:0/2910337682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4dd37790 con 0x55cc4dcab4d0 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.879+0000 7f7829a50740 1 -- 172.21.15.47:0/2910337682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78100ac7c0 con 0x55cc4dcab4d0 2024-09-21T01:00:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.880+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07dc00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f78100a9280 tx=0x7f78100ac600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504053081d16713a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.880+0000 7f77fb7fe640 10 client.15594 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.880+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2910337682 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100ad3b0 con 0x55cc4dcab4d0 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.880+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2910337682 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f78100d00b0 con 0x55cc4dcab4d0 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.880+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2910337682 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f78100d02b0 con 0x55cc4dcab4d0 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.880+0000 7f7829a50740 10 client.15594 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.880+0000 7f7829a50740 1 -- 172.21.15.47:0/2910337682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55cc4ddb0620 con 0x55cc4dcab4d0 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.881+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2910337682 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f78100abf10 con 0x55cc4dcab4d0 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.881+0000 7f7829a50740 10 client.15594 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.881+0000 7f7829a50740 10 client.15594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.881+0000 7f7829a50740 20 client.15594 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.881+0000 7f7829a50740 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cc4dc8ad80 0x55cc4e08a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.881+0000 7f7829a50740 4 client.15594 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.881+0000 7f7829a50740 1 -- 172.21.15.47:0/2910337682 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc4dfe8640 con 0x55cc4dc8ad80 2024-09-21T01:00:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.882+0000 7f781bfff640 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cc4dc8ad80 0x55cc4e08a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.884+0000 7f77fb7fe640 10 client.15594 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.884+0000 7f781bfff640 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cc4dc8ad80 0x55cc4e08a6f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e4d9b66390a299 server_cookie=8b5c4fc08582f6e in_seq=0 out_seq=0 2024-09-21T01:00:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.886+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2910337682 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc4dfe8640 con 0x55cc4dc8ad80 2024-09-21T01:00:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.886+0000 7f77fb7fe640 10 client.15594 handle_command_reply: tid=0 2024-09-21T01:00:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 client.15594 shutdown 2024-09-21T01:00:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 -- 172.21.15.47:0/2910337682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 msgr2=0x55cc4e07dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07dc00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f78100a9280 tx=0x7f78100ac600 comp rx=0 tx=0).stop 2024-09-21T01:00:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 -- 172.21.15.47:0/2910337682 shutdown_connections 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cc4dc8ad80 0x55cc4e08a6f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07dc00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 --2- 172.21.15.47:0/2910337682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e07d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f7829a50740 1 -- 172.21.15.47:0/2910337682 >> 172.21.15.47:0/2910337682 conn(0x55cc4dcc0300 msgr2=0x55cc4e06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.887+0000 7f77fb7fe640 0 client.15594 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.888+0000 7f7829a50740 1 -- 172.21.15.47:0/2910337682 shutdown_connections 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.888+0000 7f7829a50740 1 -- 172.21.15.47:0/2910337682 wait complete. 2024-09-21T01:00:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.888+0000 7f7829a50740 20 client.15594 trim_cache size 0 max 16384 2024-09-21T01:00:06.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:06 smithi114 ceph-mon[34309]: pgmap v387: 97 pgs: 97 active+clean; 6.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 518 MiB/s wr, 291 op/s 2024-09-21T01:00:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.916+0000 7f7829a50740 1 Processor -- start 2024-09-21T01:00:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.916+0000 7f7829a50740 1 -- start start 2024-09-21T01:00:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7829a50740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e07bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7829a50740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7829a50740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7829a50740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f781c1ab120 con 0x55cc4dccc1b0 2024-09-21T01:00:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7829a50740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f781c1ad9a0 con 0x55cc4dca32f0 2024-09-21T01:00:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7829a50740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f781c1ab790 con 0x55cc4dcab4d0 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7820fa7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7820fa7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50448/0 (socket says 172.21.15.47:50448) 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f7820fa7640 1 -- 172.21.15.47:0/3419433086 learned_addr learned my addr 172.21.15.47:0/3419433086 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.917+0000 7f781b7fe640 1 --2- 172.21.15.47:0/3419433086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.918+0000 7f7820fa7640 1 -- 172.21.15.47:0/3419433086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dcab4d0 msgr2=0x55cc4e07c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.918+0000 7f7820fa7640 1 --2- 172.21.15.47:0/3419433086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.918+0000 7f7820fa7640 1 -- 172.21.15.47:0/3419433086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 msgr2=0x55cc4e07bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.918+0000 7f7820fa7640 1 --2- 172.21.15.47:0/3419433086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e07bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.918+0000 7f7820fa7640 1 -- 172.21.15.47:0/3419433086 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc4e07b750 con 0x55cc4dccc1b0 2024-09-21T01:00:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.918+0000 7f7820fa7640 1 --2- 172.21.15.47:0/3419433086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07c740 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f78140094e0 tx=0x7f7814040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d2ccef43cfdddf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.918+0000 7f7801ffb640 1 -- 172.21.15.47:0/3419433086 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781404c070 con 0x55cc4dccc1b0 2024-09-21T01:00:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.918+0000 7f7801ffb640 1 -- 172.21.15.47:0/3419433086 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7814036040 con 0x55cc4dccc1b0 2024-09-21T01:00:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.919+0000 7f7801ffb640 1 -- 172.21.15.47:0/3419433086 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781402f870 con 0x55cc4dccc1b0 2024-09-21T01:00:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.920+0000 7f7829a50740 1 -- 172.21.15.47:0/3419433086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dccc1b0 msgr2=0x55cc4e07c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.920+0000 7f7829a50740 1 --2- 172.21.15.47:0/3419433086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07c740 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f78140094e0 tx=0x7f7814040040 comp rx=0 tx=0).stop 2024-09-21T01:00:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.921+0000 7f7829a50740 1 -- 172.21.15.47:0/3419433086 shutdown_connections 2024-09-21T01:00:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.921+0000 7f7829a50740 1 --2- 172.21.15.47:0/3419433086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dccc1b0 0x55cc4e07c740 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.921+0000 7f7829a50740 1 --2- 172.21.15.47:0/3419433086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dcab4d0 0x55cc4e07c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.921+0000 7f7829a50740 1 --2- 172.21.15.47:0/3419433086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e07bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.921+0000 7f7829a50740 1 -- 172.21.15.47:0/3419433086 >> 172.21.15.47:0/3419433086 conn(0x55cc4dcc0300 msgr2=0x55cc4e073df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.921+0000 7f7829a50740 1 -- 172.21.15.47:0/3419433086 shutdown_connections 2024-09-21T01:00:06.922 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.921+0000 7f7829a50740 1 -- 172.21.15.47:0/3419433086 wait complete. 2024-09-21T01:00:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.923+0000 7f7829a50740 1 -- start start 2024-09-21T01:00:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.923+0000 7f7829a50740 1 Processor -- start 2024-09-21T01:00:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.925+0000 7f7829a50740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e085420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.925+0000 7f7829a50740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e0840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.925+0000 7f7829a50740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 0x55cc4e0847f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.925+0000 7f7829a50740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f781c1abe60 con 0x55cc4dcab4d0 2024-09-21T01:00:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.925+0000 7f7829a50740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f781c1ad2d0 con 0x55cc4dca32f0 2024-09-21T01:00:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.925+0000 7f7829a50740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f781c1ac530 con 0x55cc4dccc1b0 2024-09-21T01:00:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.925+0000 7f7829a50740 10 client.0 _ll_register_callbacks cb 0x7f78100106e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.926+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e0840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.926+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e0840e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50458/0 (socket says 172.21.15.47:50458) 2024-09-21T01:00:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.926+0000 7f781b7fe640 1 -- 172.21.15.47:0/2968143473 learned_addr learned my addr 172.21.15.47:0/2968143473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.927+0000 7f781bfff640 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e085420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.927+0000 7f7820fa7640 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 0x55cc4e0847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.927+0000 7f781b7fe640 1 -- 172.21.15.47:0/2968143473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 msgr2=0x55cc4e0847f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.928+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 0x55cc4e0847f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.928+0000 7f781b7fe640 1 -- 172.21.15.47:0/2968143473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 msgr2=0x55cc4e085420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.928+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e085420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.928+0000 7f781b7fe640 1 -- 172.21.15.47:0/2968143473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4e082d80 con 0x55cc4dcab4d0 2024-09-21T01:00:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.928+0000 7f781b7fe640 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e0840e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f781000bfd0 tx=0x7f78100a9430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2a8f0df5824616 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.928+0000 7f77fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:00:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.929+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2968143473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100c6070 con 0x55cc4dcab4d0 2024-09-21T01:00:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.929+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2968143473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f78100a8600 con 0x55cc4dcab4d0 2024-09-21T01:00:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.929+0000 7f7829a50740 1 -- 172.21.15.47:0/2968143473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7814036040 con 0x55cc4dcab4d0 2024-09-21T01:00:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.929+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2968143473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f78100c2e60 con 0x55cc4dcab4d0 2024-09-21T01:00:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.929+0000 7f7829a50740 10 client.15600 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.929+0000 7f7829a50740 1 -- 172.21.15.47:0/2968143473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cc4e0fd900 con 0x55cc4dcab4d0 2024-09-21T01:00:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.930+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2968143473 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7814036040 con 0x55cc4dcab4d0 2024-09-21T01:00:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.930+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2968143473 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f78100a8800 con 0x55cc4dcab4d0 2024-09-21T01:00:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.930+0000 7f7829a50740 10 client.15600 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.930+0000 7f7829a50740 10 client.15600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.930+0000 7f7829a50740 20 client.15600 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.930+0000 7f7829a50740 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cc4dc601c0 0x55cc4e1000d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.930+0000 7f7829a50740 4 client.15600 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:00:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.930+0000 7f7829a50740 1 -- 172.21.15.47:0/2968143473 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cc4dfe40f0 con 0x55cc4dc601c0 2024-09-21T01:00:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.932+0000 7f781bfff640 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cc4dc601c0 0x55cc4e1000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.937+0000 7f77fb7fe640 10 client.15600 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:06.937+0000 7f781bfff640 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cc4dc601c0 0x55cc4e1000d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c7ad0f0546d3ef3 server_cookie=4981f3663f1edf7b in_seq=0 out_seq=0 2024-09-21T01:00:06.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:06 smithi047 ceph-mon[30960]: pgmap v387: 97 pgs: 97 active+clean; 6.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 518 MiB/s wr, 291 op/s 2024-09-21T01:00:07.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:06 smithi134 ceph-mon[34785]: pgmap v387: 97 pgs: 97 active+clean; 6.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 518 MiB/s wr, 291 op/s 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.115+0000 7f77fb7fe640 1 -- 172.21.15.47:0/2968143473 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cc4dfe40f0 con 0x55cc4dc601c0 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.115+0000 7f77fb7fe640 10 client.15600 handle_command_reply: tid=0 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.115+0000 7f7829a50740 1 client.15600 shutdown 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 -- 172.21.15.47:0/2968143473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 msgr2=0x55cc4e0840e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e0840e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f781000bfd0 tx=0x7f78100a9430 comp rx=0 tx=0).stop 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 -- 172.21.15.47:0/2968143473 shutdown_connections 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cc4dc601c0 0x55cc4e1000d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cc4dccc1b0 0x55cc4e0847f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc4dcab4d0 0x55cc4e0840e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f77fb7fe640 0 client.15600 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 --2- 172.21.15.47:0/2968143473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cc4dca32f0 0x55cc4e085420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 -- 172.21.15.47:0/2968143473 >> 172.21.15.47:0/2968143473 conn(0x55cc4dcc0300 msgr2=0x55cc4e07b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 -- 172.21.15.47:0/2968143473 shutdown_connections 2024-09-21T01:00:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 1 -- 172.21.15.47:0/2968143473 wait complete. 2024-09-21T01:00:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7829a50740 20 client.15600 trim_cache size 0 max 16384 2024-09-21T01:00:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:00:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:00:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:00:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:00:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7822a0a640 1 -- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78040b6510 msgr2=0x7f78040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7822a0a640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78040b6510 0x7f78040b8a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7814031b50 tx=0x7f7814031a20 comp rx=0 tx=0).stop 2024-09-21T01:00:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7822a0a640 1 -- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c1056e0 msgr2=0x7f781c10e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.116+0000 7f7822a0a640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c1056e0 0x7f781c10e0c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f781000b4a0 tx=0x7f781000b8a0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.117+0000 7f7822a0a640 1 -- 172.21.15.47:0/2629976321 shutdown_connections 2024-09-21T01:00:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.117+0000 7f7822a0a640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78040b6510 0x7f78040b8a20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.117+0000 7f7822a0a640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c108300 0x7f781c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.117+0000 7f7822a0a640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f781c1056e0 0x7f781c10e0c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.117+0000 7f7822a0a640 1 --2- 172.21.15.47:0/2629976321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c102c20 0x7f781c10f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.117+0000 7f7822a0a640 1 -- 172.21.15.47:0/2629976321 >> 172.21.15.47:0/2629976321 conn(0x7f781c0fd690 msgr2=0x7f781c103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.117+0000 7f7822a0a640 1 -- 172.21.15.47:0/2629976321 shutdown_connections 2024-09-21T01:00:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:07.117+0000 7f7822a0a640 1 -- 172.21.15.47:0/2629976321 wait complete. 2024-09-21T01:00:08.005 INFO:tasks.workunit.client.0.smithi047.stdout:fs setup took 17 secs 2024-09-21T01:00:08.959 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:08 smithi047 ceph-mon[30960]: pgmap v388: 97 pgs: 97 active+clean; 8.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 656 MiB/s wr, 348 op/s 2024-09-21T01:00:09.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:08 smithi134 ceph-mon[34785]: pgmap v388: 97 pgs: 97 active+clean; 8.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 656 MiB/s wr, 348 op/s 2024-09-21T01:00:09.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:08 smithi114 ceph-mon[34309]: pgmap v388: 97 pgs: 97 active+clean; 8.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 656 MiB/s wr, 348 op/s 2024-09-21T01:00:11.073 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:10 smithi047 ceph-mon[30960]: pgmap v389: 97 pgs: 97 active+clean; 8.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 599 MiB/s wr, 245 op/s 2024-09-21T01:00:11.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:10 smithi134 ceph-mon[34785]: pgmap v389: 97 pgs: 97 active+clean; 8.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 599 MiB/s wr, 245 op/s 2024-09-21T01:00:11.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:10 smithi114 ceph-mon[34309]: pgmap v389: 97 pgs: 97 active+clean; 8.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 599 MiB/s wr, 245 op/s 2024-09-21T01:00:11.538 INFO:tasks.workunit.client.0.smithi047.stdout:Syncing()...3 sec 2024-09-21T01:00:11.538 INFO:tasks.workunit.client.0.smithi047.stdout:Starting Actual Benchmark At: Sat Sep 21 01:00:11 2024 2024-09-21T01:00:11.538 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:00:13.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:12 smithi134 ceph-mon[34785]: pgmap v390: 97 pgs: 97 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 602 MiB/s wr, 253 op/s 2024-09-21T01:00:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:12 smithi114 ceph-mon[34309]: pgmap v390: 97 pgs: 97 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 602 MiB/s wr, 253 op/s 2024-09-21T01:00:13.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:12 smithi047 ceph-mon[30960]: pgmap v390: 97 pgs: 97 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 602 MiB/s wr, 253 op/s 2024-09-21T01:00:15.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:14 smithi134 ceph-mon[34785]: pgmap v391: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 695 MiB/s wr, 301 op/s 2024-09-21T01:00:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:14 smithi114 ceph-mon[34309]: pgmap v391: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 695 MiB/s wr, 301 op/s 2024-09-21T01:00:15.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:14 smithi047 ceph-mon[30960]: pgmap v391: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 695 MiB/s wr, 301 op/s 2024-09-21T01:00:17.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:16 smithi134 ceph-mon[34785]: pgmap v392: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 594 MiB/s wr, 501 op/s 2024-09-21T01:00:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:16 smithi114 ceph-mon[34309]: pgmap v392: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 594 MiB/s wr, 501 op/s 2024-09-21T01:00:17.207 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:16 smithi047 ceph-mon[30960]: pgmap v392: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 594 MiB/s wr, 501 op/s 2024-09-21T01:00:19.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:18 smithi134 ceph-mon[34785]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 558 MiB/s wr, 2.46k op/s 2024-09-21T01:00:19.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:18 smithi114 ceph-mon[34309]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 558 MiB/s wr, 2.46k op/s 2024-09-21T01:00:19.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:18 smithi047 ceph-mon[30960]: pgmap v393: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 558 MiB/s wr, 2.46k op/s 2024-09-21T01:00:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 -- 172.21.15.47:0/1136950480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954104730 msgr2=0x7f8954104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 --2- 172.21.15.47:0/1136950480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954104730 0x7f8954104b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8948009900 tx=0x7f894802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 -- 172.21.15.47:0/1136950480 shutdown_connections 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 --2- 172.21.15.47:0/1136950480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89541050d0 0x7f895410ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 --2- 172.21.15.47:0/1136950480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954104730 0x7f8954104b40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 --2- 172.21.15.47:0/1136950480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89541036b0 0x7f8954103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 -- 172.21.15.47:0/1136950480 >> 172.21.15.47:0/1136950480 conn(0x7f89540feff0 msgr2=0x7f89541014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 -- 172.21.15.47:0/1136950480 shutdown_connections 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.276+0000 7f895a55e640 1 -- 172.21.15.47:0/1136950480 wait complete. 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.277+0000 7f895a55e640 1 Processor -- start 2024-09-21T01:00:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.277+0000 7f895a55e640 1 -- start start 2024-09-21T01:00:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f895a55e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89541036b0 0x7f8954199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f895a55e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8954104730 0x7f895419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f895a55e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89541050d0 0x7f895419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f895a55e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f895410f2e0 con 0x7f8954104730 2024-09-21T01:00:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f895a55e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f895410f160 con 0x7f89541050d0 2024-09-21T01:00:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f895a55e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f895410f460 con 0x7f89541036b0 2024-09-21T01:00:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f8953fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89541036b0 0x7f8954199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f8953fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89541036b0 0x7f8954199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:52540/0 (socket says 172.21.15.47:52540) 2024-09-21T01:00:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f8953fff640 1 -- 172.21.15.47:0/2634029901 learned_addr learned my addr 172.21.15.47:0/2634029901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.278+0000 7f8958afb640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89541050d0 0x7f895419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f89537fe640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8954104730 0x7f895419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f8958afb640 1 -- 172.21.15.47:0/2634029901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89541036b0 msgr2=0x7f8954199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f8958afb640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89541036b0 0x7f8954199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f8958afb640 1 -- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8954104730 msgr2=0x7f895419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f8958afb640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8954104730 0x7f895419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f8958afb640 1 -- 172.21.15.47:0/2634029901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895419b950 con 0x7f89541050d0 2024-09-21T01:00:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f8953fff640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89541036b0 0x7f8954199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f89537fe640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8954104730 0x7f895419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:00:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f8958afb640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89541050d0 0x7f895419b130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f894c009fd0 tx=0x7f894c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f89517fa640 1 -- 172.21.15.47:0/2634029901 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c00ce20 con 0x7f89541050d0 2024-09-21T01:00:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f89517fa640 1 -- 172.21.15.47:0/2634029901 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f894c005020 con 0x7f89541050d0 2024-09-21T01:00:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f89517fa640 1 -- 172.21.15.47:0/2634029901 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c010690 con 0x7f89541050d0 2024-09-21T01:00:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.279+0000 7f895a55e640 1 -- 172.21.15.47:0/2634029901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895419bc40 con 0x7f89541050d0 2024-09-21T01:00:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.280+0000 7f895a55e640 1 -- 172.21.15.47:0/2634029901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89540757d0 con 0x7f89541050d0 2024-09-21T01:00:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89614cd740 1 Processor -- start 2024-09-21T01:00:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89517fa640 1 -- 172.21.15.47:0/2634029901 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f894c0054d0 con 0x7f89541050d0 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89614cd740 1 -- start start 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89614cd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75f61b0 0x55fdb799de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89614cd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 0x55fdb799e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89614cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75d54d0 0x55fdb799f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89614cd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fdb79106f0 con 0x55fdb75cd2f0 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89614cd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55fdb78ffb20 con 0x55fdb75f61b0 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.283+0000 7f89614cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fdb7903930 con 0x55fdb75d54d0 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75f61b0 0x55fdb799de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75f61b0 0x55fdb799de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:39576/0 (socket says 172.21.15.47:39576) 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 -- 172.21.15.47:0/2433057210 learned_addr learned my addr 172.21.15.47:0/2433057210 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75d54d0 0x55fdb799f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f8953fff640 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 0x55fdb799e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 -- 172.21.15.47:0/2433057210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75d54d0 msgr2=0x55fdb799f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75d54d0 0x55fdb799f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 -- 172.21.15.47:0/2433057210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 msgr2=0x55fdb799e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 0x55fdb799e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 -- 172.21.15.47:0/2433057210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb78c5530 con 0x55fdb75f61b0 2024-09-21T01:00:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89517fa640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f893c0ba9a0 0x7f893c0bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f89537fe640 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75f61b0 0x55fdb799de50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8948031910 tx=0x7f8948031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df5078b7bb0c82be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.284+0000 7f8953fff640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f893c0ba9a0 0x7f893c0bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.285+0000 7f893a7fc640 1 -- 172.21.15.47:0/2433057210 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948035040 con 0x55fdb75f61b0 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.285+0000 7f89517fa640 1 -- 172.21.15.47:0/2634029901 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f894c0e7a30 con 0x7f89541050d0 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.285+0000 7f893a7fc640 1 -- 172.21.15.47:0/2433057210 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89480035f0 con 0x55fdb75f61b0 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.285+0000 7f893a7fc640 1 -- 172.21.15.47:0/2433057210 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894803e600 con 0x55fdb75f61b0 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 -- 172.21.15.47:0/2433057210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75f61b0 msgr2=0x55fdb799de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75f61b0 0x55fdb799de50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8948031910 tx=0x7f8948031400 comp rx=0 tx=0).stop 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f8953fff640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f893c0ba9a0 0x7f893c0bceb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f894400f650 tx=0x7f8944005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 -- 172.21.15.47:0/2433057210 shutdown_connections 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75d54d0 0x55fdb799f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 0x55fdb799e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 --2- 172.21.15.47:0/2433057210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75f61b0 0x55fdb799de50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 -- 172.21.15.47:0/2433057210 >> 172.21.15.47:0/2433057210 conn(0x55fdb75ea300 msgr2=0x55fdb79998e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 -- 172.21.15.47:0/2433057210 shutdown_connections 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 -- 172.21.15.47:0/2433057210 wait complete. 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.286+0000 7f89614cd740 1 -- start start 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f89614cd740 1 Processor -- start 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f89614cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f89614cd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb79a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f89614cd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75f61b0 0x55fdb79a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f89614cd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fdb7837ab0 con 0x55fdb75f61b0 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f89614cd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55fdb78a5730 con 0x55fdb75d54d0 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f89614cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fdb799fad0 con 0x55fdb75cd2f0 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f8953fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f89614cd740 10 client.0 _ll_register_callbacks cb 0x55fdb78f96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f8953fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79a75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:52558/0 (socket says 172.21.15.47:52558) 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.287+0000 7f8953fff640 1 -- 172.21.15.47:0/3751479531 learned_addr learned my addr 172.21.15.47:0/3751479531 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f8953fff640 1 -- 172.21.15.47:0/3751479531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 msgr2=0x55fdb79a7c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f8953fff640 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb79a7c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f8953fff640 1 -- 172.21.15.47:0/3751479531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75f61b0 msgr2=0x55fdb79a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f8953fff640 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75f61b0 0x55fdb79a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f8953fff640 1 -- 172.21.15.47:0/3751479531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb7661790 con 0x55fdb75cd2f0 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f8953fff640 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79a75b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89440098c0 tx=0x7f8944004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=541b937a6c71adc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f89337fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f89337fe640 1 -- 172.21.15.47:0/3751479531 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944036060 con 0x55fdb75cd2f0 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.288+0000 7f89337fe640 1 -- 172.21.15.47:0/3751479531 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8944020030 con 0x55fdb75cd2f0 2024-09-21T01:00:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.289+0000 7f89614cd740 1 -- 172.21.15.47:0/3751479531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89480035f0 con 0x55fdb75cd2f0 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.289+0000 7f89337fe640 1 -- 172.21.15.47:0/3751479531 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f894400ee20 con 0x55fdb75cd2f0 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.289+0000 7f89614cd740 10 client.25291 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.289+0000 7f89614cd740 1 -- 172.21.15.47:0/3751479531 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fdb76da620 con 0x55fdb75cd2f0 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.289+0000 7f89337fe640 1 -- 172.21.15.47:0/3751479531 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89480035f0 con 0x55fdb75cd2f0 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.289+0000 7f89337fe640 1 -- 172.21.15.47:0/3751479531 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f89440047a0 con 0x55fdb75cd2f0 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.290+0000 7f89614cd740 10 client.25291 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.290+0000 7f89614cd740 10 client.25291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.290+0000 7f89614cd740 20 client.25291 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.290+0000 7f89614cd740 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55fdb75b4d80 0x55fdb79b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.290+0000 7f89614cd740 4 client.25291 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.290+0000 7f89614cd740 1 -- 172.21.15.47:0/3751479531 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdb7912640 con 0x55fdb75b4d80 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.290+0000 7f89537fe640 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55fdb75b4d80 0x55fdb79b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.291+0000 7f89537fe640 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55fdb75b4d80 0x55fdb79b4e50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=742d215c2d1f7801 server_cookie=d59424bd0ba2c133 in_seq=0 out_seq=0 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.291+0000 7f89337fe640 10 client.25291 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.291+0000 7f89337fe640 1 -- 172.21.15.47:0/3751479531 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fdb7912640 con 0x55fdb75b4d80 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.291+0000 7f89337fe640 10 client.25291 handle_command_reply: tid=0 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.292+0000 7f89614cd740 1 client.25291 shutdown 2024-09-21T01:00:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.292+0000 7f89614cd740 1 -- 172.21.15.47:0/3751479531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 msgr2=0x55fdb79a75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.292+0000 7f89614cd740 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79a75b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89440098c0 tx=0x7f8944004730 comp rx=0 tx=0).stop 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.292+0000 7f89614cd740 1 -- 172.21.15.47:0/3751479531 shutdown_connections 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.292+0000 7f89614cd740 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55fdb75b4d80 0x55fdb79b4e50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.292+0000 7f89337fe640 0 client.25291 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.292+0000 7f89614cd740 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75f61b0 0x55fdb79a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.292+0000 7f89614cd740 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb79a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.293+0000 7f89614cd740 1 --2- 172.21.15.47:0/3751479531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79a75b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.293+0000 7f89614cd740 1 -- 172.21.15.47:0/3751479531 >> 172.21.15.47:0/3751479531 conn(0x55fdb75ea300 msgr2=0x55fdb7997ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.293+0000 7f89614cd740 1 -- 172.21.15.47:0/3751479531 shutdown_connections 2024-09-21T01:00:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.293+0000 7f89614cd740 1 -- 172.21.15.47:0/3751479531 wait complete. 2024-09-21T01:00:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.293+0000 7f89614cd740 20 client.25291 trim_cache size 0 max 16384 2024-09-21T01:00:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.320+0000 7f89614cd740 1 Processor -- start 2024-09-21T01:00:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.320+0000 7f89614cd740 1 -- start start 2024-09-21T01:00:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f89614cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75b4d80 0x55fdb7999220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f89614cd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 0x55fdb7998610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f89614cd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb7998b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f89614cd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89541a6b60 con 0x55fdb75cd2f0 2024-09-21T01:00:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f89614cd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f89541a93e0 con 0x55fdb75d54d0 2024-09-21T01:00:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f89614cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89541a71d0 con 0x55fdb75b4d80 2024-09-21T01:00:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8958afb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb7998b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8953fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75b4d80 0x55fdb7999220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8953fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75b4d80 0x55fdb7999220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:52560/0 (socket says 172.21.15.47:52560) 2024-09-21T01:00:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8953fff640 1 -- 172.21.15.47:0/3665552421 learned_addr learned my addr 172.21.15.47:0/3665552421 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8958afb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb7998b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:39608/0 (socket says 172.21.15.47:39608) 2024-09-21T01:00:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f89537fe640 1 --2- 172.21.15.47:0/3665552421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 0x55fdb7998610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8953fff640 1 -- 172.21.15.47:0/3665552421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 msgr2=0x55fdb7998b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8953fff640 1 --2- 172.21.15.47:0/3665552421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb7998b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8953fff640 1 -- 172.21.15.47:0/3665552421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 msgr2=0x55fdb7998610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8953fff640 1 --2- 172.21.15.47:0/3665552421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 0x55fdb7998610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.321+0000 7f8953fff640 1 -- 172.21.15.47:0/3665552421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb79a8b50 con 0x55fdb75b4d80 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.322+0000 7f8953fff640 1 --2- 172.21.15.47:0/3665552421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75b4d80 0x55fdb7999220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f894400fee0 tx=0x7f89440049e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9678c78fcd0ac584 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.322+0000 7f8939ffb640 1 -- 172.21.15.47:0/3665552421 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894401ace0 con 0x55fdb75b4d80 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.322+0000 7f8939ffb640 1 -- 172.21.15.47:0/3665552421 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f894401ae80 con 0x55fdb75b4d80 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.322+0000 7f8939ffb640 1 -- 172.21.15.47:0/3665552421 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89440185b0 con 0x55fdb75b4d80 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.323+0000 7f89614cd740 1 -- 172.21.15.47:0/3665552421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75b4d80 msgr2=0x55fdb7999220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.323+0000 7f89614cd740 1 --2- 172.21.15.47:0/3665552421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75b4d80 0x55fdb7999220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f894400fee0 tx=0x7f89440049e0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.323+0000 7f89614cd740 1 -- 172.21.15.47:0/3665552421 shutdown_connections 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.323+0000 7f89614cd740 1 --2- 172.21.15.47:0/3665552421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb7998b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.323+0000 7f89614cd740 1 --2- 172.21.15.47:0/3665552421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75cd2f0 0x55fdb7998610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.323+0000 7f89614cd740 1 --2- 172.21.15.47:0/3665552421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75b4d80 0x55fdb7999220 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.323+0000 7f89614cd740 1 -- 172.21.15.47:0/3665552421 >> 172.21.15.47:0/3665552421 conn(0x55fdb75ea300 msgr2=0x55fdb79945c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.324+0000 7f89614cd740 1 -- 172.21.15.47:0/3665552421 shutdown_connections 2024-09-21T01:00:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.324+0000 7f89614cd740 1 -- 172.21.15.47:0/3665552421 wait complete. 2024-09-21T01:00:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.325+0000 7f89614cd740 1 -- start start 2024-09-21T01:00:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.325+0000 7f89614cd740 1 Processor -- start 2024-09-21T01:00:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f89614cd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75b4d80 0x55fdb79ac910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f89614cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f89614cd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb79adb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8953fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75b4d80 0x55fdb79ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8953fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75b4d80 0x55fdb79ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36874/0 (socket says 172.21.15.47:36874) 2024-09-21T01:00:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8953fff640 1 -- 172.21.15.47:0/3776155115 learned_addr learned my addr 172.21.15.47:0/3776155115 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89541a78a0 con 0x55fdb75b4d80 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f89541a8d10 con 0x55fdb75d54d0 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89541a7f70 con 0x55fdb75cd2f0 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f89537fe640 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8958afb640 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb79adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f89614cd740 10 client.0 _ll_register_callbacks cb 0x7f8944009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8953fff640 1 -- 172.21.15.47:0/3776155115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 msgr2=0x55fdb79acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8953fff640 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8953fff640 1 -- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 msgr2=0x55fdb79adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8953fff640 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb79adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.326+0000 7f8953fff640 1 -- 172.21.15.47:0/3776155115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb79ae2a0 con 0x55fdb75b4d80 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f8958afb640 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb79adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f8953fff640 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75b4d80 0x55fdb79ac910 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f894400eb30 tx=0x7f894400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b700b7ca47cbf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f89337fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f89337fe640 1 -- 172.21.15.47:0/3776155115 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944048060 con 0x55fdb75b4d80 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f89337fe640 1 -- 172.21.15.47:0/3776155115 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f894402c040 con 0x55fdb75b4d80 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fdb790e0f0 con 0x55fdb75b4d80 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f89337fe640 1 -- 172.21.15.47:0/3776155115 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f89440269f0 con 0x55fdb75b4d80 2024-09-21T01:00:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f89614cd740 10 client.15612 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.327+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fdb79af5d0 con 0x55fdb75b4d80 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89337fe640 1 -- 172.21.15.47:0/3776155115 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fdb790e0f0 con 0x55fdb75b4d80 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89337fe640 1 -- 172.21.15.47:0/3776155115 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f894404d070 con 0x55fdb75b4d80 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89614cd740 10 client.15612 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89614cd740 10 client.15612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89614cd740 20 client.15612 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89614cd740 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55fdb75f61b0 0x55fdb7a32b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89614cd740 4 client.15612 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdb790b520 con 0x55fdb75f61b0 2024-09-21T01:00:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.328+0000 7f89537fe640 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55fdb75f61b0 0x55fdb7a32b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.329+0000 7f89337fe640 10 client.15612 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:20.329+0000 7f89537fe640 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55fdb75f61b0 0x55fdb7a32b60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c8b51eb4b5af9c server_cookie=7b551636b0f857a7 in_seq=0 out_seq=0 2024-09-21T01:00:21.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:20 smithi134 ceph-mon[34785]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 399 MiB/s wr, 3.51k op/s 2024-09-21T01:00:21.149 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:20 smithi047 ceph-mon[30960]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 399 MiB/s wr, 3.51k op/s 2024-09-21T01:00:21.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:20 smithi114 ceph-mon[34309]: pgmap v394: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 399 MiB/s wr, 3.51k op/s 2024-09-21T01:00:23.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:22 smithi134 ceph-mon[34785]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 330 MiB/s wr, 4.21k op/s 2024-09-21T01:00:23.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:22 smithi114 ceph-mon[34309]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 330 MiB/s wr, 4.21k op/s 2024-09-21T01:00:23.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:22 smithi047 ceph-mon[30960]: pgmap v395: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 330 MiB/s wr, 4.21k op/s 2024-09-21T01:00:25.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:24 smithi134 ceph-mon[34785]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 267 MiB/s wr, 6.25k op/s 2024-09-21T01:00:25.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:24 smithi114 ceph-mon[34309]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 267 MiB/s wr, 6.25k op/s 2024-09-21T01:00:25.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:24 smithi047 ceph-mon[30960]: pgmap v396: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 267 MiB/s wr, 6.25k op/s 2024-09-21T01:00:27.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:26 smithi134 ceph-mon[34785]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 99 MiB/s wr, 6.67k op/s 2024-09-21T01:00:27.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:26 smithi114 ceph-mon[34309]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 99 MiB/s wr, 6.67k op/s 2024-09-21T01:00:27.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:26 smithi047 ceph-mon[30960]: pgmap v397: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 99 MiB/s wr, 6.67k op/s 2024-09-21T01:00:28.545 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:00:28.872 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:28.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:28 smithi047 ceph-mon[30960]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 67 MiB/s wr, 8.03k op/s 2024-09-21T01:00:29.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:28 smithi134 ceph-mon[34785]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 67 MiB/s wr, 8.03k op/s 2024-09-21T01:00:29.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:28 smithi114 ceph-mon[34309]: pgmap v398: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 67 MiB/s wr, 8.03k op/s 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 -- 172.21.15.47:0/265740751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 msgr2=0x7ff5e8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/265740751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 0x7ff5e8102e90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009900 tx=0x7ff5dc02a410 comp rx=0 tx=0).stop 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 -- 172.21.15.47:0/265740751 shutdown_connections 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/265740751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8108d10 0x7ff5e810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/265740751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5e81083c0 0x7ff5e81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/265740751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 0x7ff5e8102e90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 -- 172.21.15.47:0/265740751 >> 172.21.15.47:0/265740751 conn(0x7ff5e8079740 msgr2=0x7ff5e8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 -- 172.21.15.47:0/265740751 shutdown_connections 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.020+0000 7ff5ef08e640 1 -- 172.21.15.47:0/265740751 wait complete. 2024-09-21T01:00:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ef08e640 1 Processor -- start 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ef08e640 1 -- start start 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ef08e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 0x7ff5e810fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ef08e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5e81083c0 0x7ff5e8110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ef08e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8108d10 0x7ff5e8110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ef08e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8113a90 con 0x7ff5e8102a80 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ef08e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8113910 con 0x7ff5e8108d10 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ef08e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e8113c10 con 0x7ff5e81083c0 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ece2a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 0x7ff5e810fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ece2a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 0x7ff5e810fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55424/0 (socket says 172.21.15.47:55424) 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ece2a640 1 -- 172.21.15.47:0/2102938823 learned_addr learned my addr 172.21.15.47:0/2102938823 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8108d10 0x7ff5e8110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5e81083c0 0x7ff5e8110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ece2a640 1 -- 172.21.15.47:0/2102938823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5e81083c0 msgr2=0x7ff5e8110310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.021+0000 7ff5ece2a640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5e81083c0 0x7ff5e8110310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5ece2a640 1 -- 172.21.15.47:0/2102938823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8108d10 msgr2=0x7ff5e8110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5ece2a640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8108d10 0x7ff5e8110850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5ece2a640 1 -- 172.21.15.47:0/2102938823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e81a87a0 con 0x7ff5e8102a80 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8108d10 0x7ff5e8110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5ece2a640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 0x7ff5e810fdd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc005940 tx=0x7ff5dc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5e5ffb640 1 -- 172.21.15.47:0/2102938823 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc03f030 con 0x7ff5e8102a80 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5e5ffb640 1 -- 172.21.15.47:0/2102938823 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5dc0044c0 con 0x7ff5e8102a80 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5e5ffb640 1 -- 172.21.15.47:0/2102938823 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc035070 con 0x7ff5e8102a80 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5ef08e640 1 -- 172.21.15.47:0/2102938823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e81a8a30 con 0x7ff5e8102a80 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.022+0000 7ff5ef08e640 1 -- 172.21.15.47:0/2102938823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e81a8ec0 con 0x7ff5e8102a80 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5f5602740 1 Processor -- start 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5e5ffb640 1 -- 172.21.15.47:0/2102938823 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff5dc042030 con 0x7ff5e8102a80 2024-09-21T01:00:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5f5602740 1 -- start start 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472ab3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ab3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472ab40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5f5602740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557472a29e50 con 0x5574726e31b0 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5f5602740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x557472a19280 con 0x5574726eb390 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5f5602740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557472a1d090 con 0x55747270c070 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5ed62b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472ab3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5ece2a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ab3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5ed62b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472ab3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:60092/0 (socket says 172.21.15.47:60092) 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5ed62b640 1 -- 172.21.15.47:0/3501312454 learned_addr learned my addr 172.21.15.47:0/3501312454 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.025+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/3501312454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472ab40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5ed62b640 1 -- 172.21.15.47:0/3501312454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 msgr2=0x557472ab40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/3501312454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472ab40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5ed62b640 1 -- 172.21.15.47:0/3501312454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 msgr2=0x557472ab3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/3501312454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ab3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5ed62b640 1 -- 172.21.15.47:0/3501312454 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557472777650 con 0x55747270c070 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/3501312454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472ab3650 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0011790 tx=0x7ff5e0011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f038b642f5acc0e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5d2ffd640 1 -- 172.21.15.47:0/3501312454 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0003c30 con 0x55747270c070 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5e5ffb640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5d80b6590 0x7ff5d80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5d2ffd640 1 -- 172.21.15.47:0/3501312454 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5e000fe50 con 0x55747270c070 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5d2ffd640 1 -- 172.21.15.47:0/3501312454 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00193e0 con 0x55747270c070 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5ece2a640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5d80b6590 0x7ff5d80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.026+0000 7ff5e5ffb640 1 -- 172.21.15.47:0/2102938823 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff5dc107520 con 0x7ff5e8102a80 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 -- 172.21.15.47:0/3501312454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 msgr2=0x557472ab3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5ece2a640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5d80b6590 0x7ff5d80b8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0cd790 tx=0x7ff5dc10d0e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 --2- 172.21.15.47:0/3501312454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472ab3650 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0011790 tx=0x7ff5e0011c50 comp rx=0 tx=0).stop 2024-09-21T01:00:30.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 -- 172.21.15.47:0/3501312454 shutdown_connections 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 --2- 172.21.15.47:0/3501312454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472ab40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 --2- 172.21.15.47:0/3501312454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ab3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 --2- 172.21.15.47:0/3501312454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472ab3650 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 -- 172.21.15.47:0/3501312454 >> 172.21.15.47:0/3501312454 conn(0x557472700460 msgr2=0x557472ab1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 -- 172.21.15.47:0/3501312454 shutdown_connections 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.027+0000 7ff5f5602740 1 -- 172.21.15.47:0/3501312454 wait complete. 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 1 -- start start 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 1 Processor -- start 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472abece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472abf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472abf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55747287a700 con 0x5574726e31b0 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5574729b4110 con 0x5574726eb390 2024-09-21T01:00:30.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557472ac1e30 con 0x55747270c070 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5f5602740 10 client.0 _ll_register_callbacks cb 0x5574729cd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5ed62b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472abece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5e7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472abf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5ed62b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472abece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55442/0 (socket says 172.21.15.47:55442) 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5ed62b640 1 -- 172.21.15.47:0/856721025 learned_addr learned my addr 172.21.15.47:0/856721025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.028+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472abf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5e7fff640 1 -- 172.21.15.47:0/856721025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 msgr2=0x557472abf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472abf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5e7fff640 1 -- 172.21.15.47:0/856721025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 msgr2=0x557472abece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472abece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5e7fff640 1 -- 172.21.15.47:0/856721025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574729e1c40 con 0x5574726eb390 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472abf220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5e806b6c0 tx=0x7ff5d4012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b684a3eaa23b29b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:30.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5c7fff640 1 -- 172.21.15.47:0/856721025 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4004020 con 0x5574726eb390 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5c7fff640 1 -- 172.21.15.47:0/856721025 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff5d40041c0 con 0x5574726eb390 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5f5602740 1 -- 172.21.15.47:0/856721025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5e000fe50 con 0x5574726eb390 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5c7fff640 1 -- 172.21.15.47:0/856721025 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff5d40043c0 con 0x5574726eb390 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5f5602740 10 client.25298 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.029+0000 7ff5f5602740 1 -- 172.21.15.47:0/856721025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557472acdbc0 con 0x5574726eb390 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5c7fff640 1 -- 172.21.15.47:0/856721025 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5e000fe50 con 0x5574726eb390 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5c7fff640 1 -- 172.21.15.47:0/856721025 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff5d4003ae0 con 0x5574726eb390 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5f5602740 10 client.25298 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5f5602740 10 client.25298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5f5602740 20 client.25298 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5f5602740 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5574726ca9f0 0x557472ad11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5f5602740 4 client.25298 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5f5602740 1 -- 172.21.15.47:0/856721025 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557472a2bda0 con 0x5574726ca9f0 2024-09-21T01:00:30.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5574726ca9f0 0x557472ad11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5c7fff640 10 client.25298 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.030+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5574726ca9f0 0x557472ad11d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfd46abde6098b01 server_cookie=4a3da17bff747498 in_seq=0 out_seq=0 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5c7fff640 1 -- 172.21.15.47:0/856721025 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557472a2bda0 con 0x5574726ca9f0 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5c7fff640 10 client.25298 handle_command_reply: tid=0 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 client.25298 shutdown 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 -- 172.21.15.47:0/856721025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 msgr2=0x557472abf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472abf220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5e806b6c0 tx=0x7ff5d4012b60 comp rx=0 tx=0).stop 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 -- 172.21.15.47:0/856721025 shutdown_connections 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5574726ca9f0 0x557472ad11d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55747270c070 0x557472abf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5574726eb390 0x557472abf220 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5c7fff640 0 client.25298 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:30.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 --2- 172.21.15.47:0/856721025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472abece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.031+0000 7ff5f5602740 1 -- 172.21.15.47:0/856721025 >> 172.21.15.47:0/856721025 conn(0x557472700460 msgr2=0x557472ab67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.032+0000 7ff5f5602740 1 -- 172.21.15.47:0/856721025 shutdown_connections 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.032+0000 7ff5f5602740 1 -- 172.21.15.47:0/856721025 wait complete. 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.032+0000 7ff5f5602740 20 client.25298 trim_cache size 0 max 16384 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.049+0000 7ff5f5602740 1 Processor -- start 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5f5602740 1 -- start start 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ac0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726eb390 0x557472abbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472abc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5f5602740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e81af410 con 0x5574726e31b0 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5f5602740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e81b1c70 con 0x55747270c070 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5f5602740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e81afa60 con 0x5574726eb390 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ac0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ac0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55452/0 (socket says 172.21.15.47:55452) 2024-09-21T01:00:30.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 -- 172.21.15.47:0/3372259927 learned_addr learned my addr 172.21.15.47:0/3372259927 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472abc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726eb390 0x557472abbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 -- 172.21.15.47:0/3372259927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726eb390 msgr2=0x557472abbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726eb390 0x557472abbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 -- 172.21.15.47:0/3372259927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 msgr2=0x557472abc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472abc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.050+0000 7ff5ed62b640 1 -- 172.21.15.47:0/3372259927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557472abdc40 con 0x5574726e31b0 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.051+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ac0910 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0000f80 tx=0x7ff5e0004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1881c1d27bb11923 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.051+0000 7ff5d27fc640 1 -- 172.21.15.47:0/3372259927 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e001f040 con 0x5574726e31b0 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.051+0000 7ff5d27fc640 1 -- 172.21.15.47:0/3372259927 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5e000fe50 con 0x5574726e31b0 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.051+0000 7ff5d27fc640 1 -- 172.21.15.47:0/3372259927 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00057b0 con 0x5574726e31b0 2024-09-21T01:00:30.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 -- 172.21.15.47:0/3372259927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 msgr2=0x557472ac0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ac0910 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0000f80 tx=0x7ff5e0004710 comp rx=0 tx=0).stop 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 -- 172.21.15.47:0/3372259927 shutdown_connections 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472abc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726eb390 0x557472abbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 --2- 172.21.15.47:0/3372259927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726e31b0 0x557472ac0910 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 -- 172.21.15.47:0/3372259927 >> 172.21.15.47:0/3372259927 conn(0x557472700460 msgr2=0x557472ac0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 -- 172.21.15.47:0/3372259927 shutdown_connections 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 -- 172.21.15.47:0/3372259927 wait complete. 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 -- start start 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.052+0000 7ff5f5602740 1 Processor -- start 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726e31b0 0x557472ac3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726eb390 0x557472ac3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5f5602740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472b3ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5f5602740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e81b0130 con 0x5574726eb390 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5f5602740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e81b15a0 con 0x55747270c070 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5f5602740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e81b0800 con 0x5574726e31b0 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5f5602740 10 client.0 _ll_register_callbacks cb 0x7ff5d4009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726eb390 0x557472ac3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726eb390 0x557472ac3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55456/0 (socket says 172.21.15.47:55456) 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 -- 172.21.15.47:0/761445503 learned_addr learned my addr 172.21.15.47:0/761445503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5ed62b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726e31b0 0x557472ac3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472b3ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 -- 172.21.15.47:0/761445503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726e31b0 msgr2=0x557472ac3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726e31b0 0x557472ac3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 -- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 msgr2=0x557472b3ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472b3ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 -- 172.21.15.47:0/761445503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557472b3b0d0 con 0x5574726eb390 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472b3ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:30.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5e7fff640 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726eb390 0x557472ac3da0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4000c00 tx=0x7ff5d40096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152f124335f42965 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5c7fff640 1 -- 172.21.15.47:0/761445503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d400fc70 con 0x5574726eb390 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5c7fff640 1 -- 172.21.15.47:0/761445503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff5d400fe10 con 0x5574726eb390 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.053+0000 7ff5f5602740 1 -- 172.21.15.47:0/761445503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5e000fe50 con 0x5574726eb390 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5c7fff640 1 -- 172.21.15.47:0/761445503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff5d40035f0 con 0x5574726eb390 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5f5602740 10 client.15630 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5f5602740 1 -- 172.21.15.47:0/761445503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557472b3c3d0 con 0x5574726eb390 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5c7fff640 1 -- 172.21.15.47:0/761445503 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5e000fe50 con 0x5574726eb390 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5c7fff640 1 -- 172.21.15.47:0/761445503 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff5d401c950 con 0x5574726eb390 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5f5602740 10 client.15630 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5f5602740 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5f5602740 20 client.15630 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:30.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5f5602740 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55747269fda0 0x557472b3ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5f5602740 4 client.15630 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5f5602740 1 -- 172.21.15.47:0/761445503 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557472a27850 con 0x55747269fda0 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.054+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55747269fda0 0x557472b3ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5c7fff640 10 client.15630 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5ed62b640 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55747269fda0 0x557472b3ebf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88bccd3223963e41 server_cookie=3fe94d48dbfd76f5 in_seq=0 out_seq=0 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5c7fff640 1 -- 172.21.15.47:0/761445503 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x557472a27850 con 0x55747269fda0 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5c7fff640 10 client.15630 handle_command_reply: tid=0 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 client.15630 shutdown 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 -- 172.21.15.47:0/761445503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726eb390 msgr2=0x557472ac3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726eb390 0x557472ac3da0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4000c00 tx=0x7ff5d40096a0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 -- 172.21.15.47:0/761445503 shutdown_connections 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55747269fda0 0x557472b3ebf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55747270c070 0x557472b3ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5c7fff640 0 client.15630 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:30.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5574726eb390 0x557472ac3da0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 --2- 172.21.15.47:0/761445503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574726e31b0 0x557472ac3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 -- 172.21.15.47:0/761445503 >> 172.21.15.47:0/761445503 conn(0x557472700460 msgr2=0x557472ac0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:30.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 -- 172.21.15.47:0/761445503 shutdown_connections 2024-09-21T01:00:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:00:30.140 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-09-21T01:00:30.140 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-09-21T01:00:30.140 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:00:30.140 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:00:30.141 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:00:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.055+0000 7ff5f5602740 1 -- 172.21.15.47:0/761445503 wait complete. 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5f5602740 20 client.15630 trim_cache size 0 max 16384 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 -- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5d80b6590 msgr2=0x7ff5d80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5d80b6590 0x7ff5d80b8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0cd790 tx=0x7ff5dc10d0e0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 -- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 msgr2=0x7ff5e810fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 0x7ff5e810fdd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc005940 tx=0x7ff5dc0040c0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 -- 172.21.15.47:0/2102938823 shutdown_connections 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff5d80b6590 0x7ff5d80b8aa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8108d10 0x7ff5e8110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5e81083c0 0x7ff5e8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 --2- 172.21.15.47:0/2102938823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5e8102a80 0x7ff5e810fdd0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:30.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 -- 172.21.15.47:0/2102938823 >> 172.21.15.47:0/2102938823 conn(0x7ff5e8079740 msgr2=0x7ff5e81014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:30.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 -- 172.21.15.47:0/2102938823 shutdown_connections 2024-09-21T01:00:30.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:30.056+0000 7ff5ef08e640 1 -- 172.21.15.47:0/2102938823 wait complete. 2024-09-21T01:00:30.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:30 smithi047 ceph-mon[30960]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 52 MiB/s wr, 6.96k op/s 2024-09-21T01:00:31.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:30 smithi134 ceph-mon[34785]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 52 MiB/s wr, 6.96k op/s 2024-09-21T01:00:31.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:30 smithi114 ceph-mon[34309]: pgmap v399: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 52 MiB/s wr, 6.96k op/s 2024-09-21T01:00:31.540 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:00:31.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:00:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 -- 172.21.15.47:0/98022095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 msgr2=0x7f264410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 --2- 172.21.15.47:0/98022095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 0x7f264410d880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2630009900 tx=0x7f263002a410 comp rx=0 tx=0).stop 2024-09-21T01:00:33.045 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:32 smithi047 ceph-mon[30960]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 50 MiB/s wr, 6.37k op/s 2024-09-21T01:00:33.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 -- 172.21.15.47:0/98022095 shutdown_connections 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 --2- 172.21.15.47:0/98022095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f264410de40 0x7f2644110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 --2- 172.21.15.47:0/98022095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 0x7f264410d880 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 --2- 172.21.15.47:0/98022095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26441049e0 0x7f2644104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 -- 172.21.15.47:0/98022095 >> 172.21.15.47:0/98022095 conn(0x7f2644079750 msgr2=0x7f2644079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 -- 172.21.15.47:0/98022095 shutdown_connections 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.002+0000 7f264aa80640 1 -- 172.21.15.47:0/98022095 wait complete. 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.003+0000 7f264aa80640 1 Processor -- start 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.003+0000 7f264aa80640 1 -- start start 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264aa80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26441049e0 0x7f264419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264aa80640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 0x7f264419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:33.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264aa80640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264410de40 0x7f264419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264aa80640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2644113aa0 con 0x7f2644105330 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264aa80640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2644113920 con 0x7f264410de40 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264aa80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2644113c20 con 0x7f26441049e0 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 0x7f264419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 0x7f264419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51900/0 (socket says 172.21.15.47:51900) 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 -- 172.21.15.47:0/3976791766 learned_addr learned my addr 172.21.15.47:0/3976791766 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264881c640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26441049e0 0x7f264419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264901d640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264410de40 0x7f264419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 -- 172.21.15.47:0/3976791766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26441049e0 msgr2=0x7f264419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26441049e0 0x7f264419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 -- 172.21.15.47:0/3976791766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264410de40 msgr2=0x7f264419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264410de40 0x7f264419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 -- 172.21.15.47:0/3976791766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26441a0420 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f264901d640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264410de40 0x7f264419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.004+0000 7f2643fff640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 0x7f264419aa50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2630006010 tx=0x7f2630004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.005+0000 7f2641ffb640 1 -- 172.21.15.47:0/3976791766 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630048070 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.005+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26441a06b0 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.005+0000 7f2641ffb640 1 -- 172.21.15.47:0/3976791766 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26300044a0 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.005+0000 7f2641ffb640 1 -- 172.21.15.47:0/3976791766 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630035050 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.005+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2644102600 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.006+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264406c280 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.008+0000 7f2641ffb640 1 -- 172.21.15.47:0/3976791766 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f263004b070 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.009+0000 7f2641ffb640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f26340b6510 0x7f26340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.009+0000 7f264881c640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f26340b6510 0x7f26340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.009+0000 7f2641ffb640 1 -- 172.21.15.47:0/3976791766 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f263010b1a0 con 0x7f2644105330 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.009+0000 7f264881c640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f26340b6510 0x7f26340b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f264406c980 tx=0x7f263800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:33.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.012+0000 7f2641ffb640 1 -- 172.21.15.47:0/3976791766 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2630052080 con 0x7f2644105330 2024-09-21T01:00:33.093 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:32 smithi134 ceph-mon[34785]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 50 MiB/s wr, 6.37k op/s 2024-09-21T01:00:33.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:32 smithi114 ceph-mon[34309]: pgmap v400: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 50 MiB/s wr, 6.37k op/s 2024-09-21T01:00:33.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.248+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2644104df0 con 0x7f2644105330 2024-09-21T01:00:33.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.249+0000 7f2641ffb640 1 -- 172.21.15.47:0/3976791766 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f2644104df0 con 0x7f2644105330 2024-09-21T01:00:33.250 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:00:33.250 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:00:33.250 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f26340b6510 msgr2=0x7f26340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f26340b6510 0x7f26340b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f264406c980 tx=0x7f263800b390 comp rx=0 tx=0).stop 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 msgr2=0x7f264419aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 0x7f264419aa50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2630006010 tx=0x7f2630004060 comp rx=0 tx=0).stop 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 shutdown_connections 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f26340b6510 0x7f26340b8a20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f264410de40 0x7f264419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2644105330 0x7f264419aa50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 --2- 172.21.15.47:0/3976791766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26441049e0 0x7f264419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:33.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 >> 172.21.15.47:0/3976791766 conn(0x7f2644079750 msgr2=0x7f2644106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:33.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 shutdown_connections 2024-09-21T01:00:33.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:33.251+0000 7f264aa80640 1 -- 172.21.15.47:0/3976791766 wait complete. 2024-09-21T01:00:34.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:33 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3976791766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:00:34.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:33 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3976791766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:00:34.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:33 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3976791766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:00:34.588 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:00:34.853 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:34.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:34 smithi047 ceph-mon[30960]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 60 MiB/s wr, 7.27k op/s 2024-09-21T01:00:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89337fe640 1 -- 172.21.15.47:0/3776155115 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdb790b520 con 0x55fdb75f61b0 2024-09-21T01:00:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89337fe640 10 client.15612 handle_command_reply: tid=0 2024-09-21T01:00:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 client.15612 shutdown 2024-09-21T01:00:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75b4d80 msgr2=0x55fdb79ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75b4d80 0x55fdb79ac910 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f894400eb30 tx=0x7f894400eb60 comp rx=0 tx=0).stop 2024-09-21T01:00:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 shutdown_connections 2024-09-21T01:00:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55fdb75f61b0 0x55fdb7a32b60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55fdb75d54d0 0x55fdb79adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fdb75cd2f0 0x55fdb79acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 --2- 172.21.15.47:0/3776155115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fdb75b4d80 0x55fdb79ac910 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 >> 172.21.15.47:0/3776155115 conn(0x55fdb75ea300 msgr2=0x55fdb7998580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89337fe640 0 client.15612 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.030+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 shutdown_connections 2024-09-21T01:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f89614cd740 1 -- 172.21.15.47:0/3776155115 wait complete. 2024-09-21T01:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f89614cd740 20 client.15612 trim_cache size 0 max 16384 2024-09-21T01:00:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:00:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:00:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:00:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 -- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f893c0ba9a0 msgr2=0x7f893c0bceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f893c0ba9a0 0x7f893c0bceb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f894400f650 tx=0x7f8944005f90 comp rx=0 tx=0).stop 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 -- 172.21.15.47:0/2634029901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89541050d0 msgr2=0x7f895419b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89541050d0 0x7f895419b130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f894c009fd0 tx=0x7f894c00ef10 comp rx=0 tx=0).stop 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 -- 172.21.15.47:0/2634029901 shutdown_connections 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f893c0ba9a0 0x7f893c0bceb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89541050d0 0x7f895419b130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8954104730 0x7f895419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 --2- 172.21.15.47:0/2634029901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89541036b0 0x7f8954199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.031+0000 7f895a55e640 1 -- 172.21.15.47:0/2634029901 >> 172.21.15.47:0/2634029901 conn(0x7f89540feff0 msgr2=0x7f8954107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.035 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.032+0000 7f895a55e640 1 -- 172.21.15.47:0/2634029901 shutdown_connections 2024-09-21T01:00:35.036 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:35.032+0000 7f895a55e640 1 -- 172.21.15.47:0/2634029901 wait complete. 2024-09-21T01:00:35.093 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:34 smithi134 ceph-mon[34785]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 60 MiB/s wr, 7.27k op/s 2024-09-21T01:00:35.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:34 smithi114 ceph-mon[34309]: pgmap v401: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 60 MiB/s wr, 7.27k op/s 2024-09-21T01:00:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 -- 172.21.15.47:0/3125578678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c01083a0 msgr2=0x7f02c01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 --2- 172.21.15.47:0/3125578678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c01083a0 0x7f02c01087b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009900 tx=0x7f02b402a410 comp rx=0 tx=0).stop 2024-09-21T01:00:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 -- 172.21.15.47:0/3125578678 shutdown_connections 2024-09-21T01:00:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 --2- 172.21.15.47:0/3125578678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c0108cf0 0x7f02c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 --2- 172.21.15.47:0/3125578678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c01083a0 0x7f02c01087b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 --2- 172.21.15.47:0/3125578678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c0102a60 0x7f02c0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 -- 172.21.15.47:0/3125578678 >> 172.21.15.47:0/3125578678 conn(0x7f02c0079730 msgr2=0x7f02c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 -- 172.21.15.47:0/3125578678 shutdown_connections 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 -- 172.21.15.47:0/3125578678 wait complete. 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 Processor -- start 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.754+0000 7f02c6327640 1 -- start start 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02c6327640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c0102a60 0x7f02c019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02c6327640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c01083a0 0x7f02c019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02c6327640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c0108cf0 0x7f02c019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02c6327640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02c0112960 con 0x7f02c0102a60 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02c6327640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01127e0 con 0x7f02c01083a0 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02c6327640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02c0112ae0 con 0x7f02c0108cf0 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c0102a60 0x7f02c019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c0102a60 0x7f02c019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51924/0 (socket says 172.21.15.47:51924) 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02c48c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c0108cf0 0x7f02c019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bffff640 1 -- 172.21.15.47:0/2032444791 learned_addr learned my addr 172.21.15.47:0/2032444791 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bf7fe640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c01083a0 0x7f02c019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bffff640 1 -- 172.21.15.47:0/2032444791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c0108cf0 msgr2=0x7f02c019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bffff640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c0108cf0 0x7f02c019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bffff640 1 -- 172.21.15.47:0/2032444791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c01083a0 msgr2=0x7f02c019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bffff640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c01083a0 0x7f02c019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.755+0000 7f02bffff640 1 -- 172.21.15.47:0/2032444791 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c01a0470 con 0x7f02c0102a60 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.756+0000 7f02bffff640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c0102a60 0x7f02c019a500 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f02b000d950 tx=0x7f02b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.756+0000 7f02bd7fa640 1 -- 172.21.15.47:0/2032444791 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0017070 con 0x7f02c0102a60 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.756+0000 7f02c6327640 1 -- 172.21.15.47:0/2032444791 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c01a0760 con 0x7f02c0102a60 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.756+0000 7f02bd7fa640 1 -- 172.21.15.47:0/2032444791 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02b0009c30 con 0x7f02c0102a60 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.756+0000 7f02c6327640 1 -- 172.21.15.47:0/2032444791 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c01a6ec0 con 0x7f02c0102a60 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.756+0000 7f02bd7fa640 1 -- 172.21.15.47:0/2032444791 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b000f620 con 0x7f02c0102a60 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.758+0000 7f02cc89b740 1 Processor -- start 2024-09-21T01:00:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02cc89b740 1 -- start start 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d8f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d8f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d8fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02cc89b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562ef8d05ea0 con 0x562ef89c7390 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02cc89b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562ef8cf52d0 con 0x562ef89e8070 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bd7fa640 1 -- 172.21.15.47:0/2032444791 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f02b0010460 con 0x7f02c0102a60 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02cc89b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562ef8cf90e0 con 0x562ef89bf1b0 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d8fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d8fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51938/0 (socket says 172.21.15.47:51938) 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bf7fe640 1 -- 172.21.15.47:0/3405825586 learned_addr learned my addr 172.21.15.47:0/3405825586 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02c48c4640 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d8f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bffff640 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d8f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bf7fe640 1 -- 172.21.15.47:0/3405825586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 msgr2=0x562ef8d8f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bf7fe640 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d8f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bf7fe640 1 -- 172.21.15.47:0/3405825586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 msgr2=0x562ef8d8f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bf7fe640 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d8f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02bf7fe640 1 -- 172.21.15.47:0/3405825586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef8a53650 con 0x562ef89c7390 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.759+0000 7f02c48c4640 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d8f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.760+0000 7f02bf7fe640 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d8fd40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009900 tx=0x7f02b4032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9026dcb70e2fd14e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.760+0000 7f02a67fc640 1 -- 172.21.15.47:0/3405825586 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4040070 con 0x562ef89c7390 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.760+0000 7f02bd7fa640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02a80b6510 0x7f02a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.760+0000 7f02a67fc640 1 -- 172.21.15.47:0/3405825586 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02b4004030 con 0x562ef89c7390 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.760+0000 7f02a67fc640 1 -- 172.21.15.47:0/3405825586 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4035040 con 0x562ef89c7390 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.760+0000 7f02c48c4640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02a80b6510 0x7f02a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.760+0000 7f02bd7fa640 1 -- 172.21.15.47:0/2032444791 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f02b00e6dc0 con 0x7f02c0102a60 2024-09-21T01:00:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 -- 172.21.15.47:0/3405825586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 msgr2=0x562ef8d8fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02c48c4640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02a80b6510 0x7f02a80b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009fd0 tx=0x7f02b8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d8fd40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009900 tx=0x7f02b4032bd0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 -- 172.21.15.47:0/3405825586 shutdown_connections 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d8fd40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d8f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 --2- 172.21.15.47:0/3405825586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d8f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 -- 172.21.15.47:0/3405825586 >> 172.21.15.47:0/3405825586 conn(0x562ef89dc460 msgr2=0x562ef8d8d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 -- 172.21.15.47:0/3405825586 shutdown_connections 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.761+0000 7f02cc89b740 1 -- 172.21.15.47:0/3405825586 wait complete. 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 1 -- start start 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 1 Processor -- start 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d9a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d9ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d9b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562ef8b56700 con 0x562ef89c7390 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562ef8c90160 con 0x562ef89e8070 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562ef8da1e50 con 0x562ef89bf1b0 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02cc89b740 10 client.0 _ll_register_callbacks cb 0x562ef8ca99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02bf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d9ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02bffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d9a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02c48c4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d9b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02bf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d9ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51940/0 (socket says 172.21.15.47:51940) 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02bf7fe640 1 -- 172.21.15.47:0/343452850 learned_addr learned my addr 172.21.15.47:0/343452850 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.762+0000 7f02bffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d9a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:58562/0 (socket says 172.21.15.47:58562) 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02c48c4640 1 -- 172.21.15.47:0/343452850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 msgr2=0x562ef8d9a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02c48c4640 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d9a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02c48c4640 1 -- 172.21.15.47:0/343452850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 msgr2=0x562ef8d9ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02c48c4640 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d9ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02c48c4640 1 -- 172.21.15.47:0/343452850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef8cbdc90 con 0x562ef89e8070 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02bffff640 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d9a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02c48c4640 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d9b3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009d20 tx=0x7f02b8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930c9c6075acf7c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f029f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f029f7fe640 1 -- 172.21.15.47:0/343452850 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8003c40 con 0x562ef89e8070 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f029f7fe640 1 -- 172.21.15.47:0/343452850 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f02b8017030 con 0x562ef89e8070 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02cc89b740 1 -- 172.21.15.47:0/343452850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02b4004030 con 0x562ef89e8070 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f029f7fe640 1 -- 172.21.15.47:0/343452850 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f02b8003de0 con 0x562ef89e8070 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02cc89b740 10 client.25322 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.763+0000 7f02cc89b740 1 -- 172.21.15.47:0/343452850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562ef8dadb80 con 0x562ef89e8070 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f029f7fe640 1 -- 172.21.15.47:0/343452850 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02b4004030 con 0x562ef89e8070 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f029f7fe640 1 -- 172.21.15.47:0/343452850 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f02b801f820 con 0x562ef89e8070 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f02cc89b740 10 client.25322 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f02cc89b740 10 client.25322 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f02cc89b740 20 client.25322 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f02cc89b740 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ef89a69f0 0x562ef8db1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f02cc89b740 4 client.25322 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f02cc89b740 1 -- 172.21.15.47:0/343452850 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ef8d07df0 con 0x562ef89a69f0 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.764+0000 7f02bffff640 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ef89a69f0 0x562ef8db1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.765+0000 7f029f7fe640 10 client.25322 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.765+0000 7f02bffff640 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ef89a69f0 0x562ef8db1080 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea4e208bb5408d4c server_cookie=8659c396450aa0b6 in_seq=0 out_seq=0 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.765+0000 7f029f7fe640 1 -- 172.21.15.47:0/343452850 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ef8d07df0 con 0x562ef89a69f0 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.765+0000 7f029f7fe640 10 client.25322 handle_command_reply: tid=0 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.765+0000 7f02cc89b740 1 client.25322 shutdown 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 -- 172.21.15.47:0/343452850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 msgr2=0x562ef8d9b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d9b3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009d20 tx=0x7f02b8004ab0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 -- 172.21.15.47:0/343452850 shutdown_connections 2024-09-21T01:00:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ef89a69f0 0x562ef8db1080 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89e8070 0x562ef8d9b3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8d9ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f029f7fe640 0 client.25322 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 --2- 172.21.15.47:0/343452850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89bf1b0 0x562ef8d9a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 -- 172.21.15.47:0/343452850 >> 172.21.15.47:0/343452850 conn(0x562ef89dc460 msgr2=0x562ef8d92450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 -- 172.21.15.47:0/343452850 shutdown_connections 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 1 -- 172.21.15.47:0/343452850 wait complete. 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.766+0000 7f02cc89b740 20 client.25322 trim_cache size 0 max 16384 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.779+0000 7f02cc89b740 1 Processor -- start 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.779+0000 7f02cc89b740 1 -- start start 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89a69f0 0x562ef8d90cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 0x562ef8d9c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89c7390 0x562ef8d97af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02cc89b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01ab100 con 0x562ef89a69f0 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02cc89b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01ad980 con 0x562ef89bf1b0 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02cc89b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01ab770 con 0x562ef89c7390 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89a69f0 0x562ef8d90cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89a69f0 0x562ef8d90cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51946/0 (socket says 172.21.15.47:51946) 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 -- 172.21.15.47:0/3398617337 learned_addr learned my addr 172.21.15.47:0/3398617337 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02c48c4640 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89c7390 0x562ef8d97af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bf7fe640 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 0x562ef8d9c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 -- 172.21.15.47:0/3398617337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89c7390 msgr2=0x562ef8d97af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89c7390 0x562ef8d97af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 -- 172.21.15.47:0/3398617337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 msgr2=0x562ef8d9c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 0x562ef8d9c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 -- 172.21.15.47:0/3398617337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef8d98e00 con 0x562ef89a69f0 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02c48c4640 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89c7390 0x562ef8d97af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.780+0000 7f02bffff640 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89a69f0 0x562ef8d90cb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f02b00ad030 tx=0x7f02b00ea8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67788e8999cb42a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.781+0000 7f02a5ffb640 1 -- 172.21.15.47:0/3398617337 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0020040 con 0x562ef89a69f0 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.781+0000 7f02a5ffb640 1 -- 172.21.15.47:0/3398617337 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02b00b4e50 con 0x562ef89a69f0 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.781+0000 7f02a5ffb640 1 -- 172.21.15.47:0/3398617337 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b00b6a10 con 0x562ef89a69f0 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.781+0000 7f02cc89b740 1 -- 172.21.15.47:0/3398617337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89a69f0 msgr2=0x562ef8d90cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.781+0000 7f02cc89b740 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89a69f0 0x562ef8d90cb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f02b00ad030 tx=0x7f02b00ea8e0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.781+0000 7f02cc89b740 1 -- 172.21.15.47:0/3398617337 shutdown_connections 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.781+0000 7f02cc89b740 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89c7390 0x562ef8d97af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.782+0000 7f02cc89b740 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 0x562ef8d9c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.782+0000 7f02cc89b740 1 --2- 172.21.15.47:0/3398617337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89a69f0 0x562ef8d90cb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.782+0000 7f02cc89b740 1 -- 172.21.15.47:0/3398617337 >> 172.21.15.47:0/3398617337 conn(0x562ef89dc460 msgr2=0x562ef8d9be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.782+0000 7f02cc89b740 1 -- 172.21.15.47:0/3398617337 shutdown_connections 2024-09-21T01:00:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.782+0000 7f02cc89b740 1 -- 172.21.15.47:0/3398617337 wait complete. 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.782+0000 7f02cc89b740 1 -- start start 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.782+0000 7f02cc89b740 1 Processor -- start 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89a69f0 0x562ef8da74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 0x562ef8da7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02cc89b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8da2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02cc89b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01abe40 con 0x562ef89c7390 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02cc89b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01ad2b0 con 0x562ef89bf1b0 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02cc89b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01ac510 con 0x562ef89a69f0 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02cc89b740 10 client.0 _ll_register_callbacks cb 0x7f02b8009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02c48c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8da2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02bffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89a69f0 0x562ef8da74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02c48c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8da2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51954/0 (socket says 172.21.15.47:51954) 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02c48c4640 1 -- 172.21.15.47:0/1304448124 learned_addr learned my addr 172.21.15.47:0/1304448124 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02bf7fe640 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 0x562ef8da7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02bffff640 1 -- 172.21.15.47:0/1304448124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 msgr2=0x562ef8da7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02bffff640 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 0x562ef8da7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02bffff640 1 -- 172.21.15.47:0/1304448124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 msgr2=0x562ef8da2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02bffff640 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8da2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02bffff640 1 -- 172.21.15.47:0/1304448124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef8da3270 con 0x562ef89a69f0 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02c48c4640 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8da2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f02bffff640 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89a69f0 0x562ef8da74d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02b00ad030 tx=0x7f02b0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd827f088ebe29c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f029f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.783+0000 7f029f7fe640 1 -- 172.21.15.47:0/1304448124 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0020030 con 0x562ef89a69f0 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f029f7fe640 1 -- 172.21.15.47:0/1304448124 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f02b00983d0 con 0x562ef89a69f0 2024-09-21T01:00:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 1 -- 172.21.15.47:0/1304448124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02b00b4e50 con 0x562ef89a69f0 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f029f7fe640 1 -- 172.21.15.47:0/1304448124 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f02b0009de0 con 0x562ef89a69f0 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 10 client.25339 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 1 -- 172.21.15.47:0/1304448124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562ef8e1b5a0 con 0x562ef89a69f0 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f029f7fe640 1 -- 172.21.15.47:0/1304448124 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02b00b4e50 con 0x562ef89a69f0 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f029f7fe640 1 -- 172.21.15.47:0/1304448124 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f02b00abd70 con 0x562ef89a69f0 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 10 client.25339 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 10 client.25339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 20 client.25339 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ef89e8070 0x562ef8e1dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 4 client.25339 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02cc89b740 1 -- 172.21.15.47:0/1304448124 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ef8d038a0 con 0x562ef89e8070 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.784+0000 7f02bf7fe640 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ef89e8070 0x562ef8e1dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f029f7fe640 10 client.25339 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02bf7fe640 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ef89e8070 0x562ef8e1dca0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa57d99031e5575 server_cookie=625d6d53bdf501c7 in_seq=0 out_seq=0 2024-09-21T01:00:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f029f7fe640 1 -- 172.21.15.47:0/1304448124 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ef8d038a0 con 0x562ef89e8070 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f029f7fe640 10 client.25339 handle_command_reply: tid=0 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 client.25339 shutdown 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 -- 172.21.15.47:0/1304448124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89a69f0 msgr2=0x562ef8da74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89a69f0 0x562ef8da74d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02b00ad030 tx=0x7f02b0000bc0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 -- 172.21.15.47:0/1304448124 shutdown_connections 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ef89e8070 0x562ef8e1dca0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ef89c7390 0x562ef8da2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ef89bf1b0 0x562ef8da7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f029f7fe640 0 client.25339 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 --2- 172.21.15.47:0/1304448124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ef89a69f0 0x562ef8da74d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 -- 172.21.15.47:0/1304448124 >> 172.21.15.47:0/1304448124 conn(0x562ef89dc460 msgr2=0x562ef8daaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 -- 172.21.15.47:0/1304448124 shutdown_connections 2024-09-21T01:00:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 1 -- 172.21.15.47:0/1304448124 wait complete. 2024-09-21T01:00:35.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.785+0000 7f02cc89b740 20 client.25339 trim_cache size 0 max 16384 2024-09-21T01:00:35.878 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-09-21T01:00:35.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 -- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02a80b6510 msgr2=0x7f02a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02a80b6510 0x7f02a80b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009fd0 tx=0x7f02b8009500 comp rx=0 tx=0).stop 2024-09-21T01:00:35.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 -- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c0102a60 msgr2=0x7f02c019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:35.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c0102a60 0x7f02c019a500 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f02b000d950 tx=0x7f02b000de10 comp rx=0 tx=0).stop 2024-09-21T01:00:35.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 -- 172.21.15.47:0/2032444791 shutdown_connections 2024-09-21T01:00:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f02a80b6510 0x7f02a80b8a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c0108cf0 0x7f02c019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c01083a0 0x7f02c019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 --2- 172.21.15.47:0/2032444791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02c0102a60 0x7f02c019a500 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 -- 172.21.15.47:0/2032444791 >> 172.21.15.47:0/2032444791 conn(0x7f02c0079730 msgr2=0x7f02c006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 -- 172.21.15.47:0/2032444791 shutdown_connections 2024-09-21T01:00:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:35.786+0000 7f02c6327640 1 -- 172.21.15.47:0/2032444791 wait complete. 2024-09-21T01:00:37.062 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:36 smithi047 ceph-mon[30960]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 49 MiB/s wr, 5.70k op/s 2024-09-21T01:00:37.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:36 smithi134 ceph-mon[34785]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 49 MiB/s wr, 5.70k op/s 2024-09-21T01:00:37.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:36 smithi114 ceph-mon[34309]: pgmap v402: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 49 MiB/s wr, 5.70k op/s 2024-09-21T01:00:38.090 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:00:38.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:00:38.353 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:39.061 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:38 smithi047 ceph-mon[30960]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 61 MiB/s wr, 7.23k op/s 2024-09-21T01:00:39.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:38 smithi134 ceph-mon[34785]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 61 MiB/s wr, 7.23k op/s 2024-09-21T01:00:39.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:38 smithi114 ceph-mon[34309]: pgmap v403: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 61 MiB/s wr, 7.23k op/s 2024-09-21T01:00:39.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 -- 172.21.15.47:0/882909037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b0008e60 msgr2=0x7fb7b0009270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/882909037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b0008e60 0x7fb7b0009270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009900 tx=0x7fb7a402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 -- 172.21.15.47:0/882909037 shutdown_connections 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/882909037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b00a6cc0 0x7fb7b00a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/882909037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7b00097b0 0x7fb7b00a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/882909037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b0008e60 0x7fb7b0009270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 -- 172.21.15.47:0/882909037 >> 172.21.15.47:0/882909037 conn(0x7fb7b0093d70 msgr2=0x7fb7b00961c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 -- 172.21.15.47:0/882909037 shutdown_connections 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.244+0000 7fb7bcef7640 1 -- 172.21.15.47:0/882909037 wait complete. 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.246+0000 7fb7bcef7640 1 Processor -- start 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.246+0000 7fb7bcef7640 1 -- start start 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.247+0000 7fb7bcef7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7b0008e60 0x7fb7b0132e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.247+0000 7fb7bcef7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b00097b0 0x7fb7b01333a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.247+0000 7fb7b77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7b0008e60 0x7fb7b0132e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.247+0000 7fb7b77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7b0008e60 0x7fb7b0132e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51962/0 (socket says 172.21.15.47:51962) 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.248+0000 7fb7b77fe640 1 -- 172.21.15.47:0/1798860255 learned_addr learned my addr 172.21.15.47:0/1798860255 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.248+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b00a6cc0 0x7fb7b0138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.248+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b00097b0 0x7fb7b01333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.248+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b00ac680 con 0x7fb7b0008e60 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.249+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b00a6cc0 0x7fb7b0138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.249+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b00ac500 con 0x7fb7b00097b0 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.249+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b00ac800 con 0x7fb7b00a6cc0 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.250+0000 7fb7b77fe640 1 -- 172.21.15.47:0/1798860255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b00a6cc0 msgr2=0x7fb7b0138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.250+0000 7fb7b77fe640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b00a6cc0 0x7fb7b0138640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.250+0000 7fb7b77fe640 1 -- 172.21.15.47:0/1798860255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b00097b0 msgr2=0x7fb7b01333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.250+0000 7fb7b77fe640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b00097b0 0x7fb7b01333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.250+0000 7fb7b77fe640 1 -- 172.21.15.47:0/1798860255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b0138d70 con 0x7fb7b0008e60 2024-09-21T01:00:39.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.250+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b00a6cc0 0x7fb7b0138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.250+0000 7fb7b77fe640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7b0008e60 0x7fb7b0132e00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009850 tx=0x7fb7a4030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.250+0000 7fb7b4ff9640 1 -- 172.21.15.47:0/1798860255 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a403f070 con 0x7fb7b0008e60 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.251+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b0139000 con 0x7fb7b0008e60 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.251+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b0139470 con 0x7fb7b0008e60 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.251+0000 7fb7b4ff9640 1 -- 172.21.15.47:0/1798860255 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a4004460 con 0x7fb7b0008e60 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.251+0000 7fb7b4ff9640 1 -- 172.21.15.47:0/1798860255 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4049060 con 0x7fb7b0008e60 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.254+0000 7fb7c46cd740 1 Processor -- start 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7b4ff9640 1 -- 172.21.15.47:0/1798860255 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb7a4042070 con 0x7fb7b0008e60 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7c46cd740 1 -- start start 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e577b350 0x5580e5b22610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b22b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5b23090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580e5a98e60 con 0x5580e5752490 2024-09-21T01:00:39.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5580e5a88290 con 0x5580e575a670 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5580e5a8c0a0 con 0x5580e577b350 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e577b350 0x5580e5b22610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e577b350 0x5580e5b22610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:58618/0 (socket says 172.21.15.47:58618) 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7b7fff640 1 -- 172.21.15.47:0/2503210482 learned_addr learned my addr 172.21.15.47:0/2503210482 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7b77fe640 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b22b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.255+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5b23090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7b7fff640 1 -- 172.21.15.47:0/2503210482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 msgr2=0x5580e5b23090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5b23090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7b7fff640 1 -- 172.21.15.47:0/2503210482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 msgr2=0x5580e5b22b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b22b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7b7fff640 1 -- 172.21.15.47:0/2503210482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e57e6930 con 0x5580e577b350 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e577b350 0x5580e5b22610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8052910 tx=0x7fb7b8064940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92b89608de586a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:39.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7a1ffb640 1 -- 172.21.15.47:0/2503210482 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b806ba20 con 0x5580e577b350 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7a1ffb640 1 -- 172.21.15.47:0/2503210482 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7b806bbc0 con 0x5580e577b350 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.256+0000 7fb7a1ffb640 1 -- 172.21.15.47:0/2503210482 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b807e620 con 0x5580e577b350 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.257+0000 7fb7b4ff9640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb7a80b6590 0x7fb7a80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.257+0000 7fb7b77fe640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb7a80b6590 0x7fb7a80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.257+0000 7fb7b4ff9640 1 -- 172.21.15.47:0/1798860255 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb7a41079e0 con 0x7fb7b0008e60 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2503210482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e577b350 msgr2=0x5580e5b22610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7b77fe640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb7a80b6590 0x7fb7a80b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4041df0 tx=0x7fb7a400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e577b350 0x5580e5b22610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8052910 tx=0x7fb7b8064940 comp rx=0 tx=0).stop 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2503210482 shutdown_connections 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5b23090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b22b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/2503210482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e577b350 0x5580e5b22610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2503210482 >> 172.21.15.47:0/2503210482 conn(0x5580e576f740 msgr2=0x5580e5b20500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2503210482 shutdown_connections 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2503210482 wait complete. 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 -- start start 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.258+0000 7fb7c46cd740 1 Processor -- start 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b2e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5b2e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b2e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b2e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:58630/0 (socket says 172.21.15.47:58630) 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 -- 172.21.15.47:0/3091334044 learned_addr learned my addr 172.21.15.47:0/3091334044 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e577b350 0x5580e5b3a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580e58e9890 con 0x5580e577b350 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5580e5a22d40 con 0x5580e575a670 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5580e5b30df0 con 0x5580e5752490 2024-09-21T01:00:39.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e577b350 0x5580e5b3a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5b2e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 -- 172.21.15.47:0/3091334044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 msgr2=0x5580e5b2e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5b2e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 -- 172.21.15.47:0/3091334044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e577b350 msgr2=0x5580e5b3a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e577b350 0x5580e5b3a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.259+0000 7fb7b7fff640 1 -- 172.21.15.47:0/3091334044 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e5b3a680 con 0x5580e5752490 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b2e1e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80524b0 tx=0x7fb7b806a490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bef1ed90fe82aff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb796ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7c46cd740 10 client.0 _ll_register_callbacks cb 0x5580e5a86c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7b806bbc0 con 0x5580e5752490 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb796ffd640 1 -- 172.21.15.47:0/3091334044 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8080a50 con 0x5580e5752490 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb796ffd640 1 -- 172.21.15.47:0/3091334044 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb7b809a440 con 0x5580e5752490 2024-09-21T01:00:39.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb796ffd640 1 -- 172.21.15.47:0/3091334044 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb7b809a660 con 0x5580e5752490 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7c46cd740 10 client.25351 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5580e5b3cc80 con 0x5580e5752490 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb796ffd640 1 -- 172.21.15.47:0/3091334044 <== mon.1 v2:172.21.15.134:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb7b8098020 con 0x5580e5752490 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7c46cd740 10 client.25351 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7c46cd740 10 client.25351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7c46cd740 20 client.25351 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.260+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580e5739cd0 0x5580e5b404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.261+0000 7fb7c46cd740 4 client.25351 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.261+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580e5a9adb0 con 0x5580e5739cd0 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.261+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580e5739cd0 0x5580e5b404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.261+0000 7fb796ffd640 10 client.25351 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.261+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580e5739cd0 0x5580e5b404d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917425207a96cae server_cookie=5974ae4b10ec2509 in_seq=0 out_seq=0 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb796ffd640 1 -- 172.21.15.47:0/3091334044 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580e5a9adb0 con 0x5580e5739cd0 2024-09-21T01:00:39.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb796ffd640 10 client.25351 handle_command_reply: tid=0 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 client.25351 shutdown 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 msgr2=0x5580e5b2e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b2e1e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80524b0 tx=0x7fb7b806a490 comp rx=0 tx=0).stop 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 shutdown_connections 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580e5739cd0 0x5580e5b404d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e577b350 0x5580e5b3a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5b2e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb796ffd640 0 client.25351 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/3091334044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b2e1e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 >> 172.21.15.47:0/3091334044 conn(0x5580e576f740 msgr2=0x5580e5b257a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 shutdown_connections 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 1 -- 172.21.15.47:0/3091334044 wait complete. 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.262+0000 7fb7c46cd740 20 client.25351 trim_cache size 0 max 16384 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.280+0000 7fb7c46cd740 1 Processor -- start 2024-09-21T01:00:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.280+0000 7fb7c46cd740 1 -- start start 2024-09-21T01:00:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e5739cd0 0x5580e5b3a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b27720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e575a670 0x5580e5b27c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c00c280 con 0x5580e5752490 2024-09-21T01:00:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c00eb00 con 0x5580e5739cd0 2024-09-21T01:00:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c00c8f0 con 0x5580e575a670 2024-09-21T01:00:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b27720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b27720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52000/0 (socket says 172.21.15.47:52000) 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 -- 172.21.15.47:0/2022430224 learned_addr learned my addr 172.21.15.47:0/2022430224 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e5739cd0 0x5580e5b3a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e575a670 0x5580e5b27c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 -- 172.21.15.47:0/2022430224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e575a670 msgr2=0x5580e5b27c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e575a670 0x5580e5b27c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 -- 172.21.15.47:0/2022430224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e5739cd0 msgr2=0x5580e5b3a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e5739cd0 0x5580e5b3a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 -- 172.21.15.47:0/2022430224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e5b2eb80 con 0x5580e5752490 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b27720 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00059e0 tx=0x7fb7ac005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be92a491209cd73b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.281+0000 7fb7a17fa640 1 -- 172.21.15.47:0/2022430224 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac020040 con 0x5580e5752490 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.282+0000 7fb7a17fa640 1 -- 172.21.15.47:0/2022430224 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7ac0047a0 con 0x5580e5752490 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.282+0000 7fb7a17fa640 1 -- 172.21.15.47:0/2022430224 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac01e860 con 0x5580e5752490 2024-09-21T01:00:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.282+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2022430224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 msgr2=0x5580e5b27720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.282+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b27720 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00059e0 tx=0x7fb7ac005f90 comp rx=0 tx=0).stop 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2022430224 shutdown_connections 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e575a670 0x5580e5b27c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5752490 0x5580e5b27720 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/2022430224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e5739cd0 0x5580e5b3a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2022430224 >> 172.21.15.47:0/2022430224 conn(0x5580e576f740 msgr2=0x5580e5b2c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2022430224 shutdown_connections 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 -- 172.21.15.47:0/2022430224 wait complete. 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 -- start start 2024-09-21T01:00:39.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.283+0000 7fb7c46cd740 1 Processor -- start 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5739cd0 0x5580e5b41fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b42590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7c46cd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5ba2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c00cfc0 con 0x5580e5739cd0 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c00e430 con 0x5580e575a670 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7c46cd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c00d690 con 0x5580e5752490 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7c46cd740 10 client.0 _ll_register_callbacks cb 0x7fb7ac0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5739cd0 0x5580e5b41fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5739cd0 0x5580e5b41fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52016/0 (socket says 172.21.15.47:52016) 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b7fff640 1 -- 172.21.15.47:0/1049821635 learned_addr learned my addr 172.21.15.47:0/1049821635 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b42590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5ba2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b6ffd640 1 -- 172.21.15.47:0/1049821635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 msgr2=0x5580e5ba2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5ba2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b6ffd640 1 -- 172.21.15.47:0/1049821635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5739cd0 msgr2=0x5580e5b41fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5739cd0 0x5580e5b41fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b6ffd640 1 -- 172.21.15.47:0/1049821635 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e5ba3280 con 0x5580e5752490 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5739cd0 0x5580e5b41fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb7b6ffd640 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b42590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009be0 tx=0x7fb7ac009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b163959fbc5ce366 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.284+0000 7fb796ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb796ffd640 1 -- 172.21.15.47:0/1049821635 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac020040 con 0x5580e5752490 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 1 -- 172.21.15.47:0/1049821635 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7ac0047a0 con 0x5580e5752490 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb796ffd640 1 -- 172.21.15.47:0/1049821635 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb7ac004cd0 con 0x5580e5752490 2024-09-21T01:00:39.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb796ffd640 1 -- 172.21.15.47:0/1049821635 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb7ac004030 con 0x5580e5752490 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 10 client.25357 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 1 -- 172.21.15.47:0/1049821635 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5580e5bab7e0 con 0x5580e5752490 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb796ffd640 1 -- 172.21.15.47:0/1049821635 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7ac0047a0 con 0x5580e5752490 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb796ffd640 1 -- 172.21.15.47:0/1049821635 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb7ac02c060 con 0x5580e5752490 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 10 client.25357 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 10 client.25357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 20 client.25357 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580e577b350 0x5580e5bade70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 4 client.25357 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7c46cd740 1 -- 172.21.15.47:0/1049821635 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5580e5a96860 con 0x5580e577b350 2024-09-21T01:00:39.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.285+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580e577b350 0x5580e5bade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.286+0000 7fb796ffd640 10 client.25357 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.286+0000 7fb7b7fff640 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580e577b350 0x5580e5bade70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd198cf3fc96f41 server_cookie=6cd821838fa1b267 in_seq=0 out_seq=0 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb796ffd640 1 -- 172.21.15.47:0/1049821635 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5580e5a96860 con 0x5580e577b350 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb796ffd640 10 client.25357 handle_command_reply: tid=0 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 client.25357 shutdown 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 -- 172.21.15.47:0/1049821635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 msgr2=0x5580e5b42590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b42590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009be0 tx=0x7fb7ac009ee0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 -- 172.21.15.47:0/1049821635 shutdown_connections 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5580e577b350 0x5580e5bade70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5580e575a670 0x5580e5ba2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5580e5752490 0x5580e5b42590 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 --2- 172.21.15.47:0/1049821635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580e5739cd0 0x5580e5b41fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb796ffd640 0 client.25357 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:39.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 -- 172.21.15.47:0/1049821635 >> 172.21.15.47:0/1049821635 conn(0x5580e576f740 msgr2=0x5580e5b2c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:39.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 -- 172.21.15.47:0/1049821635 shutdown_connections 2024-09-21T01:00:39.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 1 -- 172.21.15.47:0/1049821635 wait complete. 2024-09-21T01:00:39.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.288+0000 7fb7c46cd740 20 client.25357 trim_cache size 0 max 16384 2024-09-21T01:00:39.336 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:00:39.336 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-09-21T01:00:39.337 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "013c654d-123e-4be3-a479-1be70f6e1569", 2024-09-21T01:00:39.337 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-09-21T01:00:39.337 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:00:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb7a80b6590 msgr2=0x7fb7a80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb7a80b6590 0x7fb7a80b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4041df0 tx=0x7fb7a400b040 comp rx=0 tx=0).stop 2024-09-21T01:00:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7b0008e60 msgr2=0x7fb7b0132e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7b0008e60 0x7fb7b0132e00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009850 tx=0x7fb7a4030650 comp rx=0 tx=0).stop 2024-09-21T01:00:39.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 shutdown_connections 2024-09-21T01:00:39.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb7a80b6590 0x7fb7a80b8aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7b00a6cc0 0x7fb7b0138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b00097b0 0x7fb7b01333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 --2- 172.21.15.47:0/1798860255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7b0008e60 0x7fb7b0132e00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:39.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 >> 172.21.15.47:0/1798860255 conn(0x7fb7b0093d70 msgr2=0x7fb7b00a73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:39.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 shutdown_connections 2024-09-21T01:00:39.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:39.289+0000 7fb7bcef7640 1 -- 172.21.15.47:0/1798860255 wait complete. 2024-09-21T01:00:39.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:39 smithi047 ceph-mon[30960]: scrub queued for path: / 2024-09-21T01:00:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:39 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:39.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:39 smithi047 ceph-mon[30960]: scrub summary: active paths [/] 2024-09-21T01:00:40.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:39 smithi134 ceph-mon[34785]: scrub queued for path: / 2024-09-21T01:00:40.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:39 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:40.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:39 smithi134 ceph-mon[34785]: scrub summary: active paths [/] 2024-09-21T01:00:40.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:39 smithi114 ceph-mon[34309]: scrub queued for path: / 2024-09-21T01:00:40.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:39 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T01:00:40.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:39 smithi114 ceph-mon[34309]: scrub summary: active paths [/] 2024-09-21T01:00:40.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:00:41.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:40 smithi134 ceph-mon[34785]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 55 MiB/s wr, 6.54k op/s 2024-09-21T01:00:41.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:40 smithi114 ceph-mon[34309]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 55 MiB/s wr, 6.54k op/s 2024-09-21T01:00:41.194 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:00:41.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:40 smithi047 ceph-mon[30960]: pgmap v404: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 55 MiB/s wr, 6.54k op/s 2024-09-21T01:00:42.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 -- 172.21.15.47:0/836564363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec1049d0 msgr2=0x7f32ec104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 --2- 172.21.15.47:0/836564363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec1049d0 0x7f32ec104de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009860 tx=0x7f32e802a340 comp rx=0 tx=0).stop 2024-09-21T01:00:42.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 -- 172.21.15.47:0/836564363 shutdown_connections 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 --2- 172.21.15.47:0/836564363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32ec10de30 0x7f32ec110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 --2- 172.21.15.47:0/836564363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ec105320 0x7f32ec10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 --2- 172.21.15.47:0/836564363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec1049d0 0x7f32ec104de0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 -- 172.21.15.47:0/836564363 >> 172.21.15.47:0/836564363 conn(0x7f32ec079740 msgr2=0x7f32ec079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 -- 172.21.15.47:0/836564363 shutdown_connections 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.003+0000 7f32f45a7640 1 -- 172.21.15.47:0/836564363 wait complete. 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f45a7640 1 Processor -- start 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f45a7640 1 -- start start 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f45a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32ec1049d0 0x7f32ec19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f45a7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ec105320 0x7f32ec19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f45a7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec10de30 0x7f32ec19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f45a7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec113ab0 con 0x7f32ec105320 2024-09-21T01:00:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f45a7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec113930 con 0x7f32ec10de30 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f45a7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec113c30 con 0x7f32ec1049d0 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f1b42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ec105320 0x7f32ec19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f1b42640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ec105320 0x7f32ec19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48740/0 (socket says 172.21.15.47:48740) 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f2343640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32ec1049d0 0x7f32ec19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f1b42640 1 -- 172.21.15.47:0/2717229835 learned_addr learned my addr 172.21.15.47:0/2717229835 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.004+0000 7f32f2b44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec10de30 0x7f32ec19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f1b42640 1 -- 172.21.15.47:0/2717229835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32ec1049d0 msgr2=0x7f32ec19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f1b42640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32ec1049d0 0x7f32ec19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f1b42640 1 -- 172.21.15.47:0/2717229835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec10de30 msgr2=0x7f32ec19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f1b42640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec10de30 0x7f32ec19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f1b42640 1 -- 172.21.15.47:0/2717229835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec1a0430 con 0x7f32ec105320 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f2b44640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec10de30 0x7f32ec19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f1b42640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ec105320 0x7f32ec19aa60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0058c0 tx=0x7f32dc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32e37fe640 1 -- 172.21.15.47:0/2717229835 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00cd30 con 0x7f32ec105320 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f45a7640 1 -- 172.21.15.47:0/2717229835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec1a0720 con 0x7f32ec105320 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32e37fe640 1 -- 172.21.15.47:0/2717229835 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32dc0035f0 con 0x7f32ec105320 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32e37fe640 1 -- 172.21.15.47:0/2717229835 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0044e0 con 0x7f32ec105320 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.005+0000 7f32f45a7640 1 -- 172.21.15.47:0/2717229835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec1025f0 con 0x7f32ec105320 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.008+0000 7f32fab1b740 1 Processor -- start 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.008+0000 7f32fab1b740 1 -- start start 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.008+0000 7f32e37fe640 1 -- 172.21.15.47:0/2717229835 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f32dc003a50 con 0x7f32ec105320 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0f1070 0x56482d498270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4987b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0d0390 0x56482d498cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32fab1b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56482d40ee50 con 0x56482d0c81b0 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32fab1b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56482d3fe280 con 0x56482d0d0390 2024-09-21T01:00:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32fab1b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56482d402090 con 0x56482d0f1070 2024-09-21T01:00:42.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2343640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2b44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0f1070 0x56482d498270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2343640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48744/0 (socket says 172.21.15.47:48744) 2024-09-21T01:00:42.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2343640 1 -- 172.21.15.47:0/1537940951 learned_addr learned my addr 172.21.15.47:0/1537940951 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:42.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f1b42640 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0d0390 0x56482d498cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2343640 1 -- 172.21.15.47:0/1537940951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0f1070 msgr2=0x56482d498270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2343640 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0f1070 0x56482d498270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2343640 1 -- 172.21.15.47:0/1537940951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0d0390 msgr2=0x56482d498cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2343640 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0d0390 0x56482d498cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2343640 1 -- 172.21.15.47:0/1537940951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482d15c650 con 0x56482d0c81b0 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.009+0000 7f32f2b44640 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0f1070 0x56482d498270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.010+0000 7f32e37fe640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32d80b6510 0x7f32d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.010+0000 7f32f2343640 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4987b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009860 tx=0x7f32e8005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc49e4abbd63f2a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.010+0000 7f32f2b44640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32d80b6510 0x7f32d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.010+0000 7f32e37fe640 1 -- 172.21.15.47:0/2717229835 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f32dc0e74d0 con 0x7f32ec105320 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.010+0000 7f32e0ff9640 1 -- 172.21.15.47:0/1537940951 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8037040 con 0x56482d0c81b0 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.010+0000 7f32e0ff9640 1 -- 172.21.15.47:0/1537940951 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e8030450 con 0x56482d0c81b0 2024-09-21T01:00:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.010+0000 7f32e0ff9640 1 -- 172.21.15.47:0/1537940951 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8003950 con 0x56482d0c81b0 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 -- 172.21.15.47:0/1537940951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 msgr2=0x56482d4987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4987b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009860 tx=0x7f32e8005d30 comp rx=0 tx=0).stop 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32f2b44640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32d80b6510 0x7f32d80b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009fd0 tx=0x7f32e4012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 -- 172.21.15.47:0/1537940951 shutdown_connections 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0d0390 0x56482d498cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4987b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 --2- 172.21.15.47:0/1537940951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0f1070 0x56482d498270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 -- 172.21.15.47:0/1537940951 >> 172.21.15.47:0/1537940951 conn(0x56482d0e5460 msgr2=0x56482d496160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 -- 172.21.15.47:0/1537940951 shutdown_connections 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.011+0000 7f32fab1b740 1 -- 172.21.15.47:0/1537940951 wait complete. 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.012+0000 7f32fab1b740 1 -- start start 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.012+0000 7f32fab1b740 1 Processor -- start 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.012+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4a3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.012+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.012+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4afce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32fab1b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56482d25f700 con 0x56482d0f1070 2024-09-21T01:00:42.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32f2343640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32fab1b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56482d399110 con 0x56482d0c81b0 2024-09-21T01:00:42.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32fab1b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56482d4a69f0 con 0x56482d0d0390 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32f2343640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4a3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:58638/0 (socket says 172.21.15.47:58638) 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32f2343640 1 -- 172.21.15.47:0/566203138 learned_addr learned my addr 172.21.15.47:0/566203138 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32f2b44640 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32fab1b740 10 client.0 _ll_register_callbacks cb 0x56482d3b2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32f1b42640 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32f2343640 1 -- 172.21.15.47:0/566203138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 msgr2=0x56482d4a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.013+0000 7f32f2343640 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4a3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.014+0000 7f32f2343640 1 -- 172.21.15.47:0/566203138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 msgr2=0x56482d4afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.014+0000 7f32f2343640 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.014+0000 7f32f2343640 1 -- 172.21.15.47:0/566203138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56482d3c6c40 con 0x56482d0c81b0 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.014+0000 7f32f2b44640 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.014+0000 7f32f2343640 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4a3970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f32e802a860 tx=0x7f32e8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e07e5d7f90b258 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.014+0000 7f32d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:00:42.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.015+0000 7f32d5ffb640 1 -- 172.21.15.47:0/566203138 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8037030 con 0x56482d0c81b0 2024-09-21T01:00:42.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.015+0000 7f32d5ffb640 1 -- 172.21.15.47:0/566203138 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f32e803d480 con 0x56482d0c81b0 2024-09-21T01:00:42.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.015+0000 7f32fab1b740 1 -- 172.21.15.47:0/566203138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32e8030450 con 0x56482d0c81b0 2024-09-21T01:00:42.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.015+0000 7f32d5ffb640 1 -- 172.21.15.47:0/566203138 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f32e803d680 con 0x56482d0c81b0 2024-09-21T01:00:42.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32fab1b740 10 client.25358 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32fab1b740 1 -- 172.21.15.47:0/566203138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56482d4b2760 con 0x56482d0c81b0 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32d5ffb640 1 -- 172.21.15.47:0/566203138 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e803dcd0 con 0x56482d0c81b0 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32d5ffb640 1 -- 172.21.15.47:0/566203138 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f32e8046ca0 con 0x56482d0c81b0 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32fab1b740 10 client.25358 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32fab1b740 10 client.25358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32fab1b740 20 client.25358 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32fab1b740 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56482d0af9f0 0x56482d4b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32fab1b740 4 client.25358 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.016+0000 7f32fab1b740 1 -- 172.21.15.47:0/566203138 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f32e8030450 con 0x56482d0af9f0 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.017+0000 7f32f1b42640 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56482d0af9f0 0x56482d4b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.017+0000 7f32d5ffb640 10 client.25358 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.017+0000 7f32f1b42640 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56482d0af9f0 0x56482d4b5ac0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b811bf77ca1e8ab0 server_cookie=82c2bbb1f258677a in_seq=0 out_seq=0 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32d5ffb640 1 -- 172.21.15.47:0/566203138 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f32e8030450 con 0x56482d0af9f0 2024-09-21T01:00:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32d5ffb640 10 client.25358 handle_command_reply: tid=0 2024-09-21T01:00:42.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 client.25358 shutdown 2024-09-21T01:00:42.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 -- 172.21.15.47:0/566203138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 msgr2=0x56482d4a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4a3970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f32e802a860 tx=0x7f32e8005f90 comp rx=0 tx=0).stop 2024-09-21T01:00:42.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 -- 172.21.15.47:0/566203138 shutdown_connections 2024-09-21T01:00:42.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56482d0af9f0 0x56482d4b5ac0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32d5ffb640 0 client.25358 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:42.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4a3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 --2- 172.21.15.47:0/566203138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4a3970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 -- 172.21.15.47:0/566203138 >> 172.21.15.47:0/566203138 conn(0x56482d0e5460 msgr2=0x56482d49b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 -- 172.21.15.47:0/566203138 shutdown_connections 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 1 -- 172.21.15.47:0/566203138 wait complete. 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.018+0000 7f32fab1b740 20 client.25358 trim_cache size 0 max 16384 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.039+0000 7f32fab1b740 1 Processor -- start 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.039+0000 7f32fab1b740 1 -- start start 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4999b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0f1070 0x56482d4afc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32fab1b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1ab170 con 0x56482d0c81b0 2024-09-21T01:00:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32fab1b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1ad9f0 con 0x56482d0f1070 2024-09-21T01:00:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32fab1b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1ab7e0 con 0x56482d0d0390 2024-09-21T01:00:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32f2343640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32f1b42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32f2b44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0f1070 0x56482d4afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32f2343640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48772/0 (socket says 172.21.15.47:48772) 2024-09-21T01:00:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32f1b42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:50530/0 (socket says 172.21.15.47:50530) 2024-09-21T01:00:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.040+0000 7f32f2343640 1 -- 172.21.15.47:0/4161510532 learned_addr learned my addr 172.21.15.47:0/4161510532 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32f2b44640 1 -- 172.21.15.47:0/4161510532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 msgr2=0x56482d4999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32f2b44640 1 --2- 172.21.15.47:0/4161510532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32f2b44640 1 -- 172.21.15.47:0/4161510532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 msgr2=0x56482d4a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32f2b44640 1 --2- 172.21.15.47:0/4161510532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32f2b44640 1 -- 172.21.15.47:0/4161510532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56482d496ad0 con 0x56482d0f1070 2024-09-21T01:00:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32f1b42640 1 --2- 172.21.15.47:0/4161510532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32f2b44640 1 --2- 172.21.15.47:0/4161510532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0f1070 0x56482d4afc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32e4012010 tx=0x7f32e401a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc36b6e067688ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32d7fff640 1 -- 172.21.15.47:0/4161510532 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e402c030 con 0x56482d0f1070 2024-09-21T01:00:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32d7fff640 1 -- 172.21.15.47:0/4161510532 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e40045b0 con 0x56482d0f1070 2024-09-21T01:00:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.041+0000 7f32d7fff640 1 -- 172.21.15.47:0/4161510532 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e401ddb0 con 0x56482d0f1070 2024-09-21T01:00:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.042+0000 7f32fab1b740 1 -- 172.21.15.47:0/4161510532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0f1070 msgr2=0x56482d4afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.042+0000 7f32fab1b740 1 --2- 172.21.15.47:0/4161510532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0f1070 0x56482d4afc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32e4012010 tx=0x7f32e401a000 comp rx=0 tx=0).stop 2024-09-21T01:00:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.042+0000 7f32fab1b740 1 -- 172.21.15.47:0/4161510532 shutdown_connections 2024-09-21T01:00:42.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.042+0000 7f32fab1b740 1 --2- 172.21.15.47:0/4161510532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0f1070 0x56482d4afc50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.042+0000 7f32fab1b740 1 --2- 172.21.15.47:0/4161510532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.042+0000 7f32fab1b740 1 --2- 172.21.15.47:0/4161510532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0c81b0 0x56482d4a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.043+0000 7f32fab1b740 1 -- 172.21.15.47:0/4161510532 >> 172.21.15.47:0/4161510532 conn(0x56482d0e5460 msgr2=0x56482d4992a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.043+0000 7f32fab1b740 1 -- 172.21.15.47:0/4161510532 shutdown_connections 2024-09-21T01:00:42.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.043+0000 7f32fab1b740 1 -- 172.21.15.47:0/4161510532 wait complete. 2024-09-21T01:00:42.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.043+0000 7f32fab1b740 1 -- start start 2024-09-21T01:00:42.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.043+0000 7f32fab1b740 1 Processor -- start 2024-09-21T01:00:42.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32fab1b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32fab1b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1abeb0 con 0x56482d0f1070 2024-09-21T01:00:42.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32fab1b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1ad320 con 0x56482d0c81b0 2024-09-21T01:00:42.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32fab1b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1ac580 con 0x56482d0d0390 2024-09-21T01:00:42.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32fab1b740 10 client.0 _ll_register_callbacks cb 0x7f32dc0eaec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f2b44640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f2b44640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48778/0 (socket says 172.21.15.47:48778) 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f1b42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f2b44640 1 -- 172.21.15.47:0/3144383545 learned_addr learned my addr 172.21.15.47:0/3144383545 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f2343640 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f1b42640 1 -- 172.21.15.47:0/3144383545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 msgr2=0x56482d4b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f1b42640 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f1b42640 1 -- 172.21.15.47:0/3144383545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 msgr2=0x56482d4b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f1b42640 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f1b42640 1 -- 172.21.15.47:0/3144383545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56482d4b7320 con 0x56482d0d0390 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f2b44640 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32f1b42640 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4b66f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0e50c0 tx=0x7f32dc00cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b7a9b660ef87819 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:42.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.044+0000 7f32d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32d5ffb640 1 -- 172.21.15.47:0/3144383545 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0ad050 con 0x56482d0d0390 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32d5ffb640 1 -- 172.21.15.47:0/3144383545 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f32dc0037a0 con 0x56482d0d0390 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 1 -- 172.21.15.47:0/3144383545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32e40045b0 con 0x56482d0d0390 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32d5ffb640 1 -- 172.21.15.47:0/3144383545 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f32dc0ace70 con 0x56482d0d0390 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 10 client.25375 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 1 -- 172.21.15.47:0/3144383545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56482d520140 con 0x56482d0d0390 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32d5ffb640 1 -- 172.21.15.47:0/3144383545 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e40045b0 con 0x56482d0d0390 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32d5ffb640 1 -- 172.21.15.47:0/3144383545 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f32dc004000 con 0x56482d0d0390 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 10 client.25375 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 10 client.25375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 20 client.25375 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:42.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56482d084da0 0x56482d5228b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 4 client.25375 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.045+0000 7f32fab1b740 1 -- 172.21.15.47:0/3144383545 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56482d410da0 con 0x56482d084da0 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32f2343640 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56482d084da0 0x56482d5228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32d5ffb640 10 client.25375 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32f2343640 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56482d084da0 0x56482d5228b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a87abbe781a4816d server_cookie=1e5f683019e55054 in_seq=0 out_seq=0 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32d5ffb640 1 -- 172.21.15.47:0/3144383545 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1430 (crc 0 0 0) 0x56482d410da0 con 0x56482d084da0 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32d5ffb640 10 client.25375 handle_command_reply: tid=0 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 client.25375 shutdown 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 -- 172.21.15.47:0/3144383545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 msgr2=0x56482d4b66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4b66f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0e50c0 tx=0x7f32dc00cf80 comp rx=0 tx=0).stop 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 -- 172.21.15.47:0/3144383545 shutdown_connections 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56482d084da0 0x56482d5228b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56482d0f1070 0x56482d4b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32d5ffb640 0 client.25375 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56482d0d0390 0x56482d4b66f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 --2- 172.21.15.47:0/3144383545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56482d0c81b0 0x56482d4b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.046+0000 7f32fab1b740 1 -- 172.21.15.47:0/3144383545 >> 172.21.15.47:0/3144383545 conn(0x56482d0e5460 msgr2=0x56482d4a55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32fab1b740 1 -- 172.21.15.47:0/3144383545 shutdown_connections 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32fab1b740 1 -- 172.21.15.47:0/3144383545 wait complete. 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (100 inodes in the stack)", 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:00:42.086 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "013c654d-123e-4be3-a479-1be70f6e1569", 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:00:42.087 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:00:42.088 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32fab1b740 20 client.25375 trim_cache size 0 max 16384 2024-09-21T01:00:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 -- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32d80b6510 msgr2=0x7f32d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32d80b6510 0x7f32d80b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009fd0 tx=0x7f32e4012040 comp rx=0 tx=0).stop 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 -- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ec105320 msgr2=0x7f32ec19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ec105320 0x7f32ec19aa60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0058c0 tx=0x7f32dc00ee50 comp rx=0 tx=0).stop 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 -- 172.21.15.47:0/2717229835 shutdown_connections 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f32d80b6510 0x7f32d80b8a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32ec10de30 0x7f32ec19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ec105320 0x7f32ec19aa60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 --2- 172.21.15.47:0/2717229835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32ec1049d0 0x7f32ec19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 -- 172.21.15.47:0/2717229835 >> 172.21.15.47:0/2717229835 conn(0x7f32ec079740 msgr2=0x7f32ec1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 -- 172.21.15.47:0/2717229835 shutdown_connections 2024-09-21T01:00:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:00:42.047+0000 7f32f45a7640 1 -- 172.21.15.47:0/2717229835 wait complete. 2024-09-21T01:00:42.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:42 smithi047 ceph-mon[30960]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 56 MiB/s wr, 6.84k op/s 2024-09-21T01:00:43.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:42 smithi134 ceph-mon[34785]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 56 MiB/s wr, 6.84k op/s 2024-09-21T01:00:43.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:42 smithi114 ceph-mon[34309]: pgmap v405: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 56 MiB/s wr, 6.84k op/s 2024-09-21T01:00:43.231 INFO:tasks.cephfs.filesystem:scrub status for tag:013c654d-123e-4be3-a479-1be70f6e1569 - {'path': '/', 'tag': '013c654d-123e-4be3-a479-1be70f6e1569', 'options': 'recursive,force'} 2024-09-21T01:00:44.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:43 smithi114 ceph-mon[34309]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:44.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:43 smithi047 ceph-mon[30960]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:44.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:43 smithi134 ceph-mon[34785]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:44 smithi114 ceph-mon[34309]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 70 MiB/s wr, 8.58k op/s 2024-09-21T01:00:45.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:44 smithi047 ceph-mon[30960]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 70 MiB/s wr, 8.58k op/s 2024-09-21T01:00:45.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:44 smithi134 ceph-mon[34785]: pgmap v406: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 70 MiB/s wr, 8.58k op/s 2024-09-21T01:00:47.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:46 smithi114 ceph-mon[34309]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 62 MiB/s wr, 7.74k op/s 2024-09-21T01:00:47.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:46 smithi047 ceph-mon[30960]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 62 MiB/s wr, 7.74k op/s 2024-09-21T01:00:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:46 smithi134 ceph-mon[34785]: pgmap v407: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 62 MiB/s wr, 7.74k op/s 2024-09-21T01:00:48.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 -- 172.21.15.47:0/1330500848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 msgr2=0x7f9640102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 --2- 172.21.15.47:0/1330500848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 0x7f9640102ee0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9630009900 tx=0x7f963002a410 comp rx=0 tx=0).stop 2024-09-21T01:00:48.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 -- 172.21.15.47:0/1330500848 shutdown_connections 2024-09-21T01:00:48.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 --2- 172.21.15.47:0/1330500848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96401040c0 0x7f964010ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 --2- 172.21.15.47:0/1330500848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96401034b0 0x7f9640103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.144 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 --2- 172.21.15.47:0/1330500848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 0x7f9640102ee0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 -- 172.21.15.47:0/1330500848 >> 172.21.15.47:0/1330500848 conn(0x7f96400fd680 msgr2=0x7f96400ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 -- 172.21.15.47:0/1330500848 shutdown_connections 2024-09-21T01:00:48.145 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.143+0000 7f9644a69640 1 -- 172.21.15.47:0/1330500848 wait complete. 2024-09-21T01:00:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9644a69640 1 Processor -- start 2024-09-21T01:00:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9644a69640 1 -- start start 2024-09-21T01:00:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9644a69640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 0x7f964010cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9644a69640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96401034b0 0x7f964010b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9644a69640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96401040c0 0x7f964010bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9644a69640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f964010f340 con 0x7f9640102ad0 2024-09-21T01:00:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9644a69640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f964010f1c0 con 0x7f96401040c0 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9644a69640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f964010f4c0 con 0x7f96401034b0 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 0x7f964010cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 0x7f964010cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48784/0 (socket says 172.21.15.47:48784) 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963e59c640 1 -- 172.21.15.47:0/1287899842 learned_addr learned my addr 172.21.15.47:0/1287899842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963ed9d640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96401040c0 0x7f964010bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f9637fff640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96401034b0 0x7f964010b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963e59c640 1 -- 172.21.15.47:0/1287899842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96401034b0 msgr2=0x7f964010b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963e59c640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96401034b0 0x7f964010b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963e59c640 1 -- 172.21.15.47:0/1287899842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96401040c0 msgr2=0x7f964010bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963e59c640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96401040c0 0x7f964010bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.144+0000 7f963e59c640 1 -- 172.21.15.47:0/1287899842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964010c250 con 0x7f9640102ad0 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.145+0000 7f963e59c640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 0x7f964010cd20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9630006010 tx=0x7f96300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.145+0000 7f96377fe640 1 -- 172.21.15.47:0/1287899842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963003f030 con 0x7f9640102ad0 2024-09-21T01:00:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.145+0000 7f96377fe640 1 -- 172.21.15.47:0/1287899842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9630031910 con 0x7f9640102ad0 2024-09-21T01:00:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.145+0000 7f9644a69640 1 -- 172.21.15.47:0/1287899842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96401a3fe0 con 0x7f9640102ad0 2024-09-21T01:00:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.145+0000 7f96377fe640 1 -- 172.21.15.47:0/1287899842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630035070 con 0x7f9640102ad0 2024-09-21T01:00:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.145+0000 7f9644a69640 1 -- 172.21.15.47:0/1287899842 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96401a4390 con 0x7f9640102ad0 2024-09-21T01:00:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f964b9d6740 1 Processor -- start 2024-09-21T01:00:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f964b9d6740 1 -- start start 2024-09-21T01:00:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8dd91b0 0x558ea9180e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 0x558ea91814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db84d0 0x558ea9182010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f964b9d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558ea90f36f0 con 0x558ea8db84d0 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f96377fe640 1 -- 172.21.15.47:0/1287899842 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9630042030 con 0x7f9640102ad0 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f964b9d6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558ea90e2b20 con 0x558ea8dd91b0 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f964b9d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558ea90e6930 con 0x558ea8db02f0 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f9637fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db84d0 0x558ea9182010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8dd91b0 0x558ea9180e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8dd91b0 0x558ea9180e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:58672/0 (socket says 172.21.15.47:58672) 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f963ed9d640 1 -- 172.21.15.47:0/3882332878 learned_addr learned my addr 172.21.15.47:0/3882332878 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.148+0000 7f963e59c640 1 --2- 172.21.15.47:0/3882332878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 0x558ea91814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f963ed9d640 1 -- 172.21.15.47:0/3882332878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 msgr2=0x558ea91814c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.152 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3882332878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 0x558ea91814c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f963ed9d640 1 -- 172.21.15.47:0/3882332878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db84d0 msgr2=0x558ea9182010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3882332878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db84d0 0x558ea9182010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f963ed9d640 1 -- 172.21.15.47:0/3882332878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ea90a8530 con 0x558ea8dd91b0 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3882332878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8dd91b0 0x558ea9180e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9638009fd0 tx=0x7f96380118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da51cf60f8de969 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f96377fe640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f962c0b6510 0x7f962c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f9634ff9640 1 -- 172.21.15.47:0/3882332878 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638004d20 con 0x558ea8dd91b0 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f963e59c640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f962c0b6510 0x7f962c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f9634ff9640 1 -- 172.21.15.47:0/3882332878 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9638004050 con 0x558ea8dd91b0 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f9634ff9640 1 -- 172.21.15.47:0/3882332878 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638005280 con 0x558ea8dd91b0 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.149+0000 7f96377fe640 1 -- 172.21.15.47:0/1287899842 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f9630107760 con 0x7f9640102ad0 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 -- 172.21.15.47:0/3882332878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8dd91b0 msgr2=0x558ea9180e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f963e59c640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f962c0b6510 0x7f962c0b8a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f96300ca010 tx=0x7f963010d530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3882332878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8dd91b0 0x558ea9180e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9638009fd0 tx=0x7f96380118d0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.153 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 -- 172.21.15.47:0/3882332878 shutdown_connections 2024-09-21T01:00:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3882332878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db84d0 0x558ea9182010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3882332878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 0x558ea91814c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3882332878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8dd91b0 0x558ea9180e50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 -- 172.21.15.47:0/3882332878 >> 172.21.15.47:0/3882332878 conn(0x558ea8dcd300 msgr2=0x558ea917c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 -- 172.21.15.47:0/3882332878 shutdown_connections 2024-09-21T01:00:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.150+0000 7f964b9d6740 1 -- 172.21.15.47:0/3882332878 wait complete. 2024-09-21T01:00:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 1 -- start start 2024-09-21T01:00:48.154 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 1 Processor -- start 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 0x558ea918a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea918ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea918b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558ea901aab0 con 0x558ea8dd91b0 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558ea9088730 con 0x558ea8db84d0 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558ea9182b30 con 0x558ea8db02f0 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f964b9d6740 10 client.0 _ll_register_callbacks cb 0x558ea90dc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 0x558ea918a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea918b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f9637fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea918ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea918b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48800/0 (socket says 172.21.15.47:48800) 2024-09-21T01:00:48.158 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f9637fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea918ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:58678/0 (socket says 172.21.15.47:58678) 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.151+0000 7f963ed9d640 1 -- 172.21.15.47:0/3898715322 learned_addr learned my addr 172.21.15.47:0/3898715322 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f963ed9d640 1 -- 172.21.15.47:0/3898715322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 msgr2=0x558ea918a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 0x558ea918a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f963ed9d640 1 -- 172.21.15.47:0/3898715322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 msgr2=0x558ea918ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea918ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f963ed9d640 1 -- 172.21.15.47:0/3898715322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ea8e44790 con 0x558ea8dd91b0 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f9637fff640 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea918ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea918b7d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9638005fd0 tx=0x7f9638009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d068e051e93f8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f9625ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f9625ffb640 1 -- 172.21.15.47:0/3898715322 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963800f8f0 con 0x558ea8dd91b0 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f9625ffb640 1 -- 172.21.15.47:0/3898715322 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f963800fa90 con 0x558ea8dd91b0 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f964b9d6740 1 -- 172.21.15.47:0/3898715322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9638004050 con 0x558ea8dd91b0 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f9625ffb640 1 -- 172.21.15.47:0/3898715322 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f96380045c0 con 0x558ea8dd91b0 2024-09-21T01:00:48.159 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.152+0000 7f964b9d6740 10 client.15702 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f964b9d6740 1 -- 172.21.15.47:0/3898715322 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558ea8ebd620 con 0x558ea8dd91b0 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f9625ffb640 1 -- 172.21.15.47:0/3898715322 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9638004050 con 0x558ea8dd91b0 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f9625ffb640 1 -- 172.21.15.47:0/3898715322 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9638028bd0 con 0x558ea8dd91b0 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f964b9d6740 10 client.15702 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f964b9d6740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f964b9d6740 20 client.15702 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558ea8d97d80 0x558ea9197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f964b9d6740 4 client.15702 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f964b9d6740 1 -- 172.21.15.47:0/3898715322 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ea90f5640 con 0x558ea8d97d80 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.153+0000 7f9637fff640 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558ea8d97d80 0x558ea9197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.154+0000 7f9625ffb640 10 client.15702 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.154+0000 7f9637fff640 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558ea8d97d80 0x558ea9197ae0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6d4a48229d11f2 server_cookie=8ada6113e2cfa5c1 in_seq=0 out_seq=0 2024-09-21T01:00:48.160 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.154+0000 7f9625ffb640 1 -- 172.21.15.47:0/3898715322 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ea90f5640 con 0x558ea8d97d80 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.154+0000 7f9625ffb640 10 client.15702 handle_command_reply: tid=0 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 client.15702 shutdown 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 -- 172.21.15.47:0/3898715322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 msgr2=0x558ea918b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea918b7d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9638005fd0 tx=0x7f9638009500 comp rx=0 tx=0).stop 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 -- 172.21.15.47:0/3898715322 shutdown_connections 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558ea8d97d80 0x558ea9197ae0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea918b7d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea918ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f9625ffb640 0 client.15702 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3898715322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db02f0 0x558ea918a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 -- 172.21.15.47:0/3898715322 >> 172.21.15.47:0/3898715322 conn(0x558ea8dcd300 msgr2=0x558ea917aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 -- 172.21.15.47:0/3898715322 shutdown_connections 2024-09-21T01:00:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 1 -- 172.21.15.47:0/3898715322 wait complete. 2024-09-21T01:00:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.155+0000 7f964b9d6740 20 client.15702 trim_cache size 0 max 16384 2024-09-21T01:00:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.174+0000 7f964b9d6740 1 Processor -- start 2024-09-21T01:00:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.174+0000 7f964b9d6740 1 -- start start 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db02f0 0x558ea9185900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db84d0 0x558ea91896d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea917beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f964b9d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f96401aafd0 con 0x558ea8dd91b0 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f964b9d6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f96401ad850 con 0x558ea8db02f0 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f964b9d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96401ab640 con 0x558ea8db84d0 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea917beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea917beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48812/0 (socket says 172.21.15.47:48812) 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 -- 172.21.15.47:0/3730792130 learned_addr learned my addr 172.21.15.47:0/3730792130 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f9637fff640 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db84d0 0x558ea91896d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db02f0 0x558ea9185900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 -- 172.21.15.47:0/3730792130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db84d0 msgr2=0x558ea91896d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db84d0 0x558ea91896d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 -- 172.21.15.47:0/3730792130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db02f0 msgr2=0x558ea9185900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db02f0 0x558ea9185900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.175+0000 7f963ed9d640 1 -- 172.21.15.47:0/3730792130 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ea918a330 con 0x558ea8dd91b0 2024-09-21T01:00:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.176+0000 7f963ed9d640 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea917beb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f96380048a0 tx=0x7f9638029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a891a4cd4508dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.176+0000 7f9627fff640 1 -- 172.21.15.47:0/3730792130 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96380197f0 con 0x558ea8dd91b0 2024-09-21T01:00:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.176+0000 7f9627fff640 1 -- 172.21.15.47:0/3730792130 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9638003e40 con 0x558ea8dd91b0 2024-09-21T01:00:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.176+0000 7f9627fff640 1 -- 172.21.15.47:0/3730792130 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963800faf0 con 0x558ea8dd91b0 2024-09-21T01:00:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 -- 172.21.15.47:0/3730792130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 msgr2=0x558ea917beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:00:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea917beb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f96380048a0 tx=0x7f9638029fb0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 -- 172.21.15.47:0/3730792130 shutdown_connections 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8dd91b0 0x558ea917beb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8db84d0 0x558ea91896d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 --2- 172.21.15.47:0/3730792130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db02f0 0x558ea9185900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 -- 172.21.15.47:0/3730792130 >> 172.21.15.47:0/3730792130 conn(0x558ea8dcd300 msgr2=0x558ea9188fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 -- 172.21.15.47:0/3730792130 shutdown_connections 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 -- 172.21.15.47:0/3730792130 wait complete. 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 -- start start 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.177+0000 7f964b9d6740 1 Processor -- start 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db02f0 0x558ea9192250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea9190f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f964b9d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8dd91b0 0x558ea9191450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f964b9d6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f96401abd10 con 0x558ea8db02f0 2024-09-21T01:00:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f964b9d6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f96401ad180 con 0x558ea8db84d0 2024-09-21T01:00:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f964b9d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96401ac3e0 con 0x558ea8dd91b0 2024-09-21T01:00:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f964b9d6740 10 client.0 _ll_register_callbacks cb 0x7f9628009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:00:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db02f0 0x558ea9192250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db02f0 0x558ea9192250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48816/0 (socket says 172.21.15.47:48816) 2024-09-21T01:00:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 -- 172.21.15.47:0/2356357482 learned_addr learned my addr 172.21.15.47:0/2356357482 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:00:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f9637fff640 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea9190f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8dd91b0 0x558ea9191450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 -- 172.21.15.47:0/2356357482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8dd91b0 msgr2=0x558ea9191450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8dd91b0 0x558ea9191450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 -- 172.21.15.47:0/2356357482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 msgr2=0x558ea9190f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:00:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea9190f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:00:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 -- 172.21.15.47:0/2356357482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ea9191a90 con 0x558ea8db02f0 2024-09-21T01:00:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f963ed9d640 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db02f0 0x558ea9192250 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9638009f10 tx=0x7f9638009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce1f3edd926af72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:00:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.178+0000 7f9625ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:00:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f9625ffb640 1 -- 172.21.15.47:0/2356357482 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638019a70 con 0x558ea8db02f0 2024-09-21T01:00:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f9625ffb640 1 -- 172.21.15.47:0/2356357482 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f9638019c10 con 0x558ea8db02f0 2024-09-21T01:00:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 1 -- 172.21.15.47:0/2356357482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9638003e40 con 0x558ea8db02f0 2024-09-21T01:00:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f9625ffb640 1 -- 172.21.15.47:0/2356357482 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9638004910 con 0x558ea8db02f0 2024-09-21T01:00:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 10 client.15708 fetch_fsmap learned FSMap version 19 2024-09-21T01:00:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 1 -- 172.21.15.47:0/2356357482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558ea9190920 con 0x558ea8db02f0 2024-09-21T01:00:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f9625ffb640 1 -- 172.21.15.47:0/2356357482 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9638003e40 con 0x558ea8db02f0 2024-09-21T01:00:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f9625ffb640 1 -- 172.21.15.47:0/2356357482 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f963800f8e0 con 0x558ea8db02f0 2024-09-21T01:00:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 10 client.15708 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:00:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:00:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 20 client.15708 populate_metadata read hostname 'smithi047' 2024-09-21T01:00:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558ea8d6d1c0 0x558ea9204a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:00:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 4 client.15708 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:00:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f964b9d6740 1 -- 172.21.15.47:0/2356357482 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ea90f10f0 con 0x558ea8d6d1c0 2024-09-21T01:00:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.179+0000 7f9637fff640 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558ea8d6d1c0 0x558ea9204a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:00:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.180+0000 7f9637fff640 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558ea8d6d1c0 0x558ea9204a80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed00b7a9e040649 server_cookie=8d0f9f71451d45e6 in_seq=0 out_seq=0 2024-09-21T01:00:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:00:48.180+0000 7f9625ffb640 10 client.15708 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:00:49.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:48 smithi114 ceph-mon[34309]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 72 MiB/s wr, 9.11k op/s 2024-09-21T01:00:49.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:48 smithi047 ceph-mon[30960]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 72 MiB/s wr, 9.11k op/s 2024-09-21T01:00:49.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:48 smithi134 ceph-mon[34785]: pgmap v408: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 72 MiB/s wr, 9.11k op/s 2024-09-21T01:00:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:50 smithi114 ceph-mon[34309]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 62 MiB/s wr, 7.88k op/s 2024-09-21T01:00:51.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:50 smithi047 ceph-mon[30960]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 62 MiB/s wr, 7.88k op/s 2024-09-21T01:00:51.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:50 smithi134 ceph-mon[34785]: pgmap v409: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 62 MiB/s wr, 7.88k op/s 2024-09-21T01:00:52.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:51 smithi114 ceph-mon[34309]: Health check update: 3 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:52.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:51 smithi047 ceph-mon[30960]: Health check update: 3 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:52.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:51 smithi134 ceph-mon[34785]: Health check update: 3 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:53.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:52 smithi114 ceph-mon[34309]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 60 MiB/s wr, 7.67k op/s 2024-09-21T01:00:53.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:52 smithi047 ceph-mon[30960]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 60 MiB/s wr, 7.67k op/s 2024-09-21T01:00:53.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:52 smithi134 ceph-mon[34785]: pgmap v410: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 60 MiB/s wr, 7.67k op/s 2024-09-21T01:00:55.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:54 smithi114 ceph-mon[34309]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 64 MiB/s wr, 8.20k op/s 2024-09-21T01:00:55.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:54 smithi047 ceph-mon[30960]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 64 MiB/s wr, 8.20k op/s 2024-09-21T01:00:55.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:54 smithi134 ceph-mon[34785]: pgmap v411: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 64 MiB/s wr, 8.20k op/s 2024-09-21T01:00:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:56 smithi114 ceph-mon[34309]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 49 MiB/s wr, 6.39k op/s 2024-09-21T01:00:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:56 smithi114 ceph-mon[34309]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:57.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:56 smithi047 ceph-mon[30960]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 49 MiB/s wr, 6.39k op/s 2024-09-21T01:00:57.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:56 smithi047 ceph-mon[30960]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:56 smithi134 ceph-mon[34785]: pgmap v412: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 49 MiB/s wr, 6.39k op/s 2024-09-21T01:00:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:56 smithi134 ceph-mon[34785]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:00:58.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:00:58.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:00:58.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:00:58.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:57 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:00:58.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:00:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:00:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:00:58.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:57 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:00:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:00:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:00:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:00:58.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:57 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:00:59.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:00:58 smithi114 ceph-mon[34309]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 58 MiB/s wr, 7.56k op/s 2024-09-21T01:00:59.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:00:58 smithi047 ceph-mon[30960]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 58 MiB/s wr, 7.56k op/s 2024-09-21T01:00:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:00:58 smithi134 ceph-mon[34785]: pgmap v413: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 58 MiB/s wr, 7.56k op/s 2024-09-21T01:01:01.162 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:00 smithi134 ceph-mon[34785]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 51 MiB/s wr, 6.64k op/s 2024-09-21T01:01:01.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:00 smithi047 ceph-mon[30960]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 51 MiB/s wr, 6.64k op/s 2024-09-21T01:01:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:00 smithi114 ceph-mon[34309]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 51 MiB/s wr, 6.64k op/s 2024-09-21T01:01:02.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:01 smithi134 ceph-mon[34785]: Health check update: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:01:02.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:01 smithi114 ceph-mon[34309]: Health check update: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:01:02.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:01 smithi047 ceph-mon[30960]: Health check update: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:01:03.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:02 smithi134 ceph-mon[34785]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 49 MiB/s wr, 6.53k op/s 2024-09-21T01:01:03.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:02 smithi114 ceph-mon[34309]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 49 MiB/s wr, 6.53k op/s 2024-09-21T01:01:03.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:02 smithi047 ceph-mon[30960]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 49 MiB/s wr, 6.53k op/s 2024-09-21T01:01:05.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:04 smithi134 ceph-mon[34785]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 60 MiB/s wr, 7.76k op/s 2024-09-21T01:01:05.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:04 smithi114 ceph-mon[34309]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 60 MiB/s wr, 7.76k op/s 2024-09-21T01:01:05.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:04 smithi047 ceph-mon[30960]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 60 MiB/s wr, 7.76k op/s 2024-09-21T01:01:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:06 smithi134 ceph-mon[34785]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 6.48k op/s 2024-09-21T01:01:07.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:06 smithi114 ceph-mon[34309]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 6.48k op/s 2024-09-21T01:01:07.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:06 smithi047 ceph-mon[30960]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 6.48k op/s 2024-09-21T01:01:09.258 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:08 smithi047 ceph-mon[30960]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 MiB/s wr, 7.76k op/s 2024-09-21T01:01:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:08 smithi134 ceph-mon[34785]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 MiB/s wr, 7.76k op/s 2024-09-21T01:01:09.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:08 smithi114 ceph-mon[34309]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 61 MiB/s wr, 7.76k op/s 2024-09-21T01:01:11.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:10 smithi047 ceph-mon[30960]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 52 MiB/s wr, 6.66k op/s 2024-09-21T01:01:11.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:10 smithi134 ceph-mon[34785]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 52 MiB/s wr, 6.66k op/s 2024-09-21T01:01:11.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:10 smithi114 ceph-mon[34309]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 52 MiB/s wr, 6.66k op/s 2024-09-21T01:01:13.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:01:13.260 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:12 smithi047 ceph-mon[30960]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 50 MiB/s wr, 6.35k op/s 2024-09-21T01:01:13.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:12 smithi134 ceph-mon[34785]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 50 MiB/s wr, 6.35k op/s 2024-09-21T01:01:13.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:12 smithi114 ceph-mon[34309]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 50 MiB/s wr, 6.35k op/s 2024-09-21T01:01:13.557 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 -- 172.21.15.47:0/118330168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150109e20 msgr2=0x7f1150110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 --2- 172.21.15.47:0/118330168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150109e20 0x7f1150110650 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1148009ca0 tx=0x7f114802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 -- 172.21.15.47:0/118330168 shutdown_connections 2024-09-21T01:01:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 --2- 172.21.15.47:0/118330168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150109e20 0x7f1150110650 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 --2- 172.21.15.47:0/118330168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11501094d0 0x7f11501098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 --2- 172.21.15.47:0/118330168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1150103b90 0x7f1150103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 -- 172.21.15.47:0/118330168 >> 172.21.15.47:0/118330168 conn(0x7f11500ff600 msgr2=0x7f1150101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:14.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 -- 172.21.15.47:0/118330168 shutdown_connections 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.101+0000 7f115529b640 1 -- 172.21.15.47:0/118330168 wait complete. 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f115529b640 1 Processor -- start 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f115529b640 1 -- start start 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f115529b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150103b90 0x7f1150075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f115529b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11501094d0 0x7f1150075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f115529b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1150109e20 0x7f1150076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f115529b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1150113ae0 con 0x7f1150103b90 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f115529b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1150113960 con 0x7f1150109e20 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f115529b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1150113c60 con 0x7f11501094d0 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f114effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150103b90 0x7f1150075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.102+0000 7f114effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150103b90 0x7f1150075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58712/0 (socket says 172.21.15.47:58712) 2024-09-21T01:01:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114effd640 1 -- 172.21.15.47:0/1960594020 learned_addr learned my addr 172.21.15.47:0/1960594020 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114e7fc640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11501094d0 0x7f1150075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114f7fe640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1150109e20 0x7f1150076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114effd640 1 -- 172.21.15.47:0/1960594020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11501094d0 msgr2=0x7f1150075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114effd640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11501094d0 0x7f1150075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114effd640 1 -- 172.21.15.47:0/1960594020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1150109e20 msgr2=0x7f1150076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114effd640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1150109e20 0x7f1150076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114effd640 1 -- 172.21.15.47:0/1960594020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11501a8730 con 0x7f1150103b90 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114e7fc640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11501094d0 0x7f1150075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f114effd640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150103b90 0x7f1150075710 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f114000e9f0 tx=0x7f114000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f1137fff640 1 -- 172.21.15.47:0/1960594020 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114000cd80 con 0x7f1150103b90 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.103+0000 7f115529b640 1 -- 172.21.15.47:0/1960594020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11501a8a20 con 0x7f1150103b90 2024-09-21T01:01:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.104+0000 7f115529b640 1 -- 172.21.15.47:0/1960594020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11501a8f60 con 0x7f1150103b90 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.104+0000 7f1137fff640 1 -- 172.21.15.47:0/1960594020 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11400054d0 con 0x7f1150103b90 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.104+0000 7f1137fff640 1 -- 172.21.15.47:0/1960594020 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140010690 con 0x7f1150103b90 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f115b80f740 1 Processor -- start 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f115b80f740 1 -- start start 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f115b80f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef751650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f115b80f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3811b0 0x55abef751b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f115b80f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef389390 0x55abef7520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f115b80f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55abef6c7e50 con 0x55abef389390 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f115b80f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55abef6b7280 con 0x55abef3811b0 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f115b80f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55abef6bb090 con 0x55abef3aa070 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f114e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef389390 0x55abef7520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef751650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef751650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:59858/0 (socket says 172.21.15.47:59858) 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.107+0000 7f114f7fe640 1 -- 172.21.15.47:0/3314730200 learned_addr learned my addr 172.21.15.47:0/3314730200 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f114f7fe640 1 -- 172.21.15.47:0/3314730200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3811b0 msgr2=0x55abef751b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f114f7fe640 1 --2- 172.21.15.47:0/3314730200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3811b0 0x55abef751b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f114f7fe640 1 -- 172.21.15.47:0/3314730200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef389390 msgr2=0x55abef7520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f114f7fe640 1 --2- 172.21.15.47:0/3314730200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef389390 0x55abef7520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f114f7fe640 1 -- 172.21.15.47:0/3314730200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abef415650 con 0x55abef3aa070 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f114e7fc640 1 --2- 172.21.15.47:0/3314730200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef389390 0x55abef7520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f1137fff640 1 -- 172.21.15.47:0/1960594020 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f11400046c0 con 0x7f1150103b90 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f114f7fe640 1 --2- 172.21.15.47:0/3314730200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef751650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f114802f410 tx=0x7f114802f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3213ace28b624a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f11357fa640 1 -- 172.21.15.47:0/3314730200 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148031cf0 con 0x55abef3aa070 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f11357fa640 1 -- 172.21.15.47:0/3314730200 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1148036030 con 0x55abef3aa070 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.108+0000 7f11357fa640 1 -- 172.21.15.47:0/3314730200 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11480042a0 con 0x55abef3aa070 2024-09-21T01:01:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.109+0000 7f1137fff640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11380b6510 0x7f11380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.109+0000 7f114effd640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11380b6510 0x7f11380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.109+0000 7f115b80f740 1 -- 172.21.15.47:0/3314730200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 msgr2=0x55abef751650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.109+0000 7f115b80f740 1 --2- 172.21.15.47:0/3314730200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef751650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f114802f410 tx=0x7f114802f440 comp rx=0 tx=0).stop 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.109+0000 7f1137fff640 1 -- 172.21.15.47:0/1960594020 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f11400e7480 con 0x7f1150103b90 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.110+0000 7f114effd640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11380b6510 0x7f11380b8a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f11400715f0 tx=0x7f11400a7b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.110+0000 7f115b80f740 1 -- 172.21.15.47:0/3314730200 shutdown_connections 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.110+0000 7f115b80f740 1 --2- 172.21.15.47:0/3314730200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef389390 0x55abef7520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.110+0000 7f115b80f740 1 --2- 172.21.15.47:0/3314730200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3811b0 0x55abef751b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.110+0000 7f115b80f740 1 --2- 172.21.15.47:0/3314730200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef751650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.110+0000 7f115b80f740 1 -- 172.21.15.47:0/3314730200 >> 172.21.15.47:0/3314730200 conn(0x55abef39e460 msgr2=0x55abef74f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.110+0000 7f115b80f740 1 -- 172.21.15.47:0/3314730200 shutdown_connections 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.110+0000 7f115b80f740 1 -- 172.21.15.47:0/3314730200 wait complete. 2024-09-21T01:01:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 1 -- start start 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 1 Processor -- start 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef75ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef389390 0x55abef75d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3aa070 0x55abef75d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55abef518700 con 0x55abef3811b0 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55abef652110 con 0x55abef3aa070 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55abef75fc50 con 0x55abef389390 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f115b80f740 10 client.0 _ll_register_callbacks cb 0x55abef66b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f114e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef389390 0x55abef75d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.111+0000 7f114e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef389390 0x55abef75d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:59872/0 (socket says 172.21.15.47:59872) 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114e7fc640 1 -- 172.21.15.47:0/3588277190 learned_addr learned my addr 172.21.15.47:0/3588277190 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:14.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114f7fe640 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3aa070 0x55abef75d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114f7fe640 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef75ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114e7fc640 1 -- 172.21.15.47:0/3588277190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3aa070 msgr2=0x55abef75d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114e7fc640 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3aa070 0x55abef75d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114e7fc640 1 -- 172.21.15.47:0/3588277190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 msgr2=0x55abef75ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114e7fc640 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef75ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114e7fc640 1 -- 172.21.15.47:0/3588277190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abef67fc40 con 0x55abef389390 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114f7fe640 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef75ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f114e7fc640 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef389390 0x55abef75d230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1144012d20 tx=0x7f114400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=936e64131b210943 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f1132ff5640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f1132ff5640 1 -- 172.21.15.47:0/3588277190 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11440120d0 con 0x55abef389390 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f1132ff5640 1 -- 172.21.15.47:0/3588277190 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f1144004030 con 0x55abef389390 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.112+0000 7f115b80f740 1 -- 172.21.15.47:0/3588277190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1148036030 con 0x55abef389390 2024-09-21T01:01:14.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f1132ff5640 1 -- 172.21.15.47:0/3588277190 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1144012270 con 0x55abef389390 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f115b80f740 10 client.25405 fetch_fsmap learned FSMap version 19 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f115b80f740 1 -- 172.21.15.47:0/3588277190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55abef76ba10 con 0x55abef389390 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f1132ff5640 1 -- 172.21.15.47:0/3588277190 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1148036030 con 0x55abef389390 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f1132ff5640 1 -- 172.21.15.47:0/3588277190 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f114401c460 con 0x55abef389390 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f115b80f740 10 client.25405 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f115b80f740 10 client.25405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f115b80f740 20 client.25405 populate_metadata read hostname 'smithi047' 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f115b80f740 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55abef3689f0 0x55abef76efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f115b80f740 4 client.25405 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f115b80f740 1 -- 172.21.15.47:0/3588277190 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abef6c9da0 con 0x55abef3689f0 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.113+0000 7f114f7fe640 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55abef3689f0 0x55abef76efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.114+0000 7f1132ff5640 10 client.25405 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:14.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.114+0000 7f114f7fe640 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55abef3689f0 0x55abef76efe0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3804f9a6bd5856a server_cookie=1ce0eb8b718cd819 in_seq=0 out_seq=0 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.114+0000 7f1132ff5640 1 -- 172.21.15.47:0/3588277190 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55abef6c9da0 con 0x55abef3689f0 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.114+0000 7f1132ff5640 10 client.25405 handle_command_reply: tid=0 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 client.25405 shutdown 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 -- 172.21.15.47:0/3588277190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef389390 msgr2=0x55abef75d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef389390 0x55abef75d230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1144012d20 tx=0x7f114400f790 comp rx=0 tx=0).stop 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 -- 172.21.15.47:0/3588277190 shutdown_connections 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55abef3689f0 0x55abef76efe0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef3aa070 0x55abef75d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef389390 0x55abef75d230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 --2- 172.21.15.47:0/3588277190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef75ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f1132ff5640 0 client.25405 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 -- 172.21.15.47:0/3588277190 >> 172.21.15.47:0/3588277190 conn(0x55abef39e460 msgr2=0x55abef7547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 -- 172.21.15.47:0/3588277190 shutdown_connections 2024-09-21T01:01:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 1 -- 172.21.15.47:0/3588277190 wait complete. 2024-09-21T01:01:14.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.115+0000 7f115b80f740 20 client.25405 trim_cache size 0 max 16384 2024-09-21T01:01:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.137+0000 7f115b80f740 1 Processor -- start 2024-09-21T01:01:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.137+0000 7f115b80f740 1 -- start start 2024-09-21T01:01:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.137+0000 7f115b80f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3811b0 0x55abef75ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.137+0000 7f115b80f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef752680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.137+0000 7f115b80f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3aa070 0x55abef75d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.137+0000 7f115b80f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f113c00c300 con 0x55abef3aa070 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.137+0000 7f115b80f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f113c00eb80 con 0x55abef389390 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.137+0000 7f115b80f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f113c00c970 con 0x55abef3811b0 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3aa070 0x55abef75d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3aa070 0x55abef75d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58752/0 (socket says 172.21.15.47:58752) 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 -- 172.21.15.47:0/4264475617 learned_addr learned my addr 172.21.15.47:0/4264475617 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef752680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3811b0 0x55abef75ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 -- 172.21.15.47:0/4264475617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3811b0 msgr2=0x55abef75ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3811b0 0x55abef75ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 -- 172.21.15.47:0/4264475617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 msgr2=0x55abef752680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef752680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 -- 172.21.15.47:0/4264475617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abef753b70 con 0x55abef3aa070 2024-09-21T01:01:14.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114e7fc640 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef752680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:14.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f114f7fe640 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3aa070 0x55abef75d1b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1148000f80 tx=0x7f114802f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef163864fb4bc393 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:14.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f1134ff9640 1 -- 172.21.15.47:0/4264475617 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114804a040 con 0x55abef3aa070 2024-09-21T01:01:14.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.138+0000 7f1134ff9640 1 -- 172.21.15.47:0/4264475617 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1148036040 con 0x55abef3aa070 2024-09-21T01:01:14.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.139+0000 7f1134ff9640 1 -- 172.21.15.47:0/4264475617 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114802fb90 con 0x55abef3aa070 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 -- 172.21.15.47:0/4264475617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3aa070 msgr2=0x55abef75d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3aa070 0x55abef75d1b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1148000f80 tx=0x7f114802f3a0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 -- 172.21.15.47:0/4264475617 shutdown_connections 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3aa070 0x55abef75d1b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef752680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 --2- 172.21.15.47:0/4264475617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3811b0 0x55abef75ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 -- 172.21.15.47:0/4264475617 >> 172.21.15.47:0/4264475617 conn(0x55abef39e460 msgr2=0x55abef75caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 -- 172.21.15.47:0/4264475617 shutdown_connections 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 -- 172.21.15.47:0/4264475617 wait complete. 2024-09-21T01:01:14.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.140+0000 7f115b80f740 1 -- start start 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.141+0000 7f115b80f740 1 Processor -- start 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.141+0000 7f115b80f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef7655d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.141+0000 7f115b80f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef760a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.141+0000 7f115b80f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef760fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.141+0000 7f115b80f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f113c00d040 con 0x55abef3811b0 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.141+0000 7f115b80f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f113c00e4b0 con 0x55abef389390 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.141+0000 7f115b80f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f113c00d710 con 0x55abef3aa070 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.141+0000 7f115b80f740 10 client.0 _ll_register_callbacks cb 0x7f1144009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef760a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef760fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef760a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:58520/0 (socket says 172.21.15.47:58520) 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114e7fc640 1 -- 172.21.15.47:0/664285738 learned_addr learned my addr 172.21.15.47:0/664285738 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114f7fe640 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef7655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114f7fe640 1 -- 172.21.15.47:0/664285738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 msgr2=0x55abef760a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:14.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114f7fe640 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef760a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114f7fe640 1 -- 172.21.15.47:0/664285738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 msgr2=0x55abef7655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:14.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114f7fe640 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef7655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.142+0000 7f114f7fe640 1 -- 172.21.15.47:0/664285738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abef761600 con 0x55abef3aa070 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.143+0000 7f114f7fe640 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef760fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1148009620 tx=0x7f114802f770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dacfbb998d35f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.143+0000 7f1132ff5640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.143+0000 7f1132ff5640 1 -- 172.21.15.47:0/664285738 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148062040 con 0x55abef3aa070 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.143+0000 7f1132ff5640 1 -- 172.21.15.47:0/664285738 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f1148031650 con 0x55abef3aa070 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.143+0000 7f115b80f740 1 -- 172.21.15.47:0/664285738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1148036040 con 0x55abef3aa070 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.143+0000 7f1132ff5640 1 -- 172.21.15.47:0/664285738 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f114804a040 con 0x55abef3aa070 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.143+0000 7f115b80f740 10 client.25411 fetch_fsmap learned FSMap version 19 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.143+0000 7f115b80f740 1 -- 172.21.15.47:0/664285738 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55abef7e1fb0 con 0x55abef3aa070 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f1132ff5640 1 -- 172.21.15.47:0/664285738 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1148036040 con 0x55abef3aa070 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f1132ff5640 1 -- 172.21.15.47:0/664285738 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1148043070 con 0x55abef3aa070 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f115b80f740 10 client.25411 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:01:14.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f115b80f740 10 client.25411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f115b80f740 20 client.25411 populate_metadata read hostname 'smithi047' 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f115b80f740 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55abef33dda0 0x55abef7e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f115b80f740 4 client.25411 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f115b80f740 1 -- 172.21.15.47:0/664285738 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55abef6c5850 con 0x55abef33dda0 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.144+0000 7f114e7fc640 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55abef33dda0 0x55abef7e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.145+0000 7f1132ff5640 10 client.25411 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.145+0000 7f114e7fc640 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55abef33dda0 0x55abef7e43b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f7c0033adf423fc server_cookie=4fcfdae26f188570 in_seq=0 out_seq=0 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.145+0000 7f1132ff5640 1 -- 172.21.15.47:0/664285738 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1429 (crc 0 0 0) 0x55abef6c5850 con 0x55abef33dda0 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.145+0000 7f1132ff5640 10 client.25411 handle_command_reply: tid=0 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.145+0000 7f115b80f740 1 client.25411 shutdown 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.145+0000 7f115b80f740 1 -- 172.21.15.47:0/664285738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 msgr2=0x55abef760fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.145+0000 7f115b80f740 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef760fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1148009620 tx=0x7f114802f770 comp rx=0 tx=0).stop 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 1 -- 172.21.15.47:0/664285738 shutdown_connections 2024-09-21T01:01:14.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55abef33dda0 0x55abef7e43b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55abef3aa070 0x55abef760fc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55abef389390 0x55abef760a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 1 --2- 172.21.15.47:0/664285738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55abef3811b0 0x55abef7655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 1 -- 172.21.15.47:0/664285738 >> 172.21.15.47:0/664285738 conn(0x55abef39e460 msgr2=0x55abef75e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:14.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f1132ff5640 0 client.25411 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:14.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 1 -- 172.21.15.47:0/664285738 shutdown_connections 2024-09-21T01:01:14.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 1 -- 172.21.15.47:0/664285738 wait complete. 2024-09-21T01:01:14.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.146+0000 7f115b80f740 20 client.25411 trim_cache size 0 max 16384 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (46 inodes in the stack)", 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "013c654d-123e-4be3-a479-1be70f6e1569", 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:01:14.150 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:01:14.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:01:14.152 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:01:14.153 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:01:14.153 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:01:14.153 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:01:14.153 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:01:14.153 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:01:14.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 -- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11380b6510 msgr2=0x7f11380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11380b6510 0x7f11380b8a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f11400715f0 tx=0x7f11400a7b50 comp rx=0 tx=0).stop 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 -- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150103b90 msgr2=0x7f1150075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150103b90 0x7f1150075710 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f114000e9f0 tx=0x7f114000edf0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 -- 172.21.15.47:0/1960594020 shutdown_connections 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f11380b6510 0x7f11380b8a20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1150109e20 0x7f1150076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11501094d0 0x7f1150075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 --2- 172.21.15.47:0/1960594020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1150103b90 0x7f1150075710 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 -- 172.21.15.47:0/1960594020 >> 172.21.15.47:0/1960594020 conn(0x7f11500ff600 msgr2=0x7f1150106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 -- 172.21.15.47:0/1960594020 shutdown_connections 2024-09-21T01:01:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:14.147+0000 7f115529b640 1 -- 172.21.15.47:0/1960594020 wait complete. 2024-09-21T01:01:15.131 INFO:tasks.cephfs.filesystem:scrub status for tag:013c654d-123e-4be3-a479-1be70f6e1569 - {'path': '/', 'tag': '013c654d-123e-4be3-a479-1be70f6e1569', 'options': 'recursive,force'} 2024-09-21T01:01:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:14 smithi134 ceph-mon[34785]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 MiB/s wr, 7.51k op/s 2024-09-21T01:01:15.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:14 smithi114 ceph-mon[34309]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 MiB/s wr, 7.51k op/s 2024-09-21T01:01:15.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:14 smithi047 ceph-mon[30960]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 MiB/s wr, 7.51k op/s 2024-09-21T01:01:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:16 smithi134 ceph-mon[34785]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 47 MiB/s wr, 6.04k op/s 2024-09-21T01:01:17.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:16 smithi114 ceph-mon[34309]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 47 MiB/s wr, 6.04k op/s 2024-09-21T01:01:17.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:16 smithi047 ceph-mon[30960]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 47 MiB/s wr, 6.04k op/s 2024-09-21T01:01:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:18 smithi134 ceph-mon[34785]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 7.27k op/s 2024-09-21T01:01:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.366+0000 7f9625ffb640 1 -- 172.21.15.47:0/2356357482 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ea90f10f0 con 0x558ea8d6d1c0 2024-09-21T01:01:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.366+0000 7f9625ffb640 10 client.15708 handle_command_reply: tid=0 2024-09-21T01:01:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.366+0000 7f964b9d6740 1 client.15708 shutdown 2024-09-21T01:01:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.366+0000 7f964b9d6740 1 -- 172.21.15.47:0/2356357482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db02f0 msgr2=0x558ea9192250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.366+0000 7f964b9d6740 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db02f0 0x558ea9192250 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9638009f10 tx=0x7f9638009ea0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 1 -- 172.21.15.47:0/2356357482 shutdown_connections 2024-09-21T01:01:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x558ea8d6d1c0 0x558ea9204a80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ea8dd91b0 0x558ea9191450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558ea8db84d0 0x558ea9190f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 1 --2- 172.21.15.47:0/2356357482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558ea8db02f0 0x558ea9192250 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 1 -- 172.21.15.47:0/2356357482 >> 172.21.15.47:0/2356357482 conn(0x558ea8dcd300 msgr2=0x558ea9189980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f9625ffb640 0 client.15708 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 1 -- 172.21.15.47:0/2356357482 shutdown_connections 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 1 -- 172.21.15.47:0/2356357482 wait complete. 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.367+0000 7f964b9d6740 20 client.15708 trim_cache size 0 max 16384 2024-09-21T01:01:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:01:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:01:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:01:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:01:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 -- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f962c0b6510 msgr2=0x7f962c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f962c0b6510 0x7f962c0b8a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f96300ca010 tx=0x7f963010d530 comp rx=0 tx=0).stop 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 -- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 msgr2=0x7f964010cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 0x7f964010cd20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9630006010 tx=0x7f96300042f0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 -- 172.21.15.47:0/1287899842 shutdown_connections 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f962c0b6510 0x7f962c0b8a20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96401040c0 0x7f964010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96401034b0 0x7f964010b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 --2- 172.21.15.47:0/1287899842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9640102ad0 0x7f964010cd20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 -- 172.21.15.47:0/1287899842 >> 172.21.15.47:0/1287899842 conn(0x7f96400fd680 msgr2=0x7f9640106b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 -- 172.21.15.47:0/1287899842 shutdown_connections 2024-09-21T01:01:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:19.368+0000 7f9644a69640 1 -- 172.21.15.47:0/1287899842 wait complete. 2024-09-21T01:01:19.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:18 smithi114 ceph-mon[34309]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 7.27k op/s 2024-09-21T01:01:19.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:18 smithi047 ceph-mon[30960]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 7.27k op/s 2024-09-21T01:01:21.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:20 smithi047 ceph-mon[30960]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 47 MiB/s wr, 6.07k op/s 2024-09-21T01:01:21.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:20 smithi134 ceph-mon[34785]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 47 MiB/s wr, 6.07k op/s 2024-09-21T01:01:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:20 smithi114 ceph-mon[34309]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 47 MiB/s wr, 6.07k op/s 2024-09-21T01:01:23.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:22 smithi134 ceph-mon[34785]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 46 MiB/s wr, 5.86k op/s 2024-09-21T01:01:23.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:22 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:22 smithi114 ceph-mon[34309]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 46 MiB/s wr, 5.86k op/s 2024-09-21T01:01:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:22 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:23.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:22 smithi047 ceph-mon[30960]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 46 MiB/s wr, 5.86k op/s 2024-09-21T01:01:23.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:22 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T01:01:25.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:24 smithi134 ceph-mon[34785]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 MiB/s wr, 7.02k op/s 2024-09-21T01:01:25.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:24 smithi114 ceph-mon[34309]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 MiB/s wr, 7.02k op/s 2024-09-21T01:01:25.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:24 smithi047 ceph-mon[30960]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 MiB/s wr, 7.02k op/s 2024-09-21T01:01:27.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:27 smithi134 ceph-mon[34785]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 43 MiB/s wr, 5.65k op/s 2024-09-21T01:01:27.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:26 smithi114 ceph-mon[34309]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 43 MiB/s wr, 5.65k op/s 2024-09-21T01:01:27.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:26 smithi047 ceph-mon[30960]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 43 MiB/s wr, 5.65k op/s 2024-09-21T01:01:29.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:29 smithi134 ceph-mon[34785]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 54 MiB/s wr, 7.01k op/s 2024-09-21T01:01:29.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:29 smithi114 ceph-mon[34309]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 54 MiB/s wr, 7.01k op/s 2024-09-21T01:01:29.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:29 smithi047 ceph-mon[30960]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 54 MiB/s wr, 7.01k op/s 2024-09-21T01:01:31.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:31 smithi134 ceph-mon[34785]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 MiB/s wr, 5.79k op/s 2024-09-21T01:01:31.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:31 smithi114 ceph-mon[34309]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 MiB/s wr, 5.79k op/s 2024-09-21T01:01:31.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:31 smithi047 ceph-mon[30960]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 MiB/s wr, 5.79k op/s 2024-09-21T01:01:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.489+0000 7faa249cc640 1 -- 172.21.15.47:0/4012610791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109480 msgr2=0x7faa2010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.489+0000 7faa249cc640 1 --2- 172.21.15.47:0/4012610791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109480 0x7faa2010b920 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faa18009ca0 tx=0x7faa1802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.490+0000 7faa249cc640 1 -- 172.21.15.47:0/4012610791 shutdown_connections 2024-09-21T01:01:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.490+0000 7faa249cc640 1 --2- 172.21.15.47:0/4012610791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20109480 0x7faa2010b920 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.490+0000 7faa249cc640 1 --2- 172.21.15.47:0/4012610791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa20106b20 0x7faa20108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.490+0000 7faa249cc640 1 --2- 172.21.15.47:0/4012610791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa20101a90 0x7faa20101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.490+0000 7faa249cc640 1 -- 172.21.15.47:0/4012610791 >> 172.21.15.47:0/4012610791 conn(0x7faa200fd690 msgr2=0x7faa200ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.490+0000 7faa249cc640 1 -- 172.21.15.47:0/4012610791 shutdown_connections 2024-09-21T01:01:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.490+0000 7faa249cc640 1 -- 172.21.15.47:0/4012610791 wait complete. 2024-09-21T01:01:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa249cc640 1 Processor -- start 2024-09-21T01:01:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa249cc640 1 -- start start 2024-09-21T01:01:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa249cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20101a90 0x7faa20199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa249cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa20106b20 0x7faa2019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa249cc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa20109480 0x7faa2019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa249cc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010f350 con 0x7faa20101a90 2024-09-21T01:01:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa249cc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010f1d0 con 0x7faa20109480 2024-09-21T01:01:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa249cc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010f4d0 con 0x7faa20106b20 2024-09-21T01:01:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20101a90 0x7faa20199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20101a90 0x7faa20199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43512/0 (socket says 172.21.15.47:43512) 2024-09-21T01:01:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1e59c640 1 -- 172.21.15.47:0/3866029303 learned_addr learned my addr 172.21.15.47:0/3866029303 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa20106b20 0x7faa2019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1ed9d640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa20109480 0x7faa2019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1e59c640 1 -- 172.21.15.47:0/3866029303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa20106b20 msgr2=0x7faa2019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1e59c640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa20106b20 0x7faa2019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1e59c640 1 -- 172.21.15.47:0/3866029303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa20109480 msgr2=0x7faa2019b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1e59c640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa20109480 0x7faa2019b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.491+0000 7faa1e59c640 1 -- 172.21.15.47:0/3866029303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2019b950 con 0x7faa20101a90 2024-09-21T01:01:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.492+0000 7faa1e59c640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20101a90 0x7faa20199f10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faa1000d950 tx=0x7faa1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.492+0000 7faa0f7fe640 1 -- 172.21.15.47:0/3866029303 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10017030 con 0x7faa20101a90 2024-09-21T01:01:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.492+0000 7faa249cc640 1 -- 172.21.15.47:0/3866029303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2019bc40 con 0x7faa20101a90 2024-09-21T01:01:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.492+0000 7faa0f7fe640 1 -- 172.21.15.47:0/3866029303 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa10004020 con 0x7faa20101a90 2024-09-21T01:01:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.492+0000 7faa249cc640 1 -- 172.21.15.47:0/3866029303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa201a2330 con 0x7faa20101a90 2024-09-21T01:01:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.492+0000 7faa0f7fe640 1 -- 172.21.15.47:0/3866029303 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10005640 con 0x7faa20101a90 2024-09-21T01:01:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.495+0000 7faa0f7fe640 1 -- 172.21.15.47:0/3866029303 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7faa10009a30 con 0x7faa20101a90 2024-09-21T01:01:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.496+0000 7faa2ba0e740 1 Processor -- start 2024-09-21T01:01:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.497+0000 7faa2ba0e740 1 -- start start 2024-09-21T01:01:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.497+0000 7faa0f7fe640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa080b66b0 0x7faa080b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.497+0000 7faa1ed9d640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa080b66b0 0x7faa080b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.498 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.497+0000 7faa0f7fe640 1 -- 172.21.15.47:0/3866029303 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7faa100e6c40 con 0x7faa20101a90 2024-09-21T01:01:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aae11b0 0x55673ae8d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aab82f0 0x55673ae8d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aac04d0 0x55673ae8e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55673adfb6f0 con 0x55673aae11b0 2024-09-21T01:01:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55673adeab20 con 0x55673aab82f0 2024-09-21T01:01:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55673adee930 con 0x55673aac04d0 2024-09-21T01:01:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa1ed9d640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa080b66b0 0x7faa080b8bc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa18005e30 tx=0x7faa18031af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aae11b0 0x55673ae8d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aae11b0 0x55673ae8d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43524/0 (socket says 172.21.15.47:43524) 2024-09-21T01:01:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa1e59c640 1 -- 172.21.15.47:0/287542513 learned_addr learned my addr 172.21.15.47:0/287542513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aab82f0 0x55673ae8d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.498+0000 7faa1ed9d640 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aac04d0 0x55673ae8e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa1e59c640 1 -- 172.21.15.47:0/287542513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aac04d0 msgr2=0x55673ae8e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa1e59c640 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aac04d0 0x55673ae8e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa1e59c640 1 -- 172.21.15.47:0/287542513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aab82f0 msgr2=0x55673ae8d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa1e59c640 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aab82f0 0x55673ae8d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa1e59c640 1 -- 172.21.15.47:0/287542513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55673adb0530 con 0x55673aae11b0 2024-09-21T01:01:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa1e59c640 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aae11b0 0x55673ae8d260 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faa10005fd0 tx=0x7faa100acd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131cd6c3c83cb5ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa0cff9640 1 -- 172.21.15.47:0/287542513 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100b1950 con 0x55673aae11b0 2024-09-21T01:01:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa0cff9640 1 -- 172.21.15.47:0/287542513 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa100b6890 con 0x55673aae11b0 2024-09-21T01:01:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.499+0000 7faa0cff9640 1 -- 172.21.15.47:0/287542513 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100abb40 con 0x55673aae11b0 2024-09-21T01:01:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.500+0000 7faa2ba0e740 1 -- 172.21.15.47:0/287542513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aae11b0 msgr2=0x55673ae8d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.500+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aae11b0 0x55673ae8d260 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faa10005fd0 tx=0x7faa100acd70 comp rx=0 tx=0).stop 2024-09-21T01:01:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.500+0000 7faa2ba0e740 1 -- 172.21.15.47:0/287542513 shutdown_connections 2024-09-21T01:01:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.500+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aac04d0 0x55673ae8e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.500+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aab82f0 0x55673ae8d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.500+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/287542513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aae11b0 0x55673ae8d260 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.500+0000 7faa2ba0e740 1 -- 172.21.15.47:0/287542513 >> 172.21.15.47:0/287542513 conn(0x55673aad5300 msgr2=0x55673ae848e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.501+0000 7faa2ba0e740 1 -- 172.21.15.47:0/287542513 shutdown_connections 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.501+0000 7faa2ba0e740 1 -- 172.21.15.47:0/287542513 wait complete. 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.501+0000 7faa2ba0e740 1 -- start start 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.501+0000 7faa2ba0e740 1 Processor -- start 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.501+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aab82f0 0x55673ae96a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.501+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae97140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.501+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aae11b0 0x55673ae97c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.501+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55673ad22ab0 con 0x55673aab82f0 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55673ad90730 con 0x55673aac04d0 2024-09-21T01:01:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55673ae8ef90 con 0x55673aae11b0 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa2ba0e740 10 client.0 _ll_register_callbacks cb 0x55673ade46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aab82f0 0x55673ae96a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aab82f0 0x55673ae96a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43536/0 (socket says 172.21.15.47:43536) 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 -- 172.21.15.47:0/1905174896 learned_addr learned my addr 172.21.15.47:0/1905174896 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae97140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1ed9d640 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aae11b0 0x55673ae97c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 -- 172.21.15.47:0/1905174896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aae11b0 msgr2=0x55673ae97c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aae11b0 0x55673ae97c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 -- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 msgr2=0x55673ae97140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae97140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 -- 172.21.15.47:0/1905174896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55673ab4c790 con 0x55673aab82f0 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae97140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa1e59c640 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aab82f0 0x55673ae96a80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa100e6f60 tx=0x7faa100a90e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c835737db98ff8a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa05ffb640 1 -- 172.21.15.47:0/1905174896 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100d4070 con 0x55673aab82f0 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa05ffb640 1 -- 172.21.15.47:0/1905174896 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7faa1005c170 con 0x55673aab82f0 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1905174896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa100b6890 con 0x55673aab82f0 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.502+0000 7faa05ffb640 1 -- 172.21.15.47:0/1905174896 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faa100c81e0 con 0x55673aab82f0 2024-09-21T01:01:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa2ba0e740 10 client.15738 fetch_fsmap learned FSMap version 19 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1905174896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55673abc5620 con 0x55673aab82f0 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa05ffb640 1 -- 172.21.15.47:0/1905174896 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa100b6890 con 0x55673aab82f0 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa05ffb640 1 -- 172.21.15.47:0/1905174896 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faa100abb40 con 0x55673aab82f0 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa2ba0e740 10 client.15738 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa2ba0e740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa2ba0e740 20 client.15738 populate_metadata read hostname 'smithi047' 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55673aa9fd80 0x55673aea3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa2ba0e740 4 client.15738 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1905174896 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55673adfd640 con 0x55673aa9fd80 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.503+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55673aa9fd80 0x55673aea3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.504+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55673aa9fd80 0x55673aea3d20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1e2d300fd8e4b8a server_cookie=f5ed79579bc2322 in_seq=0 out_seq=0 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.504+0000 7faa05ffb640 10 client.15738 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.504+0000 7faa05ffb640 1 -- 172.21.15.47:0/1905174896 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55673adfd640 con 0x55673aa9fd80 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.504+0000 7faa05ffb640 10 client.15738 handle_command_reply: tid=0 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.504+0000 7faa2ba0e740 1 client.15738 shutdown 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1905174896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aab82f0 msgr2=0x55673ae96a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aab82f0 0x55673ae96a80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa100e6f60 tx=0x7faa100a90e0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1905174896 shutdown_connections 2024-09-21T01:01:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55673aa9fd80 0x55673aea3d20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa05ffb640 0 client.15738 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aae11b0 0x55673ae97c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae97140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1905174896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aab82f0 0x55673ae96a80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1905174896 >> 172.21.15.47:0/1905174896 conn(0x55673aad5300 msgr2=0x55673ae82ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.505+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1905174896 shutdown_connections 2024-09-21T01:01:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.506+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1905174896 wait complete. 2024-09-21T01:01:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.506+0000 7faa2ba0e740 20 client.15738 trim_cache size 0 max 16384 2024-09-21T01:01:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.523+0000 7faa2ba0e740 1 Processor -- start 2024-09-21T01:01:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa2ba0e740 1 -- start start 2024-09-21T01:01:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae91ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae850a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae855e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a6c80 con 0x55673aa9fd80 2024-09-21T01:01:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a9500 con 0x55673aac04d0 2024-09-21T01:01:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a72f0 con 0x55673aab82f0 2024-09-21T01:01:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae91ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae91ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43538/0 (socket says 172.21.15.47:43538) 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1e59c640 1 -- 172.21.15.47:0/1232474582 learned_addr learned my addr 172.21.15.47:0/1232474582 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae850a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1ed9d640 1 --2- 172.21.15.47:0/1232474582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae855e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1e59c640 1 -- 172.21.15.47:0/1232474582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 msgr2=0x55673ae850a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1e59c640 1 --2- 172.21.15.47:0/1232474582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae850a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1e59c640 1 -- 172.21.15.47:0/1232474582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 msgr2=0x55673ae855e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1e59c640 1 --2- 172.21.15.47:0/1232474582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae855e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.524+0000 7faa1e59c640 1 -- 172.21.15.47:0/1232474582 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55673ae9eee0 con 0x55673aa9fd80 2024-09-21T01:01:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.525+0000 7faa1e59c640 1 --2- 172.21.15.47:0/1232474582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae91ac0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faa100a9440 tx=0x7faa100acd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5504c8eb8633f461 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.525+0000 7faa07fff640 1 -- 172.21.15.47:0/1232474582 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100d4050 con 0x55673aa9fd80 2024-09-21T01:01:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.525+0000 7faa07fff640 1 -- 172.21.15.47:0/1232474582 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa100b6890 con 0x55673aa9fd80 2024-09-21T01:01:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.525+0000 7faa07fff640 1 -- 172.21.15.47:0/1232474582 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1005c170 con 0x55673aa9fd80 2024-09-21T01:01:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.526+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1232474582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 msgr2=0x55673ae91ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.526+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1232474582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae91ac0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faa100a9440 tx=0x7faa100acd40 comp rx=0 tx=0).stop 2024-09-21T01:01:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1232474582 shutdown_connections 2024-09-21T01:01:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1232474582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae855e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1232474582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae850a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1232474582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae91ac0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1232474582 >> 172.21.15.47:0/1232474582 conn(0x55673aad5300 msgr2=0x55673ae913b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1232474582 shutdown_connections 2024-09-21T01:01:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1232474582 wait complete. 2024-09-21T01:01:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 -- start start 2024-09-21T01:01:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.527+0000 7faa2ba0e740 1 Processor -- start 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae9b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae9bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa2ba0e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae9c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a79c0 con 0x55673aa9fd80 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a8e30 con 0x55673aac04d0 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa2ba0e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a8090 con 0x55673aab82f0 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa2ba0e740 10 client.0 _ll_register_callbacks cb 0x7faa14009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae9b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa1e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae9b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43552/0 (socket says 172.21.15.47:43552) 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa1e59c640 1 -- 172.21.15.47:0/1828093329 learned_addr learned my addr 172.21.15.47:0/1828093329 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.528+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae9bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa1ed9d640 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae9c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa1dd9b640 1 -- 172.21.15.47:0/1828093329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 msgr2=0x55673ae9c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae9c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa1dd9b640 1 -- 172.21.15.47:0/1828093329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 msgr2=0x55673ae9b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae9b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa1dd9b640 1 -- 172.21.15.47:0/1828093329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55673ae9cf00 con 0x55673aab82f0 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa1dd9b640 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae9bca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa14004700 tx=0x7faa14012ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5596dfe6f2314c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.529+0000 7faa05ffb640 1 -- 172.21.15.47:0/1828093329 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14020a30 con 0x55673aab82f0 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.530+0000 7faa05ffb640 1 -- 172.21.15.47:0/1828093329 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7faa14020bd0 con 0x55673aab82f0 2024-09-21T01:01:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.530+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1828093329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa100b6890 con 0x55673aab82f0 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.530+0000 7faa05ffb640 1 -- 172.21.15.47:0/1828093329 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faa14020dd0 con 0x55673aab82f0 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.530+0000 7faa2ba0e740 10 client.25429 fetch_fsmap learned FSMap version 19 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.530+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1828093329 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55673ae9e260 con 0x55673aab82f0 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.530+0000 7faa05ffb640 1 -- 172.21.15.47:0/1828093329 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa100b6890 con 0x55673aab82f0 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.530+0000 7faa05ffb640 1 -- 172.21.15.47:0/1828093329 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faa1402f020 con 0x55673aab82f0 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.530+0000 7faa2ba0e740 10 client.25429 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.531+0000 7faa2ba0e740 10 client.25429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.531+0000 7faa2ba0e740 20 client.25429 populate_metadata read hostname 'smithi047' 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.531+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55673aae11b0 0x55673af105e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.531+0000 7faa2ba0e740 4 client.25429 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.531+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1828093329 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55673adf90f0 con 0x55673aae11b0 2024-09-21T01:01:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.531+0000 7faa1e59c640 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55673aae11b0 0x55673af105e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.531+0000 7faa05ffb640 10 client.25429 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:32.532+0000 7faa1e59c640 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55673aae11b0 0x55673af105e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84fa8d5326c0a6f0 server_cookie=6814b62d2f376303 in_seq=0 out_seq=0 2024-09-21T01:01:33.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:33 smithi134 ceph-mon[34785]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 48 MiB/s wr, 6.18k op/s 2024-09-21T01:01:33.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:33 smithi114 ceph-mon[34309]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 48 MiB/s wr, 6.18k op/s 2024-09-21T01:01:33.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:33 smithi047 ceph-mon[30960]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 48 MiB/s wr, 6.18k op/s 2024-09-21T01:01:35.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:35 smithi134 ceph-mon[34785]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 MiB/s wr, 6.99k op/s 2024-09-21T01:01:35.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:35 smithi114 ceph-mon[34309]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 MiB/s wr, 6.99k op/s 2024-09-21T01:01:35.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:35 smithi047 ceph-mon[30960]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 MiB/s wr, 6.99k op/s 2024-09-21T01:01:37.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:37 smithi134 ceph-mon[34785]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 43 MiB/s wr, 5.58k op/s 2024-09-21T01:01:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:37 smithi114 ceph-mon[34309]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 43 MiB/s wr, 5.58k op/s 2024-09-21T01:01:37.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:37 smithi047 ceph-mon[30960]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 43 MiB/s wr, 5.58k op/s 2024-09-21T01:01:39.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:39 smithi134 ceph-mon[34785]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 51 MiB/s wr, 6.67k op/s 2024-09-21T01:01:39.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:39 smithi114 ceph-mon[34309]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 51 MiB/s wr, 6.67k op/s 2024-09-21T01:01:39.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:39 smithi047 ceph-mon[30960]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 51 MiB/s wr, 6.67k op/s 2024-09-21T01:01:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:41 smithi134 ceph-mon[34785]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 5.33k op/s 2024-09-21T01:01:41.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:41 smithi114 ceph-mon[34309]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 5.33k op/s 2024-09-21T01:01:41.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:41 smithi047 ceph-mon[30960]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 5.33k op/s 2024-09-21T01:01:43.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:43 smithi134 ceph-mon[34785]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 6.00k op/s 2024-09-21T01:01:43.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:43 smithi114 ceph-mon[34309]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 6.00k op/s 2024-09-21T01:01:43.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:43 smithi047 ceph-mon[30960]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 6.00k op/s 2024-09-21T01:01:45.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:01:45.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:45 smithi134 ceph-mon[34785]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 49 MiB/s wr, 6.41k op/s 2024-09-21T01:01:45.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:45 smithi114 ceph-mon[34309]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 49 MiB/s wr, 6.41k op/s 2024-09-21T01:01:45.414 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:01:45.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:45 smithi047 ceph-mon[30960]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 49 MiB/s wr, 6.41k op/s 2024-09-21T01:01:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/1437774631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bd8108cf0 msgr2=0x7f1bd810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/1437774631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bd8108cf0 0x7f1bd810f520 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009ca0 tx=0x7f1bd002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/1437774631 shutdown_connections 2024-09-21T01:01:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/1437774631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bd8108cf0 0x7f1bd810f520 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/1437774631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd81083a0 0x7f1bd81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/1437774631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd8102a60 0x7f1bd8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/1437774631 >> 172.21.15.47:0/1437774631 conn(0x7f1bd8079730 msgr2=0x7f1bd8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/1437774631 shutdown_connections 2024-09-21T01:01:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.970+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/1437774631 wait complete. 2024-09-21T01:01:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.971+0000 7f1bdfbfd640 1 Processor -- start 2024-09-21T01:01:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.971+0000 7f1bdfbfd640 1 -- start start 2024-09-21T01:01:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdfbfd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bd8102a60 0x7f1bd819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdfbfd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd81083a0 0x7f1bd819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdfbfd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd8108cf0 0x7f1bd819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdfbfd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8112960 con 0x7f1bd8102a60 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdfbfd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd81127e0 con 0x7f1bd81083a0 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdfbfd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8112ae0 con 0x7f1bd8108cf0 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdd198640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd81083a0 0x7f1bd819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdd198640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd81083a0 0x7f1bd819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:40320/0 (socket says 172.21.15.47:40320) 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdd198640 1 -- 172.21.15.47:0/3173402777 learned_addr learned my addr 172.21.15.47:0/3173402777 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:45.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bdd999640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bd8102a60 0x7f1bd819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.972+0000 7f1bde19a640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd8108cf0 0x7f1bd819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bdd198640 1 -- 172.21.15.47:0/3173402777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd8108cf0 msgr2=0x7f1bd819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bdd198640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd8108cf0 0x7f1bd819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bdd198640 1 -- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bd8102a60 msgr2=0x7f1bd819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bdd198640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bd8102a60 0x7f1bd819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bdd198640 1 -- 172.21.15.47:0/3173402777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd81a03e0 con 0x7f1bd81083a0 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bde19a640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd8108cf0 0x7f1bd819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bdd198640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd81083a0 0x7f1bd819aa40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800e9f0 tx=0x7f1bc800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bceffd640 1 -- 172.21.15.47:0/3173402777 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800ccc0 con 0x7f1bd81083a0 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bceffd640 1 -- 172.21.15.47:0/3173402777 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc80054d0 con 0x7f1bd81083a0 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bceffd640 1 -- 172.21.15.47:0/3173402777 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8010430 con 0x7f1bd81083a0 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/3173402777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd81a06d0 con 0x7f1bd81083a0 2024-09-21T01:01:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.973+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/3173402777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd80ff550 con 0x7f1bd81083a0 2024-09-21T01:01:45.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.976+0000 7f1be6171740 1 Processor -- start 2024-09-21T01:01:45.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.976+0000 7f1be6171740 1 -- start start 2024-09-21T01:01:45.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1bceffd640 1 -- 172.21.15.47:0/3173402777 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1bc80046c0 con 0x7f1bd81083a0 2024-09-21T01:01:45.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1be6171740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa103650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1be6171740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa103b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1be6171740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d3b390 0x55d6fa1040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1be6171740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa079e50 con 0x55d6f9d331b0 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1be6171740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa069280 con 0x55d6f9d5c070 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1be6171740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa06d090 con 0x55d6f9d3b390 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1bde19a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa103650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1bde19a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa103650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:40326/0 (socket says 172.21.15.47:40326) 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1bde19a640 1 -- 172.21.15.47:0/1513810361 learned_addr learned my addr 172.21.15.47:0/1513810361 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.977+0000 7f1bdd198640 1 --2- 172.21.15.47:0/1513810361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d3b390 0x55d6fa1040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bde19a640 1 -- 172.21.15.47:0/1513810361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d3b390 msgr2=0x55d6fa1040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bde19a640 1 --2- 172.21.15.47:0/1513810361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d3b390 0x55d6fa1040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bde19a640 1 -- 172.21.15.47:0/1513810361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 msgr2=0x55d6fa103b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bde19a640 1 --2- 172.21.15.47:0/1513810361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa103b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bde19a640 1 -- 172.21.15.47:0/1513810361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f9dc7650 con 0x55d6f9d5c070 2024-09-21T01:01:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bde19a640 1 --2- 172.21.15.47:0/1513810361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa103650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009470 tx=0x7f1bd00094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=790cd3328dc9a882 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bceffd640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1bc40b65c0 0x7f1bc40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bdd999640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1bc40b65c0 0x7f1bc40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bc3fff640 1 -- 172.21.15.47:0/1513810361 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0031cf0 con 0x55d6f9d5c070 2024-09-21T01:01:45.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bceffd640 1 -- 172.21.15.47:0/3173402777 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f1bc80e7550 con 0x7f1bd81083a0 2024-09-21T01:01:45.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bc3fff640 1 -- 172.21.15.47:0/1513810361 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0036040 con 0x55d6f9d5c070 2024-09-21T01:01:45.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.978+0000 7f1bc3fff640 1 -- 172.21.15.47:0/1513810361 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00042a0 con 0x55d6f9d5c070 2024-09-21T01:01:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.979+0000 7f1be6171740 1 -- 172.21.15.47:0/1513810361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 msgr2=0x55d6fa103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.979+0000 7f1be6171740 1 --2- 172.21.15.47:0/1513810361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa103650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009470 tx=0x7f1bd00094a0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.979+0000 7f1bdd999640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1bc40b65c0 0x7f1bc40b8ad0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40095f0 tx=0x7f1bd4012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.979+0000 7f1be6171740 1 -- 172.21.15.47:0/1513810361 shutdown_connections 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.979+0000 7f1be6171740 1 --2- 172.21.15.47:0/1513810361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d3b390 0x55d6fa1040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.979+0000 7f1be6171740 1 --2- 172.21.15.47:0/1513810361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.979+0000 7f1be6171740 1 --2- 172.21.15.47:0/1513810361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa103650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.979+0000 7f1be6171740 1 -- 172.21.15.47:0/1513810361 >> 172.21.15.47:0/1513810361 conn(0x55d6f9d50460 msgr2=0x55d6fa101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.980+0000 7f1be6171740 1 -- 172.21.15.47:0/1513810361 shutdown_connections 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.980+0000 7f1be6171740 1 -- 172.21.15.47:0/1513810361 wait complete. 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.980+0000 7f1be6171740 1 -- start start 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.980+0000 7f1be6171740 1 Processor -- start 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1be6171740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa10ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1be6171740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa10f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1be6171740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d5c070 0x55d6fa11b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1be6171740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d6f9eca700 con 0x55d6f9d331b0 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1be6171740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa004110 con 0x55d6f9d3b390 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1be6171740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa111e70 con 0x55d6f9d5c070 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd999640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa10ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd999640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa10ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44146/0 (socket says 172.21.15.47:44146) 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd999640 1 -- 172.21.15.47:0/2216101409 learned_addr learned my addr 172.21.15.47:0/2216101409 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bde19a640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d5c070 0x55d6fa11b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1be6171740 10 client.0 _ll_register_callbacks cb 0x55d6fa01d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd198640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa10f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd999640 1 -- 172.21.15.47:0/2216101409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d5c070 msgr2=0x55d6fa11b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd999640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d5c070 0x55d6fa11b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd999640 1 -- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 msgr2=0x55d6fa10f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd999640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa10f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd999640 1 -- 172.21.15.47:0/2216101409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6fa031c40 con 0x55d6f9d331b0 2024-09-21T01:01:45.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bde19a640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d5c070 0x55d6fa11b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.981+0000 7f1bdd198640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.982+0000 7f1bdd999640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa10ed90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1bd401cbe0 tx=0x7f1bd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284781ce3c189c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.982+0000 7f1bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.982+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2216101409 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd402a020 con 0x55d6f9d331b0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.982+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2216101409 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f1bd401ab80 con 0x55d6f9d331b0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.982+0000 7f1be6171740 1 -- 172.21.15.47:0/2216101409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd0036040 con 0x55d6f9d331b0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.982+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2216101409 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1bd4022040 con 0x55d6f9d331b0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1be6171740 10 client.15753 fetch_fsmap learned FSMap version 19 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1be6171740 1 -- 172.21.15.47:0/2216101409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d6fa11db80 con 0x55d6f9d331b0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2216101409 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0036040 con 0x55d6f9d331b0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2216101409 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1bd4025030 con 0x55d6f9d331b0 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1be6171740 10 client.15753 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1be6171740 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1be6171740 20 client.15753 populate_metadata read hostname 'smithi047' 2024-09-21T01:01:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1be6171740 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d6f9d1a9f0 0x55d6fa121160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1be6171740 4 client.15753 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:01:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.983+0000 7f1be6171740 1 -- 172.21.15.47:0/2216101409 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6fa07bda0 con 0x55d6f9d1a9f0 2024-09-21T01:01:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.984+0000 7f1bdd198640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d6f9d1a9f0 0x55d6fa121160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.985+0000 7f1bdd198640 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d6f9d1a9f0 0x55d6fa121160 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55b36a7e155ca0ed server_cookie=33e7fccc376c7128 in_seq=0 out_seq=0 2024-09-21T01:01:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.985+0000 7f1bc17fa640 10 client.15753 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.985+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2216101409 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6fa07bda0 con 0x55d6f9d1a9f0 2024-09-21T01:01:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.985+0000 7f1bc17fa640 10 client.15753 handle_command_reply: tid=0 2024-09-21T01:01:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.985+0000 7f1be6171740 1 client.15753 shutdown 2024-09-21T01:01:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 -- 172.21.15.47:0/2216101409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 msgr2=0x55d6fa10ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa10ed90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1bd401cbe0 tx=0x7f1bd4004730 comp rx=0 tx=0).stop 2024-09-21T01:01:45.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 -- 172.21.15.47:0/2216101409 shutdown_connections 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d6f9d1a9f0 0x55d6fa121160 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d5c070 0x55d6fa11b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 --2- 172.21.15.47:0/2216101409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d331b0 0x55d6fa10ed90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1bc17fa640 0 client.15753 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 -- 172.21.15.47:0/2216101409 >> 172.21.15.47:0/2216101409 conn(0x55d6f9d50460 msgr2=0x55d6fa104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 -- 172.21.15.47:0/2216101409 shutdown_connections 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 1 -- 172.21.15.47:0/2216101409 wait complete. 2024-09-21T01:01:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:45.986+0000 7f1be6171740 20 client.15753 trim_cache size 0 max 16384 2024-09-21T01:01:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1be6171740 1 Processor -- start 2024-09-21T01:01:46.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1be6171740 1 -- start start 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1be6171740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa10dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1be6171740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa104d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1be6171740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d5c070 0x55d6fa10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1be6171740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80710e0 con 0x55d6f9d5c070 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1be6171740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80738e0 con 0x55d6f9d3b390 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1be6171740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8071730 con 0x55d6f9d331b0 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1bde19a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d5c070 0x55d6fa10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1bdd198640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1bdd999640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa10dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1bde19a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d5c070 0x55d6fa10bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44152/0 (socket says 172.21.15.47:44152) 2024-09-21T01:01:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.005+0000 7f1bde19a640 1 -- 172.21.15.47:0/3405560313 learned_addr learned my addr 172.21.15.47:0/3405560313 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bdd198640 1 -- 172.21.15.47:0/3405560313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 msgr2=0x55d6fa10dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bdd198640 1 --2- 172.21.15.47:0/3405560313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa10dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bdd198640 1 -- 172.21.15.47:0/3405560313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d5c070 msgr2=0x55d6fa10bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bdd198640 1 --2- 172.21.15.47:0/3405560313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d5c070 0x55d6fa10bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bdd198640 1 -- 172.21.15.47:0/3405560313 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fa109980 con 0x55d6f9d3b390 2024-09-21T01:01:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bdd198640 1 --2- 172.21.15.47:0/3405560313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa104d90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80e5140 tx=0x7f1bc8004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea00a2e1f79d28b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:46.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bc37fe640 1 -- 172.21.15.47:0/3405560313 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80ad550 con 0x55d6f9d3b390 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bc37fe640 1 -- 172.21.15.47:0/3405560313 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc8005680 con 0x55d6f9d3b390 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.006+0000 7f1bc37fe640 1 -- 172.21.15.47:0/3405560313 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80acef0 con 0x55d6f9d3b390 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 -- 172.21.15.47:0/3405560313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 msgr2=0x55d6fa104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 --2- 172.21.15.47:0/3405560313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa104d90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80e5140 tx=0x7f1bc8004a60 comp rx=0 tx=0).stop 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 -- 172.21.15.47:0/3405560313 shutdown_connections 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 --2- 172.21.15.47:0/3405560313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d5c070 0x55d6fa10bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 --2- 172.21.15.47:0/3405560313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d3b390 0x55d6fa104d90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 --2- 172.21.15.47:0/3405560313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa10dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 -- 172.21.15.47:0/3405560313 >> 172.21.15.47:0/3405560313 conn(0x55d6f9d50460 msgr2=0x55d6fa104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 -- 172.21.15.47:0/3405560313 shutdown_connections 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.007+0000 7f1be6171740 1 -- 172.21.15.47:0/3405560313 wait complete. 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 1 -- start start 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 1 Processor -- start 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d3b390 0x55d6fa113530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa113a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8071da0 con 0x55d6f9d3b390 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8073210 con 0x55d6f9d5c070 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8072470 con 0x55d6f9d331b0 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1be6171740 10 client.0 _ll_register_callbacks cb 0x7f1bd401c860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1bdd999640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:46.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1bde19a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1bdd198640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d3b390 0x55d6fa113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1bde19a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:40356/0 (socket says 172.21.15.47:40356) 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1bde19a640 1 -- 172.21.15.47:0/2726758663 learned_addr learned my addr 172.21.15.47:0/2726758663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.008+0000 7f1bdd999640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa112ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:53166/0 (socket says 172.21.15.47:53166) 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bdd198640 1 -- 172.21.15.47:0/2726758663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 msgr2=0x55d6fa112ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bdd198640 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa112ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bdd198640 1 -- 172.21.15.47:0/2726758663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 msgr2=0x55d6fa113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bdd198640 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bdd198640 1 -- 172.21.15.47:0/2726758663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6fa18ab20 con 0x55d6f9d3b390 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bdd999640 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:01:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bdd198640 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d3b390 0x55d6fa113530 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55d6fa121840 tx=0x7f1bc80acef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40c0d9856740f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2726758663 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80ad0d0 con 0x55d6f9d3b390 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1be6171740 1 -- 172.21.15.47:0/2726758663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc8005680 con 0x55d6f9d3b390 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.009+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2726758663 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f1bc80e7310 con 0x55d6f9d3b390 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2726758663 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1bc80b2260 con 0x55d6f9d3b390 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1be6171740 10 client.15759 fetch_fsmap learned FSMap version 19 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1be6171740 1 -- 172.21.15.47:0/2726758663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d6fa18bd10 con 0x55d6f9d3b390 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2726758663 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc8005680 con 0x55d6f9d3b390 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2726758663 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1bc80a90d0 con 0x55d6f9d3b390 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1be6171740 10 client.15759 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:01:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1be6171740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1be6171740 20 client.15759 populate_metadata read hostname 'smithi047' 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1be6171740 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d6f9cefda0 0x55d6fa18e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1be6171740 4 client.15759 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1be6171740 1 -- 172.21.15.47:0/2726758663 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d6fa077850 con 0x55d6f9cefda0 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.010+0000 7f1bdd999640 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d6f9cefda0 0x55d6fa18e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1bc17fa640 10 client.15759 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1bdd999640 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d6f9cefda0 0x55d6fa18e470 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35c476e713a34e39 server_cookie=8b9e558a618cf44b in_seq=0 out_seq=0 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1bc17fa640 1 -- 172.21.15.47:0/2726758663 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55d6fa077850 con 0x55d6f9cefda0 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1bc17fa640 10 client.15759 handle_command_reply: tid=0 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 client.15759 shutdown 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 -- 172.21.15.47:0/2726758663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d3b390 msgr2=0x55d6fa113530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d3b390 0x55d6fa113530 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55d6fa121840 tx=0x7f1bc80acef0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 -- 172.21.15.47:0/2726758663 shutdown_connections 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d6f9cefda0 0x55d6fa18e470 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d6f9d5c070 0x55d6fa113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6f9d3b390 0x55d6fa113530 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 --2- 172.21.15.47:0/2726758663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6f9d331b0 0x55d6fa112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 -- 172.21.15.47:0/2726758663 >> 172.21.15.47:0/2726758663 conn(0x55d6f9d50460 msgr2=0x55d6fa110240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1bc17fa640 0 client.15759 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.011+0000 7f1be6171740 1 -- 172.21.15.47:0/2726758663 shutdown_connections 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1be6171740 1 -- 172.21.15.47:0/2726758663 wait complete. 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1be6171740 20 client.15759 trim_cache size 0 max 16384 2024-09-21T01:01:46.019 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "013c654d-123e-4be3-a479-1be70f6e1569", 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:01:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:01:46.021 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:01:46.022 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:01:46.023 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:01:46.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1bc40b65c0 msgr2=0x7f1bc40b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:46.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1bc40b65c0 0x7f1bc40b8ad0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40095f0 tx=0x7f1bd4012040 comp rx=0 tx=0).stop 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/3173402777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd81083a0 msgr2=0x7f1bd819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd81083a0 0x7f1bd819aa40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800e9f0 tx=0x7f1bc800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/3173402777 shutdown_connections 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f1bc40b65c0 0x7f1bc40b8ad0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd8108cf0 0x7f1bd819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd81083a0 0x7f1bd819aa40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 --2- 172.21.15.47:0/3173402777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1bd8102a60 0x7f1bd819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.012+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/3173402777 >> 172.21.15.47:0/3173402777 conn(0x7f1bd8079730 msgr2=0x7f1bd806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.013+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/3173402777 shutdown_connections 2024-09-21T01:01:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:01:46.013+0000 7f1bdfbfd640 1 -- 172.21.15.47:0/3173402777 wait complete. 2024-09-21T01:01:46.910 INFO:tasks.cephfs.filesystem:scrub status for tag:013c654d-123e-4be3-a479-1be70f6e1569 - {'path': '/', 'tag': '013c654d-123e-4be3-a479-1be70f6e1569', 'options': 'recursive,force'} 2024-09-21T01:01:47.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:47 smithi047 ceph-mon[30960]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 43 MiB/s wr, 5.61k op/s 2024-09-21T01:01:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:47 smithi134 ceph-mon[34785]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 43 MiB/s wr, 5.61k op/s 2024-09-21T01:01:47.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:47 smithi114 ceph-mon[34309]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 43 MiB/s wr, 5.61k op/s 2024-09-21T01:01:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa05ffb640 1 -- 172.21.15.47:0/1828093329 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55673adf90f0 con 0x55673aae11b0 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa05ffb640 10 client.25429 handle_command_reply: tid=0 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 client.25429 shutdown 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1828093329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 msgr2=0x55673ae9bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae9bca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa14004700 tx=0x7faa14012ee0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1828093329 shutdown_connections 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55673aae11b0 0x55673af105e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55673aac04d0 0x55673ae9c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55673aab82f0 0x55673ae9bca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 --2- 172.21.15.47:0/1828093329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55673aa9fd80 0x55673ae9b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa05ffb640 0 client.25429 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1828093329 >> 172.21.15.47:0/1828093329 conn(0x55673aad5300 msgr2=0x55673ae82ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:48.821 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1828093329 shutdown_connections 2024-09-21T01:01:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 1 -- 172.21.15.47:0/1828093329 wait complete. 2024-09-21T01:01:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.819+0000 7faa2ba0e740 20 client.25429 trim_cache size 0 max 16384 2024-09-21T01:01:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:01:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:01:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:01:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 -- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa080b66b0 msgr2=0x7faa080b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa080b66b0 0x7faa080b8bc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa18005e30 tx=0x7faa18031af0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 -- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20101a90 msgr2=0x7faa20199f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20101a90 0x7faa20199f10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faa1000d950 tx=0x7faa1000de10 comp rx=0 tx=0).stop 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 -- 172.21.15.47:0/3866029303 shutdown_connections 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faa080b66b0 0x7faa080b8bc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa20109480 0x7faa2019b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa20106b20 0x7faa2019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 --2- 172.21.15.47:0/3866029303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa20101a90 0x7faa20199f10 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:01:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 -- 172.21.15.47:0/3866029303 >> 172.21.15.47:0/3866029303 conn(0x7faa200fd690 msgr2=0x7faa201078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:01:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 -- 172.21.15.47:0/3866029303 shutdown_connections 2024-09-21T01:01:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:01:48.820+0000 7faa249cc640 1 -- 172.21.15.47:0/3866029303 wait complete. 2024-09-21T01:01:49.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:49 smithi134 ceph-mon[34785]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 51 MiB/s wr, 6.72k op/s 2024-09-21T01:01:49.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:49 smithi114 ceph-mon[34309]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 51 MiB/s wr, 6.72k op/s 2024-09-21T01:01:49.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:49 smithi047 ceph-mon[30960]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 51 MiB/s wr, 6.72k op/s 2024-09-21T01:01:51.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:51 smithi134 ceph-mon[34785]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 42 MiB/s wr, 5.53k op/s 2024-09-21T01:01:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:51 smithi114 ceph-mon[34309]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 42 MiB/s wr, 5.53k op/s 2024-09-21T01:01:51.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:51 smithi047 ceph-mon[30960]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 42 MiB/s wr, 5.53k op/s 2024-09-21T01:01:53.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:53 smithi134 ceph-mon[34785]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 6.41k op/s 2024-09-21T01:01:53.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:53 smithi114 ceph-mon[34309]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 6.41k op/s 2024-09-21T01:01:53.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:53 smithi047 ceph-mon[30960]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 49 MiB/s wr, 6.41k op/s 2024-09-21T01:01:55.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:55 smithi134 ceph-mon[34785]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 5.40k op/s 2024-09-21T01:01:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:55 smithi114 ceph-mon[34309]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 5.40k op/s 2024-09-21T01:01:55.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:55 smithi047 ceph-mon[30960]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 41 MiB/s wr, 5.40k op/s 2024-09-21T01:01:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:57 smithi134 ceph-mon[34785]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 38 MiB/s wr, 5.04k op/s 2024-09-21T01:01:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:57 smithi114 ceph-mon[34309]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 38 MiB/s wr, 5.04k op/s 2024-09-21T01:01:57.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:57 smithi047 ceph-mon[30960]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 38 MiB/s wr, 5.04k op/s 2024-09-21T01:01:58.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:58.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:58.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:01:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:59 smithi134 ceph-mon[34785]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 MiB/s wr, 4.84k op/s 2024-09-21T01:01:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:01:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:01:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:59 smithi114 ceph-mon[34309]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 MiB/s wr, 4.84k op/s 2024-09-21T01:01:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:01:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:01:59.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:59 smithi047 ceph-mon[30960]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 MiB/s wr, 4.84k op/s 2024-09-21T01:01:59.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:01:59.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:01:59.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:01:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:02:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:00 smithi134 ceph-mon[34785]: scrub summary: idle 2024-09-21T01:02:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:00 smithi114 ceph-mon[34309]: scrub summary: idle 2024-09-21T01:02:00.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:00 smithi047 ceph-mon[30960]: scrub summary: idle 2024-09-21T01:02:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:01 smithi134 ceph-mon[34785]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 4.88k op/s 2024-09-21T01:02:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:01 smithi114 ceph-mon[34309]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 4.88k op/s 2024-09-21T01:02:01.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:01 smithi047 ceph-mon[30960]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 4.88k op/s 2024-09-21T01:02:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.926+0000 7f89a3e4d640 1 -- 172.21.15.47:0/965554540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 msgr2=0x7f899c102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.926+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/965554540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 0x7f899c102a10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8998009900 tx=0x7f899802a410 comp rx=0 tx=0).stop 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.926+0000 7f89a3e4d640 1 -- 172.21.15.47:0/965554540 shutdown_connections 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.926+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/965554540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c103fc0 0x7f899c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.926+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/965554540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f899c103620 0x7f899c103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.926+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/965554540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 0x7f899c102a10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.926+0000 7f89a3e4d640 1 -- 172.21.15.47:0/965554540 >> 172.21.15.47:0/965554540 conn(0x7f899c0fdee0 msgr2=0x7f899c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.926+0000 7f89a3e4d640 1 -- 172.21.15.47:0/965554540 shutdown_connections 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 -- 172.21.15.47:0/965554540 wait complete. 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 Processor -- start 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 -- start start 2024-09-21T01:02:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 0x7f899c199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f899c103620 0x7f899c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c103fc0 0x7f899c19b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f899c10e1d0 con 0x7f899c1025a0 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f899c10e050 con 0x7f899c103fc0 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.927+0000 7f89a3e4d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f899c10e350 con 0x7f899c103620 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 0x7f899c199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 0x7f899c199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38642/0 (socket says 172.21.15.47:38642) 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 -- 172.21.15.47:0/1107136254 learned_addr learned my addr 172.21.15.47:0/1107136254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a23ea640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c103fc0 0x7f899c19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a13e8640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f899c103620 0x7f899c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 -- 172.21.15.47:0/1107136254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f899c103620 msgr2=0x7f899c19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f899c103620 0x7f899c19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 -- 172.21.15.47:0/1107136254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c103fc0 msgr2=0x7f899c19b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c103fc0 0x7f899c19b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 -- 172.21.15.47:0/1107136254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c19b970 con 0x7f899c1025a0 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a23ea640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c103fc0 0x7f899c19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a1be9640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 0x7f899c199f30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8998006010 tx=0x7f89980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f8992ffd640 1 -- 172.21.15.47:0/1107136254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899803f030 con 0x7f899c1025a0 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f89a3e4d640 1 -- 172.21.15.47:0/1107136254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c19bc00 con 0x7f899c1025a0 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f8992ffd640 1 -- 172.21.15.47:0/1107136254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8998032e50 con 0x7f899c1025a0 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.928+0000 7f8992ffd640 1 -- 172.21.15.47:0/1107136254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998035070 con 0x7f899c1025a0 2024-09-21T01:02:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.929+0000 7f89a3e4d640 1 -- 172.21.15.47:0/1107136254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c19bf10 con 0x7f899c1025a0 2024-09-21T01:02:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.932+0000 7f89aadc0740 1 Processor -- start 2024-09-21T01:02:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.932+0000 7f89aadc0740 1 -- start start 2024-09-21T01:02:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.932+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264af260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89aadc0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e92641d6f0 con 0x55e9261031b0 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89aadc0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55e92640cb20 con 0x55e9260da2f0 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89aadc0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e926410930 con 0x55e9260e24d0 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a23ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a13e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a23ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38648/0 (socket says 172.21.15.47:38648) 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a23ea640 1 -- 172.21.15.47:0/377418267 learned_addr learned my addr 172.21.15.47:0/377418267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a13e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:37210/0 (socket says 172.21.15.47:37210) 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a13e8640 1 -- 172.21.15.47:0/377418267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 msgr2=0x55e9264af8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a13e8640 1 --2- 172.21.15.47:0/377418267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264af8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a13e8640 1 -- 172.21.15.47:0/377418267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 msgr2=0x55e9264af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a13e8640 1 --2- 172.21.15.47:0/377418267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a13e8640 1 -- 172.21.15.47:0/377418267 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9263d2530 con 0x55e9260e24d0 2024-09-21T01:02:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f8992ffd640 1 -- 172.21.15.47:0/1107136254 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8998042030 con 0x7f899c1025a0 2024-09-21T01:02:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f89a13e8640 1 --2- 172.21.15.47:0/377418267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b0420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f898c009c20 tx=0x7f898c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5784ab072fdfa70a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.933+0000 7f8987fff640 1 -- 172.21.15.47:0/377418267 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c009dd0 con 0x55e9260e24d0 2024-09-21T01:02:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.934+0000 7f8987fff640 1 -- 172.21.15.47:0/377418267 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f898c005020 con 0x55e9260e24d0 2024-09-21T01:02:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.934+0000 7f8987fff640 1 -- 172.21.15.47:0/377418267 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c004b20 con 0x55e9260e24d0 2024-09-21T01:02:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.934+0000 7f8992ffd640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f89880b6510 0x7f89880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.934+0000 7f89a23ea640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f89880b6510 0x7f89880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.934+0000 7f8992ffd640 1 -- 172.21.15.47:0/1107136254 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8998107780 con 0x7f899c1025a0 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.934+0000 7f89aadc0740 1 -- 172.21.15.47:0/377418267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 msgr2=0x55e9264b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 --2- 172.21.15.47:0/377418267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b0420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f898c009c20 tx=0x7f898c011810 comp rx=0 tx=0).stop 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 -- 172.21.15.47:0/377418267 shutdown_connections 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 --2- 172.21.15.47:0/377418267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b0420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 --2- 172.21.15.47:0/377418267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 --2- 172.21.15.47:0/377418267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 -- 172.21.15.47:0/377418267 >> 172.21.15.47:0/377418267 conn(0x55e9260f7300 msgr2=0x55e9264a68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 -- 172.21.15.47:0/377418267 shutdown_connections 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 -- 172.21.15.47:0/377418267 wait complete. 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89a23ea640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f89880b6510 0x7f89880b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8994009fd0 tx=0x7f89940094e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 -- start start 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.935+0000 7f89aadc0740 1 Processor -- start 2024-09-21T01:02:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89aadc0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e926344ab0 con 0x55e9261031b0 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89aadc0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55e9263b2730 con 0x55e9260da2f0 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89aadc0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e9264b0f40 con 0x55e9260e24d0 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a1be9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a1be9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264b8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:54148/0 (socket says 172.21.15.47:54148) 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a23ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a1be9640 1 -- 172.21.15.47:0/4294402836 learned_addr learned my addr 172.21.15.47:0/4294402836 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a13e8640 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89aadc0740 10 client.0 _ll_register_callbacks cb 0x55e9264066b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a1be9640 1 -- 172.21.15.47:0/4294402836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 msgr2=0x55e9264b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a1be9640 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a1be9640 1 -- 172.21.15.47:0/4294402836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 msgr2=0x55e9264b9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.936+0000 7f89a1be9640 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264b9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89a1be9640 1 -- 172.21.15.47:0/4294402836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92616e790 con 0x55e9260da2f0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89a1be9640 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264b8a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8998031440 tx=0x7f89980cd8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d3dd08795943ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89857fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89857fa640 1 -- 172.21.15.47:0/4294402836 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998049040 con 0x55e9260da2f0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89857fa640 1 -- 172.21.15.47:0/4294402836 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f89980d6f40 con 0x55e9260da2f0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89aadc0740 1 -- 172.21.15.47:0/4294402836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f898c005020 con 0x55e9260da2f0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89857fa640 1 -- 172.21.15.47:0/4294402836 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f89980cd570 con 0x55e9260da2f0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89aadc0740 10 client.25442 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89aadc0740 1 -- 172.21.15.47:0/4294402836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e9261e7620 con 0x55e9260da2f0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.937+0000 7f89857fa640 1 -- 172.21.15.47:0/4294402836 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f898c005020 con 0x55e9260da2f0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89857fa640 1 -- 172.21.15.47:0/4294402836 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f899807a080 con 0x55e9260da2f0 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89aadc0740 10 client.25442 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89aadc0740 10 client.25442 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89aadc0740 20 client.25442 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89aadc0740 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e9260c1d80 0x55e9264c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89aadc0740 4 client.25442 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89aadc0740 1 -- 172.21.15.47:0/4294402836 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e92641f640 con 0x55e9260c1d80 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89a13e8640 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e9260c1d80 0x55e9264c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.938+0000 7f89857fa640 10 client.25442 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.939+0000 7f89a13e8640 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e9260c1d80 0x55e9264c6110 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b8e460564f5be11 server_cookie=5d4b668a8d462b7a in_seq=0 out_seq=0 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.939+0000 7f89857fa640 1 -- 172.21.15.47:0/4294402836 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e92641f640 con 0x55e9260c1d80 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.939+0000 7f89857fa640 10 client.25442 handle_command_reply: tid=0 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.939+0000 7f89aadc0740 1 client.25442 shutdown 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.939+0000 7f89aadc0740 1 -- 172.21.15.47:0/4294402836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 msgr2=0x55e9264b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.939+0000 7f89aadc0740 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264b8a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8998031440 tx=0x7f89980cd8f0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.944 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 1 -- 172.21.15.47:0/4294402836 shutdown_connections 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e9260c1d80 0x55e9264c6110 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264b9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 1 --2- 172.21.15.47:0/4294402836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260da2f0 0x55e9264b8a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89857fa640 0 client.25442 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 1 -- 172.21.15.47:0/4294402836 >> 172.21.15.47:0/4294402836 conn(0x55e9260f7300 msgr2=0x55e9264a4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 1 -- 172.21.15.47:0/4294402836 shutdown_connections 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 1 -- 172.21.15.47:0/4294402836 wait complete. 2024-09-21T01:02:01.945 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.940+0000 7f89aadc0740 20 client.25442 trim_cache size 0 max 16384 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89aadc0740 1 Processor -- start 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89aadc0740 1 -- start start 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9260da2f0 0x55e9264a6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9261031b0 0x55e9264a5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89aadc0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1a6bf0 con 0x55e9260da2f0 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89aadc0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1a9470 con 0x55e9261031b0 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89aadc0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1a7260 con 0x55e9260e24d0 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89a1be9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9260da2f0 0x55e9264a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89a1be9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9260da2f0 0x55e9264a6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38668/0 (socket says 172.21.15.47:38668) 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89a1be9640 1 -- 172.21.15.47:0/995961190 learned_addr learned my addr 172.21.15.47:0/995961190 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:01.960 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89a23ea640 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9261031b0 0x55e9264a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.958+0000 7f89a13e8640 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89a1be9640 1 -- 172.21.15.47:0/995961190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 msgr2=0x55e9264a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89a1be9640 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89a1be9640 1 -- 172.21.15.47:0/995961190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9261031b0 msgr2=0x55e9264a5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89a1be9640 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9261031b0 0x55e9264a5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89a1be9640 1 -- 172.21.15.47:0/995961190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9264b9ff0 con 0x55e9260da2f0 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89a13e8640 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89a1be9640 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9260da2f0 0x55e9264a6220 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f89980cacd0 tx=0x7f89980cd960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13793e222bd7b174 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89877fe640 1 -- 172.21.15.47:0/995961190 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998049070 con 0x55e9260da2f0 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89877fe640 1 -- 172.21.15.47:0/995961190 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89980d2490 con 0x55e9260da2f0 2024-09-21T01:02:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.959+0000 7f89877fe640 1 -- 172.21.15.47:0/995961190 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89980cd1d0 con 0x55e9260da2f0 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 -- 172.21.15.47:0/995961190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9260da2f0 msgr2=0x55e9264a6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9260da2f0 0x55e9264a6220 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f89980cacd0 tx=0x7f89980cd960 comp rx=0 tx=0).stop 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 -- 172.21.15.47:0/995961190 shutdown_connections 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9261031b0 0x55e9264a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260e24d0 0x55e9264a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 --2- 172.21.15.47:0/995961190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9260da2f0 0x55e9264a6220 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 -- 172.21.15.47:0/995961190 >> 172.21.15.47:0/995961190 conn(0x55e9260f7300 msgr2=0x55e9264b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 -- 172.21.15.47:0/995961190 shutdown_connections 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 -- 172.21.15.47:0/995961190 wait complete. 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 -- start start 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.960+0000 7f89aadc0740 1 Processor -- start 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260da2f0 0x55e9264c0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.965 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260e24d0 0x55e9264bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89aadc0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264bf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89aadc0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1a7930 con 0x55e9261031b0 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89aadc0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1a8da0 con 0x55e9260e24d0 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89aadc0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1a8000 con 0x55e9260da2f0 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89aadc0740 10 client.0 _ll_register_callbacks cb 0x7f8998005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a23ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a23ea640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264bf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38670/0 (socket says 172.21.15.47:38670) 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a23ea640 1 -- 172.21.15.47:0/2379612433 learned_addr learned my addr 172.21.15.47:0/2379612433 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a13e8640 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260e24d0 0x55e9264bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a1be9640 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260da2f0 0x55e9264c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a23ea640 1 -- 172.21.15.47:0/2379612433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260da2f0 msgr2=0x55e9264c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a23ea640 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260da2f0 0x55e9264c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.966 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a23ea640 1 -- 172.21.15.47:0/2379612433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260e24d0 msgr2=0x55e9264bf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a23ea640 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260e24d0 0x55e9264bf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.961+0000 7f89a23ea640 1 -- 172.21.15.47:0/2379612433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9264bff40 con 0x55e9261031b0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89a23ea640 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264bf900 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8994004270 tx=0x7f8994004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1726afc2fd1ff0c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89857fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89857fa640 1 -- 172.21.15.47:0/2379612433 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899402e060 con 0x55e9261031b0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89857fa640 1 -- 172.21.15.47:0/2379612433 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8994017070 con 0x55e9261031b0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89aadc0740 1 -- 172.21.15.47:0/2379612433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89980d2490 con 0x55e9261031b0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89857fa640 1 -- 172.21.15.47:0/2379612433 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8994010d50 con 0x55e9261031b0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89aadc0740 10 client.15777 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89aadc0740 1 -- 172.21.15.47:0/2379612433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e926530ae0 con 0x55e9261031b0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89857fa640 1 -- 172.21.15.47:0/2379612433 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89980d2490 con 0x55e9261031b0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89857fa640 1 -- 172.21.15.47:0/2379612433 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8994033070 con 0x55e9261031b0 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89aadc0740 10 client.15777 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:01.967 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.962+0000 7f89aadc0740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.963+0000 7f89aadc0740 20 client.15777 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.963+0000 7f89aadc0740 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e9260971c0 0x55e926533420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.963+0000 7f89aadc0740 4 client.15777 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:02:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.963+0000 7f89aadc0740 1 -- 172.21.15.47:0/2379612433 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e92641b0f0 con 0x55e9260971c0 2024-09-21T01:02:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.963+0000 7f89a1be9640 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e9260971c0 0x55e926533420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.963+0000 7f89857fa640 10 client.15777 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:01.968 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:01.963+0000 7f89a1be9640 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e9260971c0 0x55e926533420 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4b47c7c17e33cfc server_cookie=77c6a261c484d96f in_seq=0 out_seq=0 2024-09-21T01:02:03.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:03 smithi134 ceph-mon[34785]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 37 MiB/s wr, 5.54k op/s 2024-09-21T01:02:03.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:03 smithi114 ceph-mon[34309]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 37 MiB/s wr, 5.54k op/s 2024-09-21T01:02:03.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:03 smithi047 ceph-mon[30960]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 37 MiB/s wr, 5.54k op/s 2024-09-21T01:02:05.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:05 smithi134 ceph-mon[34785]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 37 MiB/s wr, 6.04k op/s 2024-09-21T01:02:05.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:05 smithi114 ceph-mon[34309]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 37 MiB/s wr, 6.04k op/s 2024-09-21T01:02:05.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:05 smithi047 ceph-mon[30960]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 37 MiB/s wr, 6.04k op/s 2024-09-21T01:02:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:07 smithi134 ceph-mon[34785]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 39 MiB/s wr, 6.50k op/s 2024-09-21T01:02:07.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:07 smithi114 ceph-mon[34309]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 39 MiB/s wr, 6.50k op/s 2024-09-21T01:02:07.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:07 smithi047 ceph-mon[30960]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 39 MiB/s wr, 6.50k op/s 2024-09-21T01:02:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:09 smithi134 ceph-mon[34785]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 40 MiB/s wr, 7.09k op/s 2024-09-21T01:02:09.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:09 smithi114 ceph-mon[34309]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 40 MiB/s wr, 7.09k op/s 2024-09-21T01:02:09.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:09 smithi047 ceph-mon[30960]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 40 MiB/s wr, 7.09k op/s 2024-09-21T01:02:11.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:11 smithi134 ceph-mon[34785]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 41 MiB/s wr, 7.22k op/s 2024-09-21T01:02:11.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:11 smithi114 ceph-mon[34309]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 41 MiB/s wr, 7.22k op/s 2024-09-21T01:02:11.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:11 smithi047 ceph-mon[30960]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 41 MiB/s wr, 7.22k op/s 2024-09-21T01:02:13.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:13 smithi134 ceph-mon[34785]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 34 MiB/s wr, 6.35k op/s 2024-09-21T01:02:13.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:13 smithi114 ceph-mon[34309]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 34 MiB/s wr, 6.35k op/s 2024-09-21T01:02:13.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:13 smithi047 ceph-mon[30960]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 34 MiB/s wr, 6.35k op/s 2024-09-21T01:02:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:15 smithi134 ceph-mon[34785]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 36 MiB/s wr, 6.43k op/s 2024-09-21T01:02:15.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:15 smithi114 ceph-mon[34309]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 36 MiB/s wr, 6.43k op/s 2024-09-21T01:02:15.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:15 smithi047 ceph-mon[30960]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 36 MiB/s wr, 6.43k op/s 2024-09-21T01:02:16.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:02:17.176 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:02:17.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:17 smithi047 ceph-mon[30960]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 29 MiB/s wr, 5.15k op/s 2024-09-21T01:02:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:17 smithi134 ceph-mon[34785]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 29 MiB/s wr, 5.15k op/s 2024-09-21T01:02:17.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:17 smithi114 ceph-mon[34309]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 29 MiB/s wr, 5.15k op/s 2024-09-21T01:02:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 -- 172.21.15.47:0/1126214965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 msgr2=0x7f7b48110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 --2- 172.21.15.47:0/1126214965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 0x7f7b48110640 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009ca0 tx=0x7f7b4002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 -- 172.21.15.47:0/1126214965 shutdown_connections 2024-09-21T01:02:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 --2- 172.21.15.47:0/1126214965 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 0x7f7b48110640 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 --2- 172.21.15.47:0/1126214965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b481094c0 0x7f7b481098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 --2- 172.21.15.47:0/1126214965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b48103b80 0x7f7b48103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 -- 172.21.15.47:0/1126214965 >> 172.21.15.47:0/1126214965 conn(0x7f7b480ff610 msgr2=0x7f7b48101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 -- 172.21.15.47:0/1126214965 shutdown_connections 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.829+0000 7f7b50112640 1 -- 172.21.15.47:0/1126214965 wait complete. 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b50112640 1 Processor -- start 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b50112640 1 -- start start 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b50112640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b48103b80 0x7f7b4819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b50112640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b481094c0 0x7f7b4819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b50112640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 0x7f7b4819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b50112640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b48113ad0 con 0x7f7b48109e10 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b50112640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7b48113950 con 0x7f7b48103b80 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b50112640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b48113c50 con 0x7f7b481094c0 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4e6af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 0x7f7b4819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4e6af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 0x7f7b4819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45594/0 (socket says 172.21.15.47:45594) 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4e6af640 1 -- 172.21.15.47:0/334176894 learned_addr learned my addr 172.21.15.47:0/334176894 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4deae640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b48103b80 0x7f7b4819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b481094c0 0x7f7b4819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4e6af640 1 -- 172.21.15.47:0/334176894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b481094c0 msgr2=0x7f7b4819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4e6af640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b481094c0 0x7f7b4819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4e6af640 1 -- 172.21.15.47:0/334176894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b48103b80 msgr2=0x7f7b4819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4e6af640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b48103b80 0x7f7b4819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4e6af640 1 -- 172.21.15.47:0/334176894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b481a0450 con 0x7f7b48109e10 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4deae640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b48103b80 0x7f7b4819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.830+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b481094c0 0x7f7b4819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:17.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.831+0000 7f7b4e6af640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 0x7f7b4819fd20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7b40005cc0 tx=0x7f7b40031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.831+0000 7f7b3effd640 1 -- 172.21.15.47:0/334176894 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b40003b70 con 0x7f7b48109e10 2024-09-21T01:02:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.831+0000 7f7b50112640 1 -- 172.21.15.47:0/334176894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b481a06e0 con 0x7f7b48109e10 2024-09-21T01:02:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.831+0000 7f7b3effd640 1 -- 172.21.15.47:0/334176894 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b400318f0 con 0x7f7b48109e10 2024-09-21T01:02:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.831+0000 7f7b3effd640 1 -- 172.21.15.47:0/334176894 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4002f950 con 0x7f7b48109e10 2024-09-21T01:02:17.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.831+0000 7f7b50112640 1 -- 172.21.15.47:0/334176894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b480755f0 con 0x7f7b48109e10 2024-09-21T01:02:17.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b56686740 1 Processor -- start 2024-09-21T01:02:17.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b3effd640 1 -- 172.21.15.47:0/334176894 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7b4002fb50 con 0x7f7b48109e10 2024-09-21T01:02:17.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b56686740 1 -- start start 2024-09-21T01:02:17.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b56686740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4e4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b56686740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b56686740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 0x55da0b4e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b56686740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55da0b45ae50 con 0x55da0b1141b0 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b56686740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55da0b44a280 con 0x55da0b13d070 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.834+0000 7f7b56686740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55da0b44e090 con 0x55da0b11c390 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4e4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:38500/0 (socket says 172.21.15.47:38500) 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4deae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/2470824685 learned_addr learned my addr 172.21.15.47:0/2470824685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/2470824685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 0x55da0b4e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b3effd640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7b340b6510 0x7f7b340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/2470824685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 msgr2=0x55da0b4e50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/2470824685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 0x55da0b4e50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/2470824685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 msgr2=0x55da0b4e4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/2470824685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4e4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/2470824685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da0b1a8650 con 0x55da0b13d070 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4e6af640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7b340b6510 0x7f7b340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b3effd640 1 -- 172.21.15.47:0/334176894 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f7b40108320 con 0x7f7b48109e10 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/2470824685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4e4650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b38011b90 tx=0x7f7b38004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8b0c573b831b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.835+0000 7f7b33fff640 1 -- 172.21.15.47:0/2470824685 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800fc50 con 0x55da0b13d070 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.836+0000 7f7b4e6af640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7b340b6510 0x7f7b340b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097b0 tx=0x7f7b40092c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.836+0000 7f7b33fff640 1 -- 172.21.15.47:0/2470824685 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b3800fdf0 con 0x55da0b13d070 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.836+0000 7f7b33fff640 1 -- 172.21.15.47:0/2470824685 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38005580 con 0x55da0b13d070 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 -- 172.21.15.47:0/2470824685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 msgr2=0x55da0b4e4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 --2- 172.21.15.47:0/2470824685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4e4650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b38011b90 tx=0x7f7b38004730 comp rx=0 tx=0).stop 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 -- 172.21.15.47:0/2470824685 shutdown_connections 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 --2- 172.21.15.47:0/2470824685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 0x55da0b4e50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 --2- 172.21.15.47:0/2470824685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4e4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 --2- 172.21.15.47:0/2470824685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4e4650 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 -- 172.21.15.47:0/2470824685 >> 172.21.15.47:0/2470824685 conn(0x55da0b131460 msgr2=0x55da0b4e2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:17.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 -- 172.21.15.47:0/2470824685 shutdown_connections 2024-09-21T01:02:17.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 -- 172.21.15.47:0/2470824685 wait complete. 2024-09-21T01:02:17.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 -- start start 2024-09-21T01:02:17.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.837+0000 7f7b56686740 1 Processor -- start 2024-09-21T01:02:17.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b56686740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 0x55da0b4efd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b56686740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4f0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b56686740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4fc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b56686740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55da0b2ab700 con 0x55da0b11c390 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b56686740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55da0b3e5110 con 0x55da0b13d070 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b56686740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55da0b4f2e30 con 0x55da0b1141b0 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b56686740 10 client.0 _ll_register_callbacks cb 0x55da0b3fe990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4deae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4deae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4f0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45612/0 (socket says 172.21.15.47:45612) 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4deae640 1 -- 172.21.15.47:0/1424285350 learned_addr learned my addr 172.21.15.47:0/1424285350 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 0x55da0b4efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4fc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4deae640 1 -- 172.21.15.47:0/1424285350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 msgr2=0x55da0b4efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4deae640 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 0x55da0b4efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4deae640 1 -- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 msgr2=0x55da0b4fc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.838+0000 7f7b4deae640 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4fc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b4deae640 1 -- 172.21.15.47:0/1424285350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da0b412c40 con 0x55da0b11c390 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b4deae640 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4f0290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7b44012d20 tx=0x7f7b4400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2741373db81f1bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b317fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b317fa640 1 -- 172.21.15.47:0/1424285350 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44012110 con 0x55da0b11c390 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b317fa640 1 -- 172.21.15.47:0/1424285350 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f7b44004050 con 0x55da0b11c390 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b56686740 1 -- 172.21.15.47:0/1424285350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b3800fdf0 con 0x55da0b11c390 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b317fa640 1 -- 172.21.15.47:0/1424285350 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7b440122b0 con 0x55da0b11c390 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b56686740 10 client.15789 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b56686740 1 -- 172.21.15.47:0/1424285350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55da0b4feb80 con 0x55da0b11c390 2024-09-21T01:02:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.839+0000 7f7b317fa640 1 -- 172.21.15.47:0/1424285350 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b3800fdf0 con 0x55da0b11c390 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b317fa640 1 -- 172.21.15.47:0/1424285350 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7b44010430 con 0x55da0b11c390 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b56686740 10 client.15789 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b56686740 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b56686740 20 client.15789 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b56686740 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55da0b0fb9f0 0x55da0b5020c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b56686740 4 client.15789 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b56686740 1 -- 172.21.15.47:0/1424285350 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da0b45cda0 con 0x55da0b0fb9f0 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55da0b0fb9f0 0x55da0b5020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b317fa640 10 client.15789 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.840+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55da0b0fb9f0 0x55da0b5020c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22ae7586cc927340 server_cookie=cb30670c80bbcb2 in_seq=0 out_seq=0 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.842+0000 7f7b317fa640 1 -- 172.21.15.47:0/1424285350 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da0b45cda0 con 0x55da0b0fb9f0 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.842+0000 7f7b317fa640 10 client.15789 handle_command_reply: tid=0 2024-09-21T01:02:17.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.842+0000 7f7b56686740 1 client.15789 shutdown 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.842+0000 7f7b56686740 1 -- 172.21.15.47:0/1424285350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 msgr2=0x55da0b4f0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4f0290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7b44012d20 tx=0x7f7b4400f790 comp rx=0 tx=0).stop 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 -- 172.21.15.47:0/1424285350 shutdown_connections 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55da0b0fb9f0 0x55da0b5020c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b13d070 0x55da0b4fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4f0290 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 --2- 172.21.15.47:0/1424285350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 0x55da0b4efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b317fa640 0 client.15789 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 -- 172.21.15.47:0/1424285350 >> 172.21.15.47:0/1424285350 conn(0x55da0b131460 msgr2=0x55da0b4e7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 -- 172.21.15.47:0/1424285350 shutdown_connections 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 1 -- 172.21.15.47:0/1424285350 wait complete. 2024-09-21T01:02:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.843+0000 7f7b56686740 20 client.15789 trim_cache size 0 max 16384 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b56686740 1 Processor -- start 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b56686740 1 -- start start 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b56686740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b56686740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 0x55da0b4fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b56686740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b56686740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b481af3e0 con 0x55da0b11c390 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b56686740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7b481b1c60 con 0x55da0b0fb9f0 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b56686740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b481afa50 con 0x55da0b1141b0 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4d6ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4d6ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4ecf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45614/0 (socket says 172.21.15.47:45614) 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/586703326 learned_addr learned my addr 172.21.15.47:0/586703326 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4deae640 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 0x55da0b4fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/586703326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 msgr2=0x55da0b4fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 0x55da0b4fc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/586703326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 msgr2=0x55da0b4f0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.864+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.865+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/586703326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da0b4eecb0 con 0x55da0b11c390 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.865+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4ecf40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7b38010010 tx=0x7f7b38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a3dee82673bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.865+0000 7f7b337fe640 1 -- 172.21.15.47:0/586703326 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38000e60 con 0x55da0b11c390 2024-09-21T01:02:17.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.865+0000 7f7b337fe640 1 -- 172.21.15.47:0/586703326 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b38004500 con 0x55da0b11c390 2024-09-21T01:02:17.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.865+0000 7f7b337fe640 1 -- 172.21.15.47:0/586703326 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3802d040 con 0x55da0b11c390 2024-09-21T01:02:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 -- 172.21.15.47:0/586703326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 msgr2=0x55da0b4ecf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4ecf40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7b38010010 tx=0x7f7b38004730 comp rx=0 tx=0).stop 2024-09-21T01:02:17.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 -- 172.21.15.47:0/586703326 shutdown_connections 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b11c390 0x55da0b4ecf40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b1141b0 0x55da0b4fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 --2- 172.21.15.47:0/586703326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 -- 172.21.15.47:0/586703326 >> 172.21.15.47:0/586703326 conn(0x55da0b131460 msgr2=0x55da0b4efb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 -- 172.21.15.47:0/586703326 shutdown_connections 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 -- 172.21.15.47:0/586703326 wait complete. 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 -- start start 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.866+0000 7f7b56686740 1 Processor -- start 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b56686740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b56686740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4f4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b56686740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 0x55da0b56bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b56686740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b481b0120 con 0x55da0b1141b0 2024-09-21T01:02:17.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b56686740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7b481b1590 con 0x55da0b0fb9f0 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b56686740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b481b07f0 con 0x55da0b11c390 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b56686740 10 client.0 _ll_register_callbacks cb 0x7f7b44009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b4d6ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b4deae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b4d6ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:38528/0 (socket says 172.21.15.47:38528) 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/4073993394 learned_addr learned my addr 172.21.15.47:0/4073993394 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 0x55da0b56bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/4073993394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 msgr2=0x55da0b56bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.867+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 0x55da0b56bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/4073993394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 msgr2=0x55da0b4f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:17.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4f4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b4d6ad640 1 -- 172.21.15.47:0/4073993394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da0b56c000 con 0x55da0b0fb9f0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b4deae640 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b4d6ad640 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f4410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b38011540 tx=0x7f7b380096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b138e95b59f0b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b317fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b317fa640 1 -- 172.21.15.47:0/4073993394 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38005380 con 0x55da0b0fb9f0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b317fa640 1 -- 172.21.15.47:0/4073993394 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f7b38005520 con 0x55da0b0fb9f0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b56686740 1 -- 172.21.15.47:0/4073993394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55da0b458850 con 0x55da0b0fb9f0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b317fa640 1 -- 172.21.15.47:0/4073993394 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7b38004920 con 0x55da0b0fb9f0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b56686740 10 client.25463 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b56686740 1 -- 172.21.15.47:0/4073993394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55da0b56d100 con 0x55da0b0fb9f0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.868+0000 7f7b317fa640 1 -- 172.21.15.47:0/4073993394 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55da0b458850 con 0x55da0b0fb9f0 2024-09-21T01:02:17.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b317fa640 1 -- 172.21.15.47:0/4073993394 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7b3801d020 con 0x55da0b0fb9f0 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b56686740 10 client.25463 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b56686740 10 client.25463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b56686740 20 client.25463 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b56686740 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55da0b13d070 0x55da0b56f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b56686740 4 client.25463 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b56686740 1 -- 172.21.15.47:0/4073993394 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55da0b455c80 con 0x55da0b13d070 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b4deae640 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55da0b13d070 0x55da0b56f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b317fa640 10 client.25463 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.869+0000 7f7b4deae640 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55da0b13d070 0x55da0b56f640 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=933d446ae9bbaf8 server_cookie=f2e91683fde9d975 in_seq=0 out_seq=0 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b317fa640 1 -- 172.21.15.47:0/4073993394 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55da0b455c80 con 0x55da0b13d070 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b317fa640 10 client.25463 handle_command_reply: tid=0 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 client.25463 shutdown 2024-09-21T01:02:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 -- 172.21.15.47:0/4073993394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 msgr2=0x55da0b4f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f4410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b38011540 tx=0x7f7b380096a0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 -- 172.21.15.47:0/4073993394 shutdown_connections 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55da0b13d070 0x55da0b56f640 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55da0b11c390 0x55da0b56bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da0b1141b0 0x55da0b4f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 --2- 172.21.15.47:0/4073993394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55da0b0fb9f0 0x55da0b4f4410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b317fa640 0 client.25463 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 -- 172.21.15.47:0/4073993394 >> 172.21.15.47:0/4073993394 conn(0x55da0b131460 msgr2=0x55da0b4e5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.870+0000 7f7b56686740 1 -- 172.21.15.47:0/4073993394 shutdown_connections 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.871+0000 7f7b56686740 1 -- 172.21.15.47:0/4073993394 wait complete. 2024-09-21T01:02:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.871+0000 7f7b56686740 20 client.25463 trim_cache size 0 max 16384 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:17.877 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:02:17.878 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:17.879 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:17.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:02:17.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:02:17.880 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:02:17.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 -- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7b340b6510 msgr2=0x7f7b340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7b340b6510 0x7f7b340b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097b0 tx=0x7f7b40092c40 comp rx=0 tx=0).stop 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 -- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 msgr2=0x7f7b4819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 0x7f7b4819fd20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7b40005cc0 tx=0x7f7b40031700 comp rx=0 tx=0).stop 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 -- 172.21.15.47:0/334176894 shutdown_connections 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7b340b6510 0x7f7b340b8a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b48109e10 0x7f7b4819fd20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b481094c0 0x7f7b4819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 --2- 172.21.15.47:0/334176894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b48103b80 0x7f7b4819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 -- 172.21.15.47:0/334176894 >> 172.21.15.47:0/334176894 conn(0x7f7b480ff610 msgr2=0x7f7b48107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 -- 172.21.15.47:0/334176894 shutdown_connections 2024-09-21T01:02:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:17.872+0000 7f7b50112640 1 -- 172.21.15.47:0/334176894 wait complete. 2024-09-21T01:02:18.784 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:02:18.785 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:02:19.045 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:02:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:19 smithi114 ceph-mon[34309]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 34 MiB/s wr, 5.84k op/s 2024-09-21T01:02:19.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:19 smithi047 ceph-mon[30960]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 34 MiB/s wr, 5.84k op/s 2024-09-21T01:02:19.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:19 smithi134 ceph-mon[34785]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 34 MiB/s wr, 5.84k op/s 2024-09-21T01:02:19.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 -- 172.21.15.47:0/3320784334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c1094b0 msgr2=0x7fdb5c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 --2- 172.21.15.47:0/3320784334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c1094b0 0x7fdb5c1098c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009900 tx=0x7fdb4402a410 comp rx=0 tx=0).stop 2024-09-21T01:02:19.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 -- 172.21.15.47:0/3320784334 shutdown_connections 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 --2- 172.21.15.47:0/3320784334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb5c109e00 0x7fdb5c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 --2- 172.21.15.47:0/3320784334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c1094b0 0x7fdb5c1098c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 --2- 172.21.15.47:0/3320784334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c103bc0 0x7fdb5c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 -- 172.21.15.47:0/3320784334 >> 172.21.15.47:0/3320784334 conn(0x7fdb5c07b910 msgr2=0x7fdb5c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 -- 172.21.15.47:0/3320784334 shutdown_connections 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.729+0000 7fdb6312c640 1 -- 172.21.15.47:0/3320784334 wait complete. 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.730+0000 7fdb6312c640 1 Processor -- start 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.730+0000 7fdb6312c640 1 -- start start 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb6312c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c103bc0 0x7fdb5c19c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb6312c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb5c1094b0 0x7fdb5c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb6312c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c109e00 0x7fdb5c1a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:19.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb6312c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c113ac0 con 0x7fdb5c109e00 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb6312c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c113940 con 0x7fdb5c103bc0 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb6312c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c113c40 con 0x7fdb5c1094b0 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c103bc0 0x7fdb5c19c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb616c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c109e00 0x7fdb5c1a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c103bc0 0x7fdb5c19c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:38534/0 (socket says 172.21.15.47:38534) 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 -- 172.21.15.47:0/784847019 learned_addr learned my addr 172.21.15.47:0/784847019 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb5bfff640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb5c1094b0 0x7fdb5c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 -- 172.21.15.47:0/784847019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb5c1094b0 msgr2=0x7fdb5c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb5c1094b0 0x7fdb5c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 -- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c109e00 msgr2=0x7fdb5c1a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c109e00 0x7fdb5c1a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 -- 172.21.15.47:0/784847019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c1a2600 con 0x7fdb5c103bc0 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb616c9640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c109e00 0x7fdb5c1a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.731+0000 7fdb60ec8640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c103bc0 0x7fdb5c19c690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00eab0 tx=0x7fdb4c00ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.732+0000 7fdb59ffb640 1 -- 172.21.15.47:0/784847019 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00ce40 con 0x7fdb5c103bc0 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.732+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c1a28f0 con 0x7fdb5c103bc0 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.732+0000 7fdb59ffb640 1 -- 172.21.15.47:0/784847019 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb4c011920 con 0x7fdb5c103bc0 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.732+0000 7fdb59ffb640 1 -- 172.21.15.47:0/784847019 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c010a30 con 0x7fdb5c103bc0 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.732+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c1a9050 con 0x7fdb5c103bc0 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.733+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c103fd0 con 0x7fdb5c103bc0 2024-09-21T01:02:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.734+0000 7fdb59ffb640 1 -- 172.21.15.47:0/784847019 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdb4c010bd0 con 0x7fdb5c103bc0 2024-09-21T01:02:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.735+0000 7fdb59ffb640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb480b6510 0x7fdb480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.735+0000 7fdb5bfff640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb480b6510 0x7fdb480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.735+0000 7fdb59ffb640 1 -- 172.21.15.47:0/784847019 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fdb4c0e77d0 con 0x7fdb5c103bc0 2024-09-21T01:02:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.736+0000 7fdb5bfff640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb480b6510 0x7fdb480b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009230 tx=0x7fdb44031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.739+0000 7fdb59ffb640 1 -- 172.21.15.47:0/784847019 <== mon.2 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb4c016030 con 0x7fdb5c103bc0 2024-09-21T01:02:19.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.972+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb5c19d7c0 con 0x7fdb5c103bc0 2024-09-21T01:02:19.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.973+0000 7fdb59ffb640 1 -- 172.21.15.47:0/784847019 <== mon.2 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7fdb4c0ae0e0 con 0x7fdb5c103bc0 2024-09-21T01:02:19.974 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:02:19.974 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:02:19.974 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T01:02:19.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb480b6510 msgr2=0x7fdb480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb480b6510 0x7fdb480b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009230 tx=0x7fdb44031400 comp rx=0 tx=0).stop 2024-09-21T01:02:19.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c103bc0 msgr2=0x7fdb5c19c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:19.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c103bc0 0x7fdb5c19c690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00eab0 tx=0x7fdb4c00ef70 comp rx=0 tx=0).stop 2024-09-21T01:02:19.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 shutdown_connections 2024-09-21T01:02:19.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdb480b6510 0x7fdb480b8a20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb5c109e00 0x7fdb5c1a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb5c1094b0 0x7fdb5c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 --2- 172.21.15.47:0/784847019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c103bc0 0x7fdb5c19c690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:19.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 >> 172.21.15.47:0/784847019 conn(0x7fdb5c07b910 msgr2=0x7fdb5c105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:19.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 shutdown_connections 2024-09-21T01:02:19.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:19.975+0000 7fdb6312c640 1 -- 172.21.15.47:0/784847019 wait complete. 2024-09-21T01:02:20.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:20 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/784847019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:02:20.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:20 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/784847019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:02:20.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:20 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/784847019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:02:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:21 smithi114 ceph-mon[34309]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 30 MiB/s wr, 5.00k op/s 2024-09-21T01:02:21.409 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:21 smithi047 ceph-mon[30960]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 30 MiB/s wr, 5.00k op/s 2024-09-21T01:02:21.440 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:02:21.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:21 smithi134 ceph-mon[34785]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 30 MiB/s wr, 5.00k op/s 2024-09-21T01:02:21.733 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.568+0000 7f7900bb8640 1 -- 172.21.15.47:0/137817843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc1083a0 msgr2=0x7f78fc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.568+0000 7f7900bb8640 1 --2- 172.21.15.47:0/137817843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc1083a0 0x7f78fc1087b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009900 tx=0x7f78f002a410 comp rx=0 tx=0).stop 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.568+0000 7f7900bb8640 1 -- 172.21.15.47:0/137817843 shutdown_connections 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.568+0000 7f7900bb8640 1 --2- 172.21.15.47:0/137817843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc108cf0 0x7f78fc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.568+0000 7f7900bb8640 1 --2- 172.21.15.47:0/137817843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc1083a0 0x7f78fc1087b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.568+0000 7f7900bb8640 1 --2- 172.21.15.47:0/137817843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc102a60 0x7f78fc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.568+0000 7f7900bb8640 1 -- 172.21.15.47:0/137817843 >> 172.21.15.47:0/137817843 conn(0x7f78fc079730 msgr2=0x7f78fc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.568+0000 7f7900bb8640 1 -- 172.21.15.47:0/137817843 shutdown_connections 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.569+0000 7f7900bb8640 1 -- 172.21.15.47:0/137817843 wait complete. 2024-09-21T01:02:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.569+0000 7f7900bb8640 1 Processor -- start 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.569+0000 7f7900bb8640 1 -- start start 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f7900bb8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc102a60 0x7f78fc19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f7900bb8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc1083a0 0x7f78fc19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f7900bb8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc108cf0 0x7f78fc19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f7900bb8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc112960 con 0x7f78fc102a60 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f7900bb8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1127e0 con 0x7f78fc1083a0 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f7900bb8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc112ae0 con 0x7f78fc108cf0 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc102a60 0x7f78fc19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc102a60 0x7f78fc19b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48940/0 (socket says 172.21.15.47:48940) 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 -- 172.21.15.47:0/232328282 learned_addr learned my addr 172.21.15.47:0/232328282 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc1083a0 0x7f78fc19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fad9d640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc108cf0 0x7f78fc19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 -- 172.21.15.47:0/232328282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc108cf0 msgr2=0x7f78fc19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc108cf0 0x7f78fc19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 -- 172.21.15.47:0/232328282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc1083a0 msgr2=0x7f78fc19b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc1083a0 0x7f78fc19b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 -- 172.21.15.47:0/232328282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc1a6560 con 0x7f78fc102a60 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fad9d640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc108cf0 0x7f78fc19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc1083a0 0x7f78fc19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.570+0000 7f78fa59c640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc102a60 0x7f78fc19b250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00e9f0 tx=0x7f78ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.571+0000 7f78eb7fe640 1 -- 172.21.15.47:0/232328282 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00cd80 con 0x7f78fc102a60 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.571+0000 7f78eb7fe640 1 -- 172.21.15.47:0/232328282 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78ec0054d0 con 0x7f78fc102a60 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.571+0000 7f7900bb8640 1 -- 172.21.15.47:0/232328282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78fc1a6850 con 0x7f78fc102a60 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.571+0000 7f78eb7fe640 1 -- 172.21.15.47:0/232328282 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec010690 con 0x7f78fc102a60 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.571+0000 7f7900bb8640 1 -- 172.21.15.47:0/232328282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78fc1a6d10 con 0x7f78fc102a60 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.573+0000 7f790712c740 1 Processor -- start 2024-09-21T01:02:22.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f790712c740 1 -- start start 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78eb7fe640 1 -- 172.21.15.47:0/232328282 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f78ec004e90 con 0x7f78fc102a60 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f790712c740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f5d070 0x55f2b63046a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f790712c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 0x55f2b6304be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f790712c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f3c390 0x55f2b6305120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f790712c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f2b627aea0 con 0x55f2b5f3c390 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f790712c740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f2b626a2d0 con 0x55f2b5f5d070 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f790712c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f2b626e0e0 con 0x55f2b5f341b0 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f5d070 0x55f2b63046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78f9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f3c390 0x55f2b6305120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 0x55f2b6304be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f5d070 0x55f2b63046a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:40380/0 (socket says 172.21.15.47:40380) 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fad9d640 1 -- 172.21.15.47:0/2312219673 learned_addr learned my addr 172.21.15.47:0/2312219673 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fad9d640 1 -- 172.21.15.47:0/2312219673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 msgr2=0x55f2b6304be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fad9d640 1 --2- 172.21.15.47:0/2312219673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 0x55f2b6304be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fad9d640 1 -- 172.21.15.47:0/2312219673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f3c390 msgr2=0x55f2b6305120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fad9d640 1 --2- 172.21.15.47:0/2312219673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f3c390 0x55f2b6305120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78fad9d640 1 -- 172.21.15.47:0/2312219673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b5fc8650 con 0x55f2b5f5d070 2024-09-21T01:02:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.574+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/2312219673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f3c390 0x55f2b6305120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.575+0000 7f78fad9d640 1 --2- 172.21.15.47:0/2312219673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f5d070 0x55f2b63046a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f78f4010450 tx=0x7f78f4010910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729c69472b3376 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.627 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.575+0000 7f78eb7fe640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78e40b6510 0x7f78e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.575+0000 7f78e8ff9640 1 -- 172.21.15.47:0/2312219673 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4017070 con 0x55f2b5f5d070 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.575+0000 7f78fa59c640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78e40b6510 0x7f78e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.575+0000 7f78e8ff9640 1 -- 172.21.15.47:0/2312219673 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f4011c10 con 0x55f2b5f5d070 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.575+0000 7f78e8ff9640 1 -- 172.21.15.47:0/2312219673 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f401bc30 con 0x55f2b5f5d070 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.575+0000 7f78eb7fe640 1 -- 172.21.15.47:0/232328282 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f78ec0e7700 con 0x7f78fc102a60 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 -- 172.21.15.47:0/2312219673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f5d070 msgr2=0x55f2b63046a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 --2- 172.21.15.47:0/2312219673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f5d070 0x55f2b63046a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f78f4010450 tx=0x7f78f4010910 comp rx=0 tx=0).stop 2024-09-21T01:02:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f78fa59c640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78e40b6510 0x7f78e40b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00c6a0 tx=0x7f78ec0ed530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 -- 172.21.15.47:0/2312219673 shutdown_connections 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 --2- 172.21.15.47:0/2312219673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f3c390 0x55f2b6305120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 --2- 172.21.15.47:0/2312219673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 0x55f2b6304be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 --2- 172.21.15.47:0/2312219673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f5d070 0x55f2b63046a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 -- 172.21.15.47:0/2312219673 >> 172.21.15.47:0/2312219673 conn(0x55f2b5f51460 msgr2=0x55f2b6302590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 -- 172.21.15.47:0/2312219673 shutdown_connections 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 -- 172.21.15.47:0/2312219673 wait complete. 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.576+0000 7f790712c740 1 -- start start 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f790712c740 1 Processor -- start 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f790712c740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b630fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f790712c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6310230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f790712c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b631c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f790712c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f2b60cb700 con 0x55f2b5f5d070 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f790712c740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f2b6205160 con 0x55f2b5f341b0 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f790712c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f2b6312e80 con 0x55f2b5f3c390 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f790712c740 10 client.0 _ll_register_callbacks cb 0x55f2b621e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b630fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f78f9d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6310230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b630fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:40392/0 (socket says 172.21.15.47:40392) 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f78fad9d640 1 -- 172.21.15.47:0/1436193127 learned_addr learned my addr 172.21.15.47:0/1436193127 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f78fad9d640 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b631c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f78f9d9b640 1 -- 172.21.15.47:0/1436193127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 msgr2=0x55f2b630fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b630fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.577+0000 7f78f9d9b640 1 -- 172.21.15.47:0/1436193127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 msgr2=0x55f2b631c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b631c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f78f9d9b640 1 -- 172.21.15.47:0/1436193127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b6232c90 con 0x55f2b5f3c390 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6310230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78f0006010 tx=0x7f78f0031740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a133cdf21d1617 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f78e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f78e1ffb640 1 -- 172.21.15.47:0/1436193127 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0035040 con 0x55f2b5f3c390 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f78e1ffb640 1 -- 172.21.15.47:0/1436193127 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f78f0004040 con 0x55f2b5f3c390 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f790712c740 1 -- 172.21.15.47:0/1436193127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f4011c10 con 0x55f2b5f3c390 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f78e1ffb640 1 -- 172.21.15.47:0/1436193127 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f78f0004240 con 0x55f2b5f3c390 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f790712c740 10 client.25501 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f790712c740 1 -- 172.21.15.47:0/1436193127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f2b631eb60 con 0x55f2b5f3c390 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.578+0000 7f78e1ffb640 1 -- 172.21.15.47:0/1436193127 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f4011c10 con 0x55f2b5f3c390 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f78e1ffb640 1 -- 172.21.15.47:0/1436193127 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f78f0004a40 con 0x55f2b5f3c390 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f790712c740 10 client.25501 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f790712c740 10 client.25501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f790712c740 20 client.25501 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f790712c740 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2b5f1b9f0 0x55f2b6322060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f790712c740 4 client.25501 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f790712c740 1 -- 172.21.15.47:0/1436193127 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2b627cdf0 con 0x55f2b5f1b9f0 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f78fad9d640 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2b5f1b9f0 0x55f2b6322060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f78fad9d640 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2b5f1b9f0 0x55f2b6322060 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4b5c57fc0b115f server_cookie=268e5eb7ffa03409 in_seq=0 out_seq=0 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.579+0000 7f78e1ffb640 10 client.25501 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f78e1ffb640 1 -- 172.21.15.47:0/1436193127 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2b627cdf0 con 0x55f2b5f1b9f0 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f78e1ffb640 10 client.25501 handle_command_reply: tid=0 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 client.25501 shutdown 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 -- 172.21.15.47:0/1436193127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 msgr2=0x55f2b6310230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6310230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78f0006010 tx=0x7f78f0031740 comp rx=0 tx=0).stop 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 -- 172.21.15.47:0/1436193127 shutdown_connections 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2b5f1b9f0 0x55f2b6322060 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b631c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6310230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f78e1ffb640 0 client.25501 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 --2- 172.21.15.47:0/1436193127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b630fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 -- 172.21.15.47:0/1436193127 >> 172.21.15.47:0/1436193127 conn(0x55f2b5f51460 msgr2=0x55f2b6307830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 -- 172.21.15.47:0/1436193127 shutdown_connections 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 1 -- 172.21.15.47:0/1436193127 wait complete. 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.580+0000 7f790712c740 20 client.25501 trim_cache size 0 max 16384 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.594+0000 7f790712c740 1 Processor -- start 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.594+0000 7f790712c740 1 -- start start 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.594+0000 7f790712c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 0x55f2b63025c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.594+0000 7f790712c740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f3c390 0x55f2b631c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.594+0000 7f790712c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b630cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.594+0000 7f790712c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1ad1c0 con 0x55f2b5f5d070 2024-09-21T01:02:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.594+0000 7f790712c740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1afa00 con 0x55f2b5f3c390 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.594+0000 7f790712c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1ad810 con 0x55f2b5f341b0 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b630cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b630cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48954/0 (socket says 172.21.15.47:48954) 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78f9d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f3c390 0x55f2b631c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 -- 172.21.15.47:0/1991781084 learned_addr learned my addr 172.21.15.47:0/1991781084 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 0x55f2b63025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 -- 172.21.15.47:0/1991781084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 msgr2=0x55f2b63025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 0x55f2b63025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 -- 172.21.15.47:0/1991781084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f3c390 msgr2=0x55f2b631c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f3c390 0x55f2b631c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 -- 172.21.15.47:0/1991781084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2b630e1f0 con 0x55f2b5f5d070 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f3c390 0x55f2b631c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78fad9d640 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b630cee0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f78f4010f10 tx=0x7f78f4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f8f9edd9dfcc8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78e3fff640 1 -- 172.21.15.47:0/1991781084 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4017040 con 0x55f2b5f5d070 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78e3fff640 1 -- 172.21.15.47:0/1991781084 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f4011560 con 0x55f2b5f5d070 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.595+0000 7f78e3fff640 1 -- 172.21.15.47:0/1991781084 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f40296a0 con 0x55f2b5f5d070 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 -- 172.21.15.47:0/1991781084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 msgr2=0x55f2b630cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b630cee0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f78f4010f10 tx=0x7f78f4009500 comp rx=0 tx=0).stop 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 -- 172.21.15.47:0/1991781084 shutdown_connections 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b630cee0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f3c390 0x55f2b631c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 --2- 172.21.15.47:0/1991781084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f341b0 0x55f2b63025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 -- 172.21.15.47:0/1991781084 >> 172.21.15.47:0/1991781084 conn(0x55f2b5f51460 msgr2=0x55f2b6301eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 -- 172.21.15.47:0/1991781084 shutdown_connections 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.596+0000 7f790712c740 1 -- 172.21.15.47:0/1991781084 wait complete. 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 1 -- start start 2024-09-21T01:02:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 1 Processor -- start 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b63140c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6314600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b6314b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1adec0 con 0x55f2b5f5d070 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1af330 con 0x55f2b5f341b0 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1ae590 con 0x55f2b5f3c390 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f790712c740 10 client.0 _ll_register_callbacks cb 0x7f78f0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b63140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b6314b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f78f9d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6314600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b6314b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48970/0 (socket says 172.21.15.47:48970) 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.597+0000 7f78fad9d640 1 -- 172.21.15.47:0/2542965546 learned_addr learned my addr 172.21.15.47:0/2542965546 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78fad9d640 1 -- 172.21.15.47:0/2542965546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 msgr2=0x55f2b6314600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78fad9d640 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6314600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78fad9d640 1 -- 172.21.15.47:0/2542965546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 msgr2=0x55f2b63140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78fad9d640 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b63140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78fad9d640 1 -- 172.21.15.47:0/2542965546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2b638ba20 con 0x55f2b5f5d070 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78fad9d640 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b6314b40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55f2b63125b0 tx=0x7f78f4009db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa840a01fb7f3be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78e1ffb640 1 -- 172.21.15.47:0/2542965546 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4017070 con 0x55f2b5f5d070 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78e1ffb640 1 -- 172.21.15.47:0/2542965546 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f78f401bcf0 con 0x55f2b5f5d070 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f790712c740 1 -- 172.21.15.47:0/2542965546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f4011560 con 0x55f2b5f5d070 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f78e1ffb640 1 -- 172.21.15.47:0/2542965546 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f78f4037040 con 0x55f2b5f5d070 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f790712c740 10 client.15819 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.598+0000 7f790712c740 1 -- 172.21.15.47:0/2542965546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f2b638cc80 con 0x55f2b5f5d070 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f78e1ffb640 1 -- 172.21.15.47:0/2542965546 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f4011560 con 0x55f2b5f5d070 2024-09-21T01:02:22.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f78e1ffb640 1 -- 172.21.15.47:0/2542965546 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f78f403dad0 con 0x55f2b5f5d070 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f790712c740 10 client.15819 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f790712c740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f790712c740 20 client.15819 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f790712c740 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2b5ef0da0 0x55f2b638f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f790712c740 4 client.15819 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f790712c740 1 -- 172.21.15.47:0/2542965546 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2b62788a0 con 0x55f2b5ef0da0 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.599+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2b5ef0da0 0x55f2b638f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f78e1ffb640 10 client.15819 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f78f9d9b640 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2b5ef0da0 0x55f2b638f110 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a390daf66b4872 server_cookie=49b3b175c1c1bea9 in_seq=0 out_seq=0 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f78e1ffb640 1 -- 172.21.15.47:0/2542965546 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2b62788a0 con 0x55f2b5ef0da0 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f78e1ffb640 10 client.15819 handle_command_reply: tid=0 2024-09-21T01:02:22.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 client.15819 shutdown 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 -- 172.21.15.47:0/2542965546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 msgr2=0x55f2b6314b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b6314b40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55f2b63125b0 tx=0x7f78f4009db0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 -- 172.21.15.47:0/2542965546 shutdown_connections 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55f2b5ef0da0 0x55f2b638f110 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f2b5f5d070 0x55f2b6314b40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f2b5f3c390 0x55f2b6314600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f78e1ffb640 0 client.15819 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 --2- 172.21.15.47:0/2542965546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f2b5f341b0 0x55f2b63140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.600+0000 7f790712c740 1 -- 172.21.15.47:0/2542965546 >> 172.21.15.47:0/2542965546 conn(0x55f2b5f51460 msgr2=0x55f2b63056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f790712c740 1 -- 172.21.15.47:0/2542965546 shutdown_connections 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f790712c740 1 -- 172.21.15.47:0/2542965546 wait complete. 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f790712c740 20 client.15819 trim_cache size 0 max 16384 2024-09-21T01:02:22.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 -- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78e40b6510 msgr2=0x7f78e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78e40b6510 0x7f78e40b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00c6a0 tx=0x7f78ec0ed530 comp rx=0 tx=0).stop 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 -- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc102a60 msgr2=0x7f78fc19b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc102a60 0x7f78fc19b250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00e9f0 tx=0x7f78ec00edf0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 -- 172.21.15.47:0/232328282 shutdown_connections 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f78e40b6510 0x7f78e40b8a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc108cf0 0x7f78fc19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc1083a0 0x7f78fc19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 --2- 172.21.15.47:0/232328282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78fc102a60 0x7f78fc19b250 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 -- 172.21.15.47:0/232328282 >> 172.21.15.47:0/232328282 conn(0x7f78fc079730 msgr2=0x7f78fc104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:22.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 -- 172.21.15.47:0/232328282 shutdown_connections 2024-09-21T01:02:22.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:22.601+0000 7f7900bb8640 1 -- 172.21.15.47:0/232328282 wait complete. 2024-09-21T01:02:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:23 smithi114 ceph-mon[34309]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 31 MiB/s wr, 5.12k op/s 2024-09-21T01:02:23.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:23 smithi047 ceph-mon[30960]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 31 MiB/s wr, 5.12k op/s 2024-09-21T01:02:23.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:23 smithi134 ceph-mon[34785]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 31 MiB/s wr, 5.12k op/s 2024-09-21T01:02:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.875+0000 7f89857fa640 1 -- 172.21.15.47:0/2379612433 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e92641b0f0 con 0x55e9260971c0 2024-09-21T01:02:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.875+0000 7f89857fa640 10 client.15777 handle_command_reply: tid=0 2024-09-21T01:02:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.875+0000 7f89aadc0740 1 client.15777 shutdown 2024-09-21T01:02:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 -- 172.21.15.47:0/2379612433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 msgr2=0x55e9264bf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264bf900 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8994004270 tx=0x7f8994004a90 comp rx=0 tx=0).stop 2024-09-21T01:02:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 -- 172.21.15.47:0/2379612433 shutdown_connections 2024-09-21T01:02:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e9260971c0 0x55e926533420 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9261031b0 0x55e9264bf900 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e9260e24d0 0x55e9264bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 --2- 172.21.15.47:0/2379612433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e9260da2f0 0x55e9264c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89857fa640 0 client.15777 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 -- 172.21.15.47:0/2379612433 >> 172.21.15.47:0/2379612433 conn(0x55e9260f7300 msgr2=0x55e9264b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 -- 172.21.15.47:0/2379612433 shutdown_connections 2024-09-21T01:02:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 1 -- 172.21.15.47:0/2379612433 wait complete. 2024-09-21T01:02:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.876+0000 7f89aadc0740 20 client.15777 trim_cache size 0 max 16384 2024-09-21T01:02:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:02:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:02:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:02:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:02:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 -- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f89880b6510 msgr2=0x7f89880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f89880b6510 0x7f89880b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8994009fd0 tx=0x7f89940094e0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 -- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 msgr2=0x7f899c199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 0x7f899c199f30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8998006010 tx=0x7f89980042f0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 -- 172.21.15.47:0/1107136254 shutdown_connections 2024-09-21T01:02:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f89880b6510 0x7f89880b8a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c103fc0 0x7f899c19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f899c103620 0x7f899c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 --2- 172.21.15.47:0/1107136254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c1025a0 0x7f899c199f30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 -- 172.21.15.47:0/1107136254 >> 172.21.15.47:0/1107136254 conn(0x7f899c0fdee0 msgr2=0x7f899c0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 -- 172.21.15.47:0/1107136254 shutdown_connections 2024-09-21T01:02:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:23.877+0000 7f89a3e4d640 1 -- 172.21.15.47:0/1107136254 wait complete. 2024-09-21T01:02:25.034 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:02:25.034 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:02:25.309 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:02:25.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:25 smithi114 ceph-mon[34309]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 36 MiB/s wr, 5.62k op/s 2024-09-21T01:02:25.430 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:25 smithi047 ceph-mon[30960]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 36 MiB/s wr, 5.62k op/s 2024-09-21T01:02:25.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:25 smithi134 ceph-mon[34785]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 36 MiB/s wr, 5.62k op/s 2024-09-21T01:02:26.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.291+0000 7fbcaaffd640 1 -- 172.21.15.47:0/1010659085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca00318a0 con 0x7fbcac1083a0 2024-09-21T01:02:26.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 -- 172.21.15.47:0/1010659085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 msgr2=0x7fbcac1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 --2- 172.21.15.47:0/1010659085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 0x7fbcac1087b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009900 tx=0x7fbca002a3f0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 -- 172.21.15.47:0/1010659085 shutdown_connections 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 --2- 172.21.15.47:0/1010659085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcac108cf0 0x7fbcac10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 --2- 172.21.15.47:0/1010659085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 0x7fbcac1087b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 --2- 172.21.15.47:0/1010659085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac102a60 0x7fbcac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 -- 172.21.15.47:0/1010659085 >> 172.21.15.47:0/1010659085 conn(0x7fbcac079730 msgr2=0x7fbcac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 -- 172.21.15.47:0/1010659085 shutdown_connections 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.292+0000 7fbcb2390640 1 -- 172.21.15.47:0/1010659085 wait complete. 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb2390640 1 Processor -- start 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb2390640 1 -- start start 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb2390640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcac102a60 0x7fbcac19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb2390640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 0x7fbcac19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb2390640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac108cf0 0x7fbcac19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb2390640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac112960 con 0x7fbcac1083a0 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb2390640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac1127e0 con 0x7fbcac108cf0 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb2390640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac112ae0 con 0x7fbcac102a60 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcac102a60 0x7fbcac19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 0x7fbcac19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcac102a60 0x7fbcac19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:33284/0 (socket says 172.21.15.47:33284) 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 0x7fbcac19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48984/0 (socket says 172.21.15.47:48984) 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcabfff640 1 -- 172.21.15.47:0/36787559 learned_addr learned my addr 172.21.15.47:0/36787559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.293+0000 7fbcb092d640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac108cf0 0x7fbcac19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbcabfff640 1 -- 172.21.15.47:0/36787559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac108cf0 msgr2=0x7fbcac19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbcabfff640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac108cf0 0x7fbcac19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbcabfff640 1 -- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 msgr2=0x7fbcac19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbcabfff640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 0x7fbcac19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbcabfff640 1 -- 172.21.15.47:0/36787559 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac1a03d0 con 0x7fbcac102a60 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbcabfff640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcac102a60 0x7fbcac19a460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00e9f0 tx=0x7fbc9c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbca97fa640 1 -- 172.21.15.47:0/36787559 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00cd80 con 0x7fbcac102a60 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbcb2390640 1 -- 172.21.15.47:0/36787559 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac1a06c0 con 0x7fbcac102a60 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbca97fa640 1 -- 172.21.15.47:0/36787559 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc9c0108e0 con 0x7fbcac102a60 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbca97fa640 1 -- 172.21.15.47:0/36787559 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c018980 con 0x7fbcac102a60 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.294+0000 7fbcb2390640 1 -- 172.21.15.47:0/36787559 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac1a6e20 con 0x7fbcac102a60 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb8904740 1 Processor -- start 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb8904740 1 -- start start 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbca97fa640 1 -- 172.21.15.47:0/36787559 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbc9c010430 con 0x7fbcac102a60 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 0x5599a328f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a328f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a328feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb8904740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5599a3205e60 con 0x5599a2ee8350 2024-09-21T01:02:26.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb8904740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5599a31f5290 con 0x5599a2ec7670 2024-09-21T01:02:26.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb8904740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5599a31f90a0 con 0x5599a2ebf490 2024-09-21T01:02:26.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a328f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcb092d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 0x5599a328f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a328feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a328feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:40448/0 (socket says 172.21.15.47:40448) 2024-09-21T01:02:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcab7fe640 1 -- 172.21.15.47:0/334245991 learned_addr learned my addr 172.21.15.47:0/334245991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.297+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a328f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:33288/0 (socket says 172.21.15.47:33288) 2024-09-21T01:02:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbcab7fe640 1 -- 172.21.15.47:0/334245991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 msgr2=0x5599a328f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/334245991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a328f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbcab7fe640 1 -- 172.21.15.47:0/334245991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 msgr2=0x5599a328f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/334245991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 0x5599a328f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbcab7fe640 1 -- 172.21.15.47:0/334245991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599a2f53930 con 0x5599a2ec7670 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/334245991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a328feb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009900 tx=0x7fbca0032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30710fa7dbb2338d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbc927fc640 1 -- 172.21.15.47:0/334245991 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0040070 con 0x5599a2ec7670 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbc927fc640 1 -- 172.21.15.47:0/334245991 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbca0004030 con 0x5599a2ec7670 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbc927fc640 1 -- 172.21.15.47:0/334245991 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0035040 con 0x5599a2ec7670 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.298+0000 7fbca97fa640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbc940b6510 0x7fbc940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb092d640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbc940b6510 0x7fbc940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbca97fa640 1 -- 172.21.15.47:0/36787559 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbc9c0e7550 con 0x7fbcac102a60 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 -- 172.21.15.47:0/334245991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 msgr2=0x5599a328feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb092d640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbc940b6510 0x7fbc940b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbca4005fd0 tx=0x7fbca4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 --2- 172.21.15.47:0/334245991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a328feb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009900 tx=0x7fbca0032b20 comp rx=0 tx=0).stop 2024-09-21T01:02:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 -- 172.21.15.47:0/334245991 shutdown_connections 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 --2- 172.21.15.47:0/334245991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a328feb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 --2- 172.21.15.47:0/334245991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a328f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 --2- 172.21.15.47:0/334245991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 0x5599a328f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 -- 172.21.15.47:0/334245991 >> 172.21.15.47:0/334245991 conn(0x5599a2edc740 msgr2=0x5599a328d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 -- 172.21.15.47:0/334245991 shutdown_connections 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.299+0000 7fbcb8904740 1 -- 172.21.15.47:0/334245991 wait complete. 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 1 -- start start 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 1 Processor -- start 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a329f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 0x5599a32ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5599a3056890 con 0x5599a2ee8350 2024-09-21T01:02:26.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5599a318fd40 con 0x5599a2ec7670 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5599a32a1eb0 con 0x5599a2ebf490 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb8904740 10 client.0 _ll_register_callbacks cb 0x5599a31f3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a329f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcb092d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 0x5599a32ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.300+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a329f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:40460/0 (socket says 172.21.15.47:40460) 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcab7fe640 1 -- 172.21.15.47:0/2600049798 learned_addr learned my addr 172.21.15.47:0/2600049798 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcabfff640 1 -- 172.21.15.47:0/2600049798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 msgr2=0x5599a329f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcabfff640 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a329f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcabfff640 1 -- 172.21.15.47:0/2600049798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 msgr2=0x5599a32ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcabfff640 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 0x5599a32ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcabfff640 1 -- 172.21.15.47:0/2600049798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599a32ab7d0 con 0x5599a2ebf490 2024-09-21T01:02:26.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcabfff640 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329f430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0e5140 tx=0x7fbc9c0eaba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b8af67cb24eedc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbc8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/2600049798 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0ad600 con 0x5599a2ebf490 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/2600049798 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbc9c0e9af0 con 0x5599a2ebf490 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcb8904740 1 -- 172.21.15.47:0/2600049798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbca0004030 con 0x5599a2ebf490 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/2600049798 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbc9c0acfa0 con 0x5599a2ebf490 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcb8904740 10 client.25519 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.301+0000 7fbcb8904740 1 -- 172.21.15.47:0/2600049798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5599a32ae0e0 con 0x5599a2ebf490 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/2600049798 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbca0004030 con 0x5599a2ebf490 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/2600049798 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fbc9c0a9180 con 0x5599a2ebf490 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbcb8904740 10 client.25519 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbcb8904740 10 client.25519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbcb8904740 20 client.25519 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbcb8904740 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5599a2ea6cd0 0x5599a32b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbcb8904740 4 client.25519 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbcb8904740 1 -- 172.21.15.47:0/2600049798 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599a3207db0 con 0x5599a2ea6cd0 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5599a2ea6cd0 0x5599a32b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5599a2ea6cd0 0x5599a32b15b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c43b7987a864d171 server_cookie=9cd386b1931471dd in_seq=0 out_seq=0 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.302+0000 7fbc8b7fe640 10 client.25519 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/2600049798 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599a3207db0 con 0x5599a2ea6cd0 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbc8b7fe640 10 client.25519 handle_command_reply: tid=0 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 client.25519 shutdown 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 -- 172.21.15.47:0/2600049798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 msgr2=0x5599a329f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329f430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0e5140 tx=0x7fbc9c0eaba0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 -- 172.21.15.47:0/2600049798 shutdown_connections 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5599a2ea6cd0 0x5599a32b15b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ee8350 0x5599a32ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a329f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 --2- 172.21.15.47:0/2600049798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329f430 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbc8b7fe640 0 client.25519 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 -- 172.21.15.47:0/2600049798 >> 172.21.15.47:0/2600049798 conn(0x5599a2edc740 msgr2=0x5599a3290e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.303+0000 7fbcb8904740 1 -- 172.21.15.47:0/2600049798 shutdown_connections 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.304+0000 7fbcb8904740 1 -- 172.21.15.47:0/2600049798 wait complete. 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.304+0000 7fbcb8904740 20 client.25519 trim_cache size 0 max 16384 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb8904740 1 Processor -- start 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb8904740 1 -- start start 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ec7670 0x5599a329dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ee8350 0x5599a328cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb8904740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac1aafb0 con 0x5599a2ec7670 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb8904740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac1ad810 con 0x5599a2ee8350 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb8904740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac1ab600 con 0x5599a2ebf490 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ec7670 0x5599a329dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ec7670 0x5599a329dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49008/0 (socket says 172.21.15.47:49008) 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcab7fe640 1 -- 172.21.15.47:0/1685490847 learned_addr learned my addr 172.21.15.47:0/1685490847 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.322+0000 7fbcb092d640 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ee8350 0x5599a328cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbcabfff640 1 -- 172.21.15.47:0/1685490847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ee8350 msgr2=0x5599a328cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbcabfff640 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ee8350 0x5599a328cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbcabfff640 1 -- 172.21.15.47:0/1685490847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ec7670 msgr2=0x5599a329dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbcabfff640 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ec7670 0x5599a329dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbcabfff640 1 -- 172.21.15.47:0/1685490847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599a329aac0 con 0x5599a2ebf490 2024-09-21T01:02:26.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ec7670 0x5599a329dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbcabfff640 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329dab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0ad530 tx=0x7fbc9c00e940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b024e8a9d058c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbc91ffb640 1 -- 172.21.15.47:0/1685490847 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0ad180 con 0x5599a2ebf490 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbc91ffb640 1 -- 172.21.15.47:0/1685490847 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc9c0ad340 con 0x5599a2ebf490 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.323+0000 7fbc91ffb640 1 -- 172.21.15.47:0/1685490847 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0aed10 con 0x5599a2ebf490 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 -- 172.21.15.47:0/1685490847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 msgr2=0x5599a329dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329dab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0ad530 tx=0x7fbc9c00e940 comp rx=0 tx=0).stop 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 -- 172.21.15.47:0/1685490847 shutdown_connections 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ee8350 0x5599a328cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ec7670 0x5599a329dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 --2- 172.21.15.47:0/1685490847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ebf490 0x5599a329dab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 -- 172.21.15.47:0/1685490847 >> 172.21.15.47:0/1685490847 conn(0x5599a2edc740 msgr2=0x5599a329f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 -- 172.21.15.47:0/1685490847 shutdown_connections 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 -- 172.21.15.47:0/1685490847 wait complete. 2024-09-21T01:02:26.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.324+0000 7fbcb8904740 1 -- start start 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb8904740 1 Processor -- start 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ebf490 0x5599a32a7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a32a7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb8904740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ee8350 0x5599a32a2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb8904740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac1abcd0 con 0x5599a2ebf490 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb8904740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac1ad140 con 0x5599a2ec7670 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb8904740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac1ac3a0 con 0x5599a2ee8350 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb8904740 10 client.0 _ll_register_callbacks cb 0x7fbc9c0ead60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ebf490 0x5599a32a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ebf490 0x5599a32a7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49016/0 (socket says 172.21.15.47:49016) 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcab7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a32a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcabfff640 1 -- 172.21.15.47:0/4279943095 learned_addr learned my addr 172.21.15.47:0/4279943095 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.325+0000 7fbcb092d640 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ee8350 0x5599a32a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcab7fe640 1 -- 172.21.15.47:0/4279943095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ee8350 msgr2=0x5599a32a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ee8350 0x5599a32a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcab7fe640 1 -- 172.21.15.47:0/4279943095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ebf490 msgr2=0x5599a32a7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ebf490 0x5599a32a7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcab7fe640 1 -- 172.21.15.47:0/4279943095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599a32a2810 con 0x5599a2ec7670 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcab7fe640 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a32a7930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009900 tx=0x7fbca0032ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75500019592ed473 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbc8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/4279943095 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca005a060 con 0x5599a2ec7670 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/4279943095 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbca00318b0 con 0x5599a2ec7670 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcb8904740 1 -- 172.21.15.47:0/4279943095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc9c0ad340 con 0x5599a2ec7670 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/4279943095 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbca0035040 con 0x5599a2ec7670 2024-09-21T01:02:26.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcb8904740 10 client.25505 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:26.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbcb8904740 1 -- 172.21.15.47:0/4279943095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5599a331c990 con 0x5599a2ec7670 2024-09-21T01:02:26.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/4279943095 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc9c0ad340 con 0x5599a2ec7670 2024-09-21T01:02:26.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.326+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/4279943095 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fbca00046c0 con 0x5599a2ec7670 2024-09-21T01:02:26.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbcb8904740 10 client.25505 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:26.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbcb8904740 10 client.25505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:26.404 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:02:26.404 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-09-21T01:02:26.404 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "d3e1990b-bd4b-4192-9c40-656f04b77a20", 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbcb8904740 20 client.25505 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbcb8904740 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5599a2e7c080 0x5599a331eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbcb8904740 4 client.25505 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbcb8904740 1 -- 172.21.15.47:0/4279943095 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5599a3203860 con 0x5599a2e7c080 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbcabfff640 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5599a2e7c080 0x5599a331eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbc8b7fe640 10 client.25505 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:26.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.327+0000 7fbcabfff640 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5599a2e7c080 0x5599a331eda0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38387c2a27de60c1 server_cookie=600d511014564965 in_seq=0 out_seq=0 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbc8b7fe640 1 -- 172.21.15.47:0/4279943095 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599a3203860 con 0x5599a2e7c080 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbc8b7fe640 10 client.25505 handle_command_reply: tid=0 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbcb8904740 1 client.25505 shutdown 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbcb8904740 1 -- 172.21.15.47:0/4279943095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 msgr2=0x5599a32a7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbcb8904740 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a32a7930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009900 tx=0x7fbca0032ed0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbcb8904740 1 -- 172.21.15.47:0/4279943095 shutdown_connections 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbcb8904740 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5599a2e7c080 0x5599a331eda0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbcb8904740 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599a2ee8350 0x5599a32a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbcb8904740 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599a2ec7670 0x5599a32a7930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbcb8904740 1 --2- 172.21.15.47:0/4279943095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5599a2ebf490 0x5599a32a7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.329+0000 7fbc8b7fe640 0 client.25505 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.330+0000 7fbcb8904740 1 -- 172.21.15.47:0/4279943095 >> 172.21.15.47:0/4279943095 conn(0x5599a2edc740 msgr2=0x5599a329da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:26.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.330+0000 7fbcb8904740 1 -- 172.21.15.47:0/4279943095 shutdown_connections 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.330+0000 7fbcb8904740 1 -- 172.21.15.47:0/4279943095 wait complete. 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.330+0000 7fbcb8904740 20 client.25505 trim_cache size 0 max 16384 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.330+0000 7fbcb2390640 1 -- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbc940b6510 msgr2=0x7fbc940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.330+0000 7fbcb2390640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbc940b6510 0x7fbc940b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbca4005fd0 tx=0x7fbca4009500 comp rx=0 tx=0).stop 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.330+0000 7fbcb2390640 1 -- 172.21.15.47:0/36787559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcac102a60 msgr2=0x7fbcac19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.330+0000 7fbcb2390640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcac102a60 0x7fbcac19a460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00e9f0 tx=0x7fbc9c00eeb0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.331+0000 7fbcb2390640 1 -- 172.21.15.47:0/36787559 shutdown_connections 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.331+0000 7fbcb2390640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbc940b6510 0x7fbc940b8a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.331+0000 7fbcb2390640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac108cf0 0x7fbcac19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.331+0000 7fbcb2390640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcac1083a0 0x7fbcac19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.331+0000 7fbcb2390640 1 --2- 172.21.15.47:0/36787559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcac102a60 0x7fbcac19a460 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.331+0000 7fbcb2390640 1 -- 172.21.15.47:0/36787559 >> 172.21.15.47:0/36787559 conn(0x7fbcac079730 msgr2=0x7fbcac06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.331+0000 7fbcb2390640 1 -- 172.21.15.47:0/36787559 shutdown_connections 2024-09-21T01:02:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:26.331+0000 7fbcb2390640 1 -- 172.21.15.47:0/36787559 wait complete. 2024-09-21T01:02:27.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:27 smithi114 ceph-mon[34309]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 31 MiB/s wr, 4.81k op/s 2024-09-21T01:02:27.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:27 smithi114 ceph-mon[34309]: scrub queued for path: / 2024-09-21T01:02:27.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:27 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T01:02:27.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:27 smithi114 ceph-mon[34309]: scrub summary: active paths [/] 2024-09-21T01:02:27.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:27 smithi047 ceph-mon[30960]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 31 MiB/s wr, 4.81k op/s 2024-09-21T01:02:27.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:27 smithi047 ceph-mon[30960]: scrub queued for path: / 2024-09-21T01:02:27.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:27 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T01:02:27.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:27 smithi047 ceph-mon[30960]: scrub summary: active paths [/] 2024-09-21T01:02:27.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:27 smithi134 ceph-mon[34785]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 31 MiB/s wr, 4.81k op/s 2024-09-21T01:02:27.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:27 smithi134 ceph-mon[34785]: scrub queued for path: / 2024-09-21T01:02:27.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:27 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T01:02:27.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:27 smithi134 ceph-mon[34785]: scrub summary: active paths [/] 2024-09-21T01:02:27.715 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:02:28.017 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.841+0000 7f0d6be46640 1 -- 172.21.15.47:0/4092959748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d641049b0 msgr2=0x7f0d64104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.841+0000 7f0d6be46640 1 --2- 172.21.15.47:0/4092959748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d641049b0 0x7f0d64104dc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009900 tx=0x7f0d5402a410 comp rx=0 tx=0).stop 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.841+0000 7f0d6be46640 1 -- 172.21.15.47:0/4092959748 shutdown_connections 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.841+0000 7f0d6be46640 1 --2- 172.21.15.47:0/4092959748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d6410de10 0x7f0d64110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.841+0000 7f0d6be46640 1 --2- 172.21.15.47:0/4092959748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d64105300 0x7f0d6410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.841+0000 7f0d6be46640 1 --2- 172.21.15.47:0/4092959748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d641049b0 0x7f0d64104dc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.841+0000 7f0d6be46640 1 -- 172.21.15.47:0/4092959748 >> 172.21.15.47:0/4092959748 conn(0x7f0d64079730 msgr2=0x7f0d64079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.842+0000 7f0d6be46640 1 -- 172.21.15.47:0/4092959748 shutdown_connections 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.842+0000 7f0d6be46640 1 -- 172.21.15.47:0/4092959748 wait complete. 2024-09-21T01:02:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6be46640 1 Processor -- start 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6be46640 1 -- start start 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6be46640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d641049b0 0x7f0d6419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6be46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d64105300 0x7f0d6419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6be46640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d6410de10 0x7f0d641a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6be46640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64104230 con 0x7f0d6410de10 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6be46640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641040b0 con 0x7f0d641049b0 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6be46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641043b0 con 0x7f0d64105300 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d69be2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d641049b0 0x7f0d6419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d693e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d64105300 0x7f0d6419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d69be2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d641049b0 0x7f0d6419c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:40494/0 (socket says 172.21.15.47:40494) 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d69be2640 1 -- 172.21.15.47:0/2258718242 learned_addr learned my addr 172.21.15.47:0/2258718242 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.843+0000 7f0d6a3e3640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d6410de10 0x7f0d641a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.844+0000 7f0d69be2640 1 -- 172.21.15.47:0/2258718242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d64105300 msgr2=0x7f0d6419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.844+0000 7f0d69be2640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d64105300 0x7f0d6419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.844+0000 7f0d69be2640 1 -- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d6410de10 msgr2=0x7f0d641a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.844+0000 7f0d69be2640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d6410de10 0x7f0d641a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.844+0000 7f0d69be2640 1 -- 172.21.15.47:0/2258718242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d641a2640 con 0x7f0d641049b0 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.844+0000 7f0d693e1640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d64105300 0x7f0d6419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.844+0000 7f0d69be2640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d641049b0 0x7f0d6419c6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d54032fd0 tx=0x7f0d54004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.844+0000 7f0d5affd640 1 -- 172.21.15.47:0/2258718242 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5403f030 con 0x7f0d641049b0 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.845+0000 7f0d6be46640 1 -- 172.21.15.47:0/2258718242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d641a28d0 con 0x7f0d641049b0 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.845+0000 7f0d5affd640 1 -- 172.21.15.47:0/2258718242 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d54004490 con 0x7f0d641049b0 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.845+0000 7f0d5affd640 1 -- 172.21.15.47:0/2258718242 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54035070 con 0x7f0d641049b0 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.845+0000 7f0d6be46640 1 -- 172.21.15.47:0/2258718242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d641a9090 con 0x7f0d641049b0 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.847+0000 7f0d5affd640 1 -- 172.21.15.47:0/2258718242 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f0d54042030 con 0x7f0d641049b0 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d723ba740 1 Processor -- start 2024-09-21T01:02:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d723ba740 1 -- start start 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e85215c1b0 0x55e85252cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e85252d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d723ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e8524a2e50 con 0x55e852185070 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d723ba740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55e852492280 con 0x55e852164390 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d723ba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e852496090 con 0x55e85215c1b0 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d6a3e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d693e1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e85252d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d69be2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e85215c1b0 0x55e85252cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d6a3e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49044/0 (socket says 172.21.15.47:49044) 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.848+0000 7f0d6a3e3640 1 -- 172.21.15.47:0/1353887215 learned_addr learned my addr 172.21.15.47:0/1353887215 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d5affd640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d500b6510 0x7f0d500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d693e1640 1 -- 172.21.15.47:0/1353887215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e85215c1b0 msgr2=0x55e85252cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d693e1640 1 --2- 172.21.15.47:0/1353887215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e85215c1b0 0x55e85252cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d693e1640 1 -- 172.21.15.47:0/1353887215 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 msgr2=0x55e85252c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d693e1640 1 --2- 172.21.15.47:0/1353887215 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d693e1640 1 -- 172.21.15.47:0/1353887215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8521f0650 con 0x55e852164390 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d6a3e3640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d500b6510 0x7f0d500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d693e1640 1 --2- 172.21.15.47:0/1353887215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e85252d0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d6406aaa0 tx=0x7f0d60010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72fd7dfef4fd670 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d5affd640 1 -- 172.21.15.47:0/2258718242 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f0d54107730 con 0x7f0d641049b0 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d4ffff640 1 -- 172.21.15.47:0/1353887215 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600117c0 con 0x55e852164390 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d4ffff640 1 -- 172.21.15.47:0/1353887215 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d60011e10 con 0x55e852164390 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.849+0000 7f0d4ffff640 1 -- 172.21.15.47:0/1353887215 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6001ce40 con 0x55e852164390 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 -- 172.21.15.47:0/1353887215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 msgr2=0x55e85252d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d6a3e3640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d500b6510 0x7f0d500b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c005f40 tx=0x7f0d5c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1353887215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e85252d0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d6406aaa0 tx=0x7f0d60010860 comp rx=0 tx=0).stop 2024-09-21T01:02:28.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 -- 172.21.15.47:0/1353887215 shutdown_connections 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1353887215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e85252d0d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1353887215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e85215c1b0 0x55e85252cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1353887215 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 -- 172.21.15.47:0/1353887215 >> 172.21.15.47:0/1353887215 conn(0x55e852179460 msgr2=0x55e85252a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 -- 172.21.15.47:0/1353887215 shutdown_connections 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.850+0000 7f0d723ba740 1 -- 172.21.15.47:0/1353887215 wait complete. 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.851+0000 7f0d723ba740 1 -- start start 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.851+0000 7f0d723ba740 1 Processor -- start 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.851+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852537d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.851+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e852538240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.851+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852185070 0x55e852544150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d723ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e8522f3700 con 0x55e85215c1b0 2024-09-21T01:02:28.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d723ba740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55e85242d110 con 0x55e852164390 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d723ba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e85253ae30 con 0x55e852185070 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852537d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d723ba740 10 client.0 _ll_register_callbacks cb 0x55e852446990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852537d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49056/0 (socket says 172.21.15.47:49056) 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 -- 172.21.15.47:0/3757576696 learned_addr learned my addr 172.21.15.47:0/3757576696 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d693e1640 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e852538240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d6a3e3640 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852185070 0x55e852544150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 -- 172.21.15.47:0/3757576696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852185070 msgr2=0x55e852544150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852185070 0x55e852544150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 -- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 msgr2=0x55e852538240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e852538240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 -- 172.21.15.47:0/3757576696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e85245ac40 con 0x55e85215c1b0 2024-09-21T01:02:28.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d693e1640 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e852538240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d69be2640 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852537d00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0d540cd980 tx=0x7f0d54000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4a6992818b4a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/3757576696 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54049070 con 0x55e85215c1b0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/3757576696 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f0d540d6ed0 con 0x55e85215c1b0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.852+0000 7f0d723ba740 1 -- 172.21.15.47:0/3757576696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d60011e10 con 0x55e85215c1b0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/3757576696 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0d540ca040 con 0x55e85215c1b0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d723ba740 10 client.15849 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d723ba740 1 -- 172.21.15.47:0/3757576696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e852546b10 con 0x55e85215c1b0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/3757576696 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d60011e10 con 0x55e85215c1b0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/3757576696 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0d54107bb0 con 0x55e85215c1b0 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d723ba740 10 client.15849 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d723ba740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:28.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d723ba740 20 client.15849 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d723ba740 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e8521439f0 0x55e85254a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d723ba740 4 client.15849 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.853+0000 7f0d723ba740 1 -- 172.21.15.47:0/3757576696 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8524a4da0 con 0x55e8521439f0 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.854+0000 7f0d693e1640 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e8521439f0 0x55e85254a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.854+0000 7f0d693e1640 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e8521439f0 0x55e85254a060 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd54be5397e7d646 server_cookie=ca8f7834f7ff3e96 in_seq=0 out_seq=0 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.854+0000 7f0d4d7fa640 10 client.15849 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/3757576696 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8524a4da0 con 0x55e8521439f0 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d4d7fa640 10 client.15849 handle_command_reply: tid=0 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 client.15849 shutdown 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 -- 172.21.15.47:0/3757576696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 msgr2=0x55e852537d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852537d00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0d540cd980 tx=0x7f0d54000bc0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 -- 172.21.15.47:0/3757576696 shutdown_connections 2024-09-21T01:02:28.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e8521439f0 0x55e85254a060 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852185070 0x55e852544150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852164390 0x55e852538240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d4d7fa640 0 client.15849 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 --2- 172.21.15.47:0/3757576696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852537d00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 -- 172.21.15.47:0/3757576696 >> 172.21.15.47:0/3757576696 conn(0x55e852179460 msgr2=0x55e85252f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 -- 172.21.15.47:0/3757576696 shutdown_connections 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 1 -- 172.21.15.47:0/3757576696 wait complete. 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.855+0000 7f0d723ba740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d723ba740 1 Processor -- start 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d723ba740 1 -- start start 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e85215c1b0 0x55e852539930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e852529b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d723ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641af440 con 0x55e852185070 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d723ba740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641b1cc0 con 0x55e85215c1b0 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d723ba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641afab0 con 0x55e852164390 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d6a3e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.873+0000 7f0d693e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e852529b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d693e1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e852529b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:33376/0 (socket says 172.21.15.47:33376) 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d6a3e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49072/0 (socket says 172.21.15.47:49072) 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d693e1640 1 -- 172.21.15.47:0/2349271301 learned_addr learned my addr 172.21.15.47:0/2349271301 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d69be2640 1 --2- 172.21.15.47:0/2349271301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e85215c1b0 0x55e852539930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d693e1640 1 -- 172.21.15.47:0/2349271301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e85215c1b0 msgr2=0x55e852539930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d693e1640 1 --2- 172.21.15.47:0/2349271301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e85215c1b0 0x55e852539930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d693e1640 1 -- 172.21.15.47:0/2349271301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 msgr2=0x55e85252a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d693e1640 1 --2- 172.21.15.47:0/2349271301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d693e1640 1 -- 172.21.15.47:0/2349271301 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e85253a2e0 con 0x55e852164390 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d693e1640 1 --2- 172.21.15.47:0/2349271301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e852529b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d60013010 tx=0x7f0d6000bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97cfbf90b116fa2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d4f7fe640 1 -- 172.21.15.47:0/2349271301 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60004220 con 0x55e852164390 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d4f7fe640 1 -- 172.21.15.47:0/2349271301 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d600043c0 con 0x55e852164390 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.874+0000 7f0d4f7fe640 1 -- 172.21.15.47:0/2349271301 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60004660 con 0x55e852164390 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 -- 172.21.15.47:0/2349271301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 msgr2=0x55e852529b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 --2- 172.21.15.47:0/2349271301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e852529b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d60013010 tx=0x7f0d6000bfd0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 -- 172.21.15.47:0/2349271301 shutdown_connections 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 --2- 172.21.15.47:0/2349271301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e852185070 0x55e85252a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 --2- 172.21.15.47:0/2349271301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e852529b70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 --2- 172.21.15.47:0/2349271301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e85215c1b0 0x55e852539930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 -- 172.21.15.47:0/2349271301 >> 172.21.15.47:0/2349271301 conn(0x55e852179460 msgr2=0x55e852539220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 -- 172.21.15.47:0/2349271301 shutdown_connections 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.875+0000 7f0d723ba740 1 -- 172.21.15.47:0/2349271301 wait complete. 2024-09-21T01:02:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 1 -- start start 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 1 Processor -- start 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852540710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e85253bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852185070 0x55e85253c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641b0180 con 0x55e85215c1b0 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641b15f0 con 0x55e852185070 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641b0850 con 0x55e852164390 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d723ba740 10 client.0 _ll_register_callbacks cb 0x7f0d54005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d69be2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852540710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d69be2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852540710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49076/0 (socket says 172.21.15.47:49076) 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d69be2640 1 -- 172.21.15.47:0/1727520118 learned_addr learned my addr 172.21.15.47:0/1727520118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d6a3e3640 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852185070 0x55e85253c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.876+0000 7f0d693e1640 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e85253bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d69be2640 1 -- 172.21.15.47:0/1727520118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 msgr2=0x55e85253bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d69be2640 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e85253bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d69be2640 1 -- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852185070 msgr2=0x55e85253c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d69be2640 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852185070 0x55e85253c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d69be2640 1 -- 172.21.15.47:0/1727520118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e85253c740 con 0x55e85215c1b0 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d6a3e3640 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852185070 0x55e85253c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d69be2640 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852540710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0d54032af0 tx=0x7f0d54009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99f7d98456329c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/1727520118 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54049070 con 0x55e85215c1b0 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/1727520118 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f0d54107a90 con 0x55e85215c1b0 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d723ba740 1 -- 172.21.15.47:0/1727520118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d600043c0 con 0x55e85215c1b0 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/1727520118 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0d540cd160 con 0x55e85215c1b0 2024-09-21T01:02:28.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d723ba740 10 client.15855 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.877+0000 7f0d723ba740 1 -- 172.21.15.47:0/1727520118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e8525b47e0 con 0x55e85215c1b0 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/1727520118 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d600043c0 con 0x55e85215c1b0 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/1727520118 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0d540cc6c0 con 0x55e85215c1b0 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d723ba740 10 client.15855 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d723ba740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d723ba740 20 client.15855 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e852118da0 0x55e8525b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d723ba740 4 client.15855 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d723ba740 1 -- 172.21.15.47:0/1727520118 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e8524a0850 con 0x55e852118da0 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d693e1640 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e852118da0 0x55e8525b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.878+0000 7f0d4d7fa640 10 client.15855 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d693e1640 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e852118da0 0x55e8525b6e10 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57c208132839b0c1 server_cookie=e2e825f5e28b5459 in_seq=0 out_seq=0 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d4d7fa640 1 -- 172.21.15.47:0/1727520118 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1714 (crc 0 0 0) 0x55e8524a0850 con 0x55e852118da0 2024-09-21T01:02:28.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d4d7fa640 10 client.15855 handle_command_reply: tid=0 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 client.15855 shutdown 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 -- 172.21.15.47:0/1727520118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 msgr2=0x55e852540710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852540710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0d54032af0 tx=0x7f0d54009260 comp rx=0 tx=0).stop 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 -- 172.21.15.47:0/1727520118 shutdown_connections 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55e852118da0 0x55e8525b6e10 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55e852185070 0x55e85253c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e852164390 0x55e85253bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 --2- 172.21.15.47:0/1727520118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e85215c1b0 0x55e852540710 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 -- 172.21.15.47:0/1727520118 >> 172.21.15.47:0/1727520118 conn(0x55e852179460 msgr2=0x55e852539b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d4d7fa640 0 client.15855 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:28.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 -- 172.21.15.47:0/1727520118 shutdown_connections 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (159 inodes in the stack)", 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "d3e1990b-bd4b-4192-9c40-656f04b77a20", 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:02:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:28.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:28.968 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:02:28.969 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 1 -- 172.21.15.47:0/1727520118 wait complete. 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.879+0000 7f0d723ba740 20 client.15855 trim_cache size 0 max 16384 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 -- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d500b6510 msgr2=0x7f0d500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d500b6510 0x7f0d500b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c005f40 tx=0x7f0d5c004a40 comp rx=0 tx=0).stop 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 -- 172.21.15.47:0/2258718242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d641049b0 msgr2=0x7f0d6419c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d641049b0 0x7f0d6419c6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d54032fd0 tx=0x7f0d54004270 comp rx=0 tx=0).stop 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 -- 172.21.15.47:0/2258718242 shutdown_connections 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f0d500b6510 0x7f0d500b8a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d6410de10 0x7f0d641a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d64105300 0x7f0d6419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 --2- 172.21.15.47:0/2258718242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d641049b0 0x7f0d6419c6d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 -- 172.21.15.47:0/2258718242 >> 172.21.15.47:0/2258718242 conn(0x7f0d64079730 msgr2=0x7f0d64100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 -- 172.21.15.47:0/2258718242 shutdown_connections 2024-09-21T01:02:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:02:28.880+0000 7f0d6be46640 1 -- 172.21.15.47:0/2258718242 wait complete. 2024-09-21T01:02:29.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:29 smithi114 ceph-mon[34309]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 36 MiB/s wr, 5.46k op/s 2024-09-21T01:02:29.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:29 smithi047 ceph-mon[30960]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 36 MiB/s wr, 5.46k op/s 2024-09-21T01:02:29.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:29 smithi134 ceph-mon[34785]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 36 MiB/s wr, 5.46k op/s 2024-09-21T01:02:30.500 INFO:tasks.cephfs.filesystem:scrub status for tag:d3e1990b-bd4b-4192-9c40-656f04b77a20 - {'path': '/', 'tag': 'd3e1990b-bd4b-4192-9c40-656f04b77a20', 'options': 'recursive,force'} 2024-09-21T01:02:31.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:31 smithi114 ceph-mon[34309]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-09-21T01:02:31.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:31 smithi047 ceph-mon[30960]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-09-21T01:02:31.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:31 smithi134 ceph-mon[34785]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-09-21T01:02:33.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:33 smithi114 ceph-mon[34309]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 32 MiB/s wr, 4.81k op/s 2024-09-21T01:02:33.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:33 smithi047 ceph-mon[30960]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 32 MiB/s wr, 4.81k op/s 2024-09-21T01:02:33.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:33 smithi134 ceph-mon[34785]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 32 MiB/s wr, 4.81k op/s 2024-09-21T01:02:35.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:35 smithi114 ceph-mon[34309]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 38 MiB/s wr, 5.77k op/s 2024-09-21T01:02:35.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:35 smithi047 ceph-mon[30960]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 38 MiB/s wr, 5.77k op/s 2024-09-21T01:02:35.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:35 smithi134 ceph-mon[34785]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 38 MiB/s wr, 5.77k op/s 2024-09-21T01:02:36.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:36 smithi047 ceph-mon[30960]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 35 MiB/s wr, 5.26k op/s 2024-09-21T01:02:36.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:36 smithi134 ceph-mon[34785]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 35 MiB/s wr, 5.26k op/s 2024-09-21T01:02:36.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:36 smithi114 ceph-mon[34309]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 35 MiB/s wr, 5.26k op/s 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 -- 172.21.15.47:0/2141370487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c103620 msgr2=0x7fa83c103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 --2- 172.21.15.47:0/2141370487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c103620 0x7fa83c103a30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa830009900 tx=0x7fa83002a410 comp rx=0 tx=0).stop 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 -- 172.21.15.47:0/2141370487 shutdown_connections 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 --2- 172.21.15.47:0/2141370487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa83c103fc0 0x7fa83c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 --2- 172.21.15.47:0/2141370487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c103620 0x7fa83c103a30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 --2- 172.21.15.47:0/2141370487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa83c1025a0 0x7fa83c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 -- 172.21.15.47:0/2141370487 >> 172.21.15.47:0/2141370487 conn(0x7fa83c0fdee0 msgr2=0x7fa83c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 -- 172.21.15.47:0/2141370487 shutdown_connections 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.987+0000 7fa840f89640 1 -- 172.21.15.47:0/2141370487 wait complete. 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa840f89640 1 Processor -- start 2024-09-21T01:02:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa840f89640 1 -- start start 2024-09-21T01:02:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa840f89640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c1025a0 0x7fa83c06b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa840f89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa83c103620 0x7fa83c19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa840f89640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa83c103fc0 0x7fa83c1a1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa840f89640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c10e200 con 0x7fa83c1025a0 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa840f89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c10e080 con 0x7fa83c103620 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa840f89640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c10e380 con 0x7fa83c103fc0 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa83a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c1025a0 0x7fa83c06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.988+0000 7fa83a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c1025a0 0x7fa83c06b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51686/0 (socket says 172.21.15.47:51686) 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa83a59c640 1 -- 172.21.15.47:0/1077509048 learned_addr learned my addr 172.21.15.47:0/1077509048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa83c103fc0 0x7fa83c1a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa839d9b640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa83c103620 0x7fa83c19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa83a59c640 1 -- 172.21.15.47:0/1077509048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa83c103fc0 msgr2=0x7fa83c1a1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa83a59c640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa83c103fc0 0x7fa83c1a1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa83a59c640 1 -- 172.21.15.47:0/1077509048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa83c103620 msgr2=0x7fa83c19ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa83a59c640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa83c103620 0x7fa83c19ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa83a59c640 1 -- 172.21.15.47:0/1077509048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c1a1a20 con 0x7fa83c1025a0 2024-09-21T01:02:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa83a59c640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c1025a0 0x7fa83c06b450 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00d950 tx=0x7fa82c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa82b7fe640 1 -- 172.21.15.47:0/1077509048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c017070 con 0x7fa83c1025a0 2024-09-21T01:02:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa82b7fe640 1 -- 172.21.15.47:0/1077509048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa82c009c30 con 0x7fa83c1025a0 2024-09-21T01:02:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa840f89640 1 -- 172.21.15.47:0/1077509048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c1a1d10 con 0x7fa83c1025a0 2024-09-21T01:02:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa82b7fe640 1 -- 172.21.15.47:0/1077509048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00f620 con 0x7fa83c1025a0 2024-09-21T01:02:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.989+0000 7fa840f89640 1 -- 172.21.15.47:0/1077509048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c1a21b0 con 0x7fa83c1025a0 2024-09-21T01:02:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa847fd2740 1 Processor -- start 2024-09-21T01:02:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa847fd2740 1 -- start start 2024-09-21T01:02:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb1f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb1f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb20420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa847fd2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564d0ba8d6f0 con 0x564d0b7731b0 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa847fd2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x564d0ba7cb20 con 0x564d0b7524d0 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa847fd2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564d0ba80930 con 0x564d0b74a2f0 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa82b7fe640 1 -- 172.21.15.47:0/1077509048 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa82c010460 con 0x7fa83c1025a0 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa83ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb1f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa839d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb20420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa83ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb1f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51696/0 (socket says 172.21.15.47:51696) 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.992+0000 7fa83ad9d640 1 -- 172.21.15.47:0/2376033358 learned_addr learned my addr 172.21.15.47:0/2376033358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa83a59c640 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb1f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa83ad9d640 1 -- 172.21.15.47:0/2376033358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 msgr2=0x564d0bb1f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb1f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa83ad9d640 1 -- 172.21.15.47:0/2376033358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 msgr2=0x564d0bb20420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb20420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa83ad9d640 1 -- 172.21.15.47:0/2376033358 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d0ba42530 con 0x564d0b7731b0 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa83a59c640 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb1f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb1f260 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa834011470 tx=0x7fa834011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcfaf5e98c6c128 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa828ff9640 1 -- 172.21.15.47:0/2376033358 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83401e070 con 0x564d0b7731b0 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa82b7fe640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8240b6510 0x7fa8240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa828ff9640 1 -- 172.21.15.47:0/2376033358 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83400f9f0 con 0x564d0b7731b0 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa828ff9640 1 -- 172.21.15.47:0/2376033358 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834019ba0 con 0x564d0b7731b0 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.993+0000 7fa82b7fe640 1 -- 172.21.15.47:0/1077509048 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa82c0e6ea0 con 0x7fa83c1025a0 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa83a59c640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8240b6510 0x7fa8240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa83a59c640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8240b6510 0x7fa8240b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0a96a0 tx=0x7fa82c005880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 -- 172.21.15.47:0/2376033358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 msgr2=0x564d0bb1f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb1f260 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa834011470 tx=0x7fa834011930 comp rx=0 tx=0).stop 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 -- 172.21.15.47:0/2376033358 shutdown_connections 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb20420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb1f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 --2- 172.21.15.47:0/2376033358 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb1f260 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 -- 172.21.15.47:0/2376033358 >> 172.21.15.47:0/2376033358 conn(0x564d0b767300 msgr2=0x564d0bb168e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 -- 172.21.15.47:0/2376033358 shutdown_connections 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.994+0000 7fa847fd2740 1 -- 172.21.15.47:0/2376033358 wait complete. 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 1 -- start start 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 1 Processor -- start 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb289c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb29080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7731b0 0x564d0bb29bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564d0b9b4ab0 con 0x564d0b7524d0 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x564d0ba22730 con 0x564d0b7731b0 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564d0bb20f40 con 0x564d0b74a2f0 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa847fd2740 10 client.0 _ll_register_callbacks cb 0x564d0ba766b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.995+0000 7fa839d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb29080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa839d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb29080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51706/0 (socket says 172.21.15.47:51706) 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa839d9b640 1 -- 172.21.15.47:0/3711924366 learned_addr learned my addr 172.21.15.47:0/3711924366 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7731b0 0x564d0bb29bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa839d9b640 1 -- 172.21.15.47:0/3711924366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 msgr2=0x564d0bb289c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa839d9b640 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb289c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa839d9b640 1 -- 172.21.15.47:0/3711924366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7731b0 msgr2=0x564d0bb29bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa839d9b640 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7731b0 0x564d0bb29bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa839d9b640 1 -- 172.21.15.47:0/3711924366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d0b7de790 con 0x564d0b7524d0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa839d9b640 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb29080 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa83002a930 tx=0x7fa830032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3d640e27f4c58d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa821ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa821ffb640 1 -- 172.21.15.47:0/3711924366 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830035040 con 0x564d0b7524d0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa821ffb640 1 -- 172.21.15.47:0/3711924366 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa830004240 con 0x564d0b7524d0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa847fd2740 1 -- 172.21.15.47:0/3711924366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83400f9f0 con 0x564d0b7524d0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa821ffb640 1 -- 172.21.15.47:0/3711924366 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa830004440 con 0x564d0b7524d0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.996+0000 7fa847fd2740 10 client.15867 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa847fd2740 1 -- 172.21.15.47:0/3711924366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564d0b857620 con 0x564d0b7524d0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa821ffb640 1 -- 172.21.15.47:0/3711924366 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83400f9f0 con 0x564d0b7524d0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa821ffb640 1 -- 172.21.15.47:0/3711924366 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa830004aa0 con 0x564d0b7524d0 2024-09-21T01:02:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa847fd2740 10 client.15867 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa847fd2740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa847fd2740 20 client.15867 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564d0b731d80 0x564d0bb36130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa847fd2740 4 client.15867 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:02:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa847fd2740 1 -- 172.21.15.47:0/3711924366 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d0ba8f640 con 0x564d0b731d80 2024-09-21T01:02:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.997+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564d0b731d80 0x564d0bb36130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.998+0000 7fa821ffb640 10 client.15867 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.998+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564d0b731d80 0x564d0bb36130 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51ae4e3e4e6df3f3 server_cookie=22d8c8f70181238 in_seq=0 out_seq=0 2024-09-21T01:02:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.998+0000 7fa821ffb640 1 -- 172.21.15.47:0/3711924366 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d0ba8f640 con 0x564d0b731d80 2024-09-21T01:02:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.998+0000 7fa821ffb640 10 client.15867 handle_command_reply: tid=0 2024-09-21T01:02:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.998+0000 7fa847fd2740 1 client.15867 shutdown 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 -- 172.21.15.47:0/3711924366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 msgr2=0x564d0bb29080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb29080 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa83002a930 tx=0x7fa830032d10 comp rx=0 tx=0).stop 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 -- 172.21.15.47:0/3711924366 shutdown_connections 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564d0b731d80 0x564d0bb36130 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7731b0 0x564d0bb29bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb29080 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3711924366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb289c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 -- 172.21.15.47:0/3711924366 >> 172.21.15.47:0/3711924366 conn(0x564d0b767300 msgr2=0x564d0bb202d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa821ffb640 0 client.15867 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 -- 172.21.15.47:0/3711924366 shutdown_connections 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 1 -- 172.21.15.47:0/3711924366 wait complete. 2024-09-21T01:02:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:36.999+0000 7fa847fd2740 20 client.15867 trim_cache size 0 max 16384 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa847fd2740 1 Processor -- start 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa847fd2740 1 -- start start 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb22d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb23250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb23790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa847fd2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1a6cb0 con 0x564d0b7731b0 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa847fd2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1a94f0 con 0x564d0b7524d0 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa847fd2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1a7300 con 0x564d0b74a2f0 2024-09-21T01:02:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa83ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb23790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa83ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb23790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51714/0 (socket says 172.21.15.47:51714) 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa839d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb23250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa83ad9d640 1 -- 172.21.15.47:0/479674611 learned_addr learned my addr 172.21.15.47:0/479674611 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.016+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb22d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa83ad9d640 1 -- 172.21.15.47:0/479674611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 msgr2=0x564d0bb22d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb22d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa83ad9d640 1 -- 172.21.15.47:0/479674611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 msgr2=0x564d0bb23250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb23250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa83ad9d640 1 -- 172.21.15.47:0/479674611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d0bb28320 con 0x564d0b7731b0 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa839d9b640 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb23250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb23790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa8340194d0 tx=0x7fa834009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab21e043cda0c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa823fff640 1 -- 172.21.15.47:0/479674611 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83401e040 con 0x564d0b7731b0 2024-09-21T01:02:37.019 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa823fff640 1 -- 172.21.15.47:0/479674611 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83401f040 con 0x564d0b7731b0 2024-09-21T01:02:37.020 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.017+0000 7fa823fff640 1 -- 172.21.15.47:0/479674611 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834019b60 con 0x564d0b7731b0 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 -- 172.21.15.47:0/479674611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 msgr2=0x564d0bb23790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb23790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa8340194d0 tx=0x7fa834009ce0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 -- 172.21.15.47:0/479674611 shutdown_connections 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7731b0 0x564d0bb23790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b7524d0 0x564d0bb23250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 --2- 172.21.15.47:0/479674611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b74a2f0 0x564d0bb22d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 -- 172.21.15.47:0/479674611 >> 172.21.15.47:0/479674611 conn(0x564d0b767300 msgr2=0x564d0bb115c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 -- 172.21.15.47:0/479674611 shutdown_connections 2024-09-21T01:02:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 -- 172.21.15.47:0/479674611 wait complete. 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.018+0000 7fa847fd2740 1 -- start start 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa847fd2740 1 Processor -- start 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b74a2f0 0x564d0bb2d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb2df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa847fd2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b7731b0 0x564d0bb2eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa847fd2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1a79b0 con 0x564d0b7524d0 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa847fd2740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1a8e20 con 0x564d0b74a2f0 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa847fd2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1a8080 con 0x564d0b7731b0 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa847fd2740 10 client.0 _ll_register_callbacks cb 0x7fa830009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa839d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb2df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa839d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb2df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51720/0 (socket says 172.21.15.47:51720) 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa839d9b640 1 -- 172.21.15.47:0/3183046630 learned_addr learned my addr 172.21.15.47:0/3183046630 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:02:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b7731b0 0x564d0bb2eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b74a2f0 0x564d0bb2d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa839d9b640 1 -- 172.21.15.47:0/3183046630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b7731b0 msgr2=0x564d0bb2eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa839d9b640 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b7731b0 0x564d0bb2eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa839d9b640 1 -- 172.21.15.47:0/3183046630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b74a2f0 msgr2=0x564d0bb2d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa839d9b640 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b74a2f0 0x564d0bb2d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.019+0000 7fa839d9b640 1 -- 172.21.15.47:0/3183046630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d0bb2f240 con 0x564d0b7524d0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa839d9b640 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb2df70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa830004ef0 tx=0x7fa830005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca3e43b452ce854 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa821ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa821ffb640 1 -- 172.21.15.47:0/3183046630 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830035040 con 0x564d0b7524d0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa821ffb640 1 -- 172.21.15.47:0/3183046630 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa8300051c0 con 0x564d0b7524d0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 1 -- 172.21.15.47:0/3183046630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83401f040 con 0x564d0b7524d0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa821ffb640 1 -- 172.21.15.47:0/3183046630 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa8300053c0 con 0x564d0b7524d0 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 10 client.15873 fetch_fsmap learned FSMap version 19 2024-09-21T01:02:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 1 -- 172.21.15.47:0/3183046630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564d0bb305d0 con 0x564d0b7524d0 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa821ffb640 1 -- 172.21.15.47:0/3183046630 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83401f040 con 0x564d0b7524d0 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa821ffb640 1 -- 172.21.15.47:0/3183046630 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa830004000 con 0x564d0b7524d0 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 10 client.15873 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 20 client.15873 populate_metadata read hostname 'smithi047' 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564d0b7071c0 0x564d0bba2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 4 client.15873 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.020+0000 7fa847fd2740 1 -- 172.21.15.47:0/3183046630 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d0ba8b0f0 con 0x564d0b7071c0 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.021+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564d0b7071c0 0x564d0bba2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.021+0000 7fa83ad9d640 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564d0b7071c0 0x564d0bba2b00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebe2411876ba1ead server_cookie=7f46591b49f09f3f in_seq=0 out_seq=0 2024-09-21T01:02:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:02:37.021+0000 7fa821ffb640 10 client.15873 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:02:38.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:38 smithi047 ceph-mon[30960]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 42 MiB/s wr, 6.36k op/s 2024-09-21T01:02:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:38 smithi134 ceph-mon[34785]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 42 MiB/s wr, 6.36k op/s 2024-09-21T01:02:38.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:38 smithi114 ceph-mon[34309]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 42 MiB/s wr, 6.36k op/s 2024-09-21T01:02:40.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:40 smithi047 ceph-mon[30960]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 38 MiB/s wr, 5.88k op/s 2024-09-21T01:02:40.710 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:40 smithi114 ceph-mon[34309]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 38 MiB/s wr, 5.88k op/s 2024-09-21T01:02:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:40 smithi134 ceph-mon[34785]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 38 MiB/s wr, 5.88k op/s 2024-09-21T01:02:41.745 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:41 smithi134 ceph-mon[34785]: Health check update: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:02:41.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:41 smithi047 ceph-mon[30960]: Health check update: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:02:41.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:41 smithi114 ceph-mon[34309]: Health check update: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:02:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:42 smithi134 ceph-mon[34785]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 39 MiB/s wr, 5.96k op/s 2024-09-21T01:02:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:42 smithi114 ceph-mon[34309]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 39 MiB/s wr, 5.96k op/s 2024-09-21T01:02:42.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:42 smithi047 ceph-mon[30960]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 39 MiB/s wr, 5.96k op/s 2024-09-21T01:02:44.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:44 smithi134 ceph-mon[34785]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 47 MiB/s wr, 6.98k op/s 2024-09-21T01:02:44.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:44 smithi114 ceph-mon[34309]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 47 MiB/s wr, 6.98k op/s 2024-09-21T01:02:44.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:44 smithi047 ceph-mon[30960]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 47 MiB/s wr, 6.98k op/s 2024-09-21T01:02:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:46 smithi134 ceph-mon[34785]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 39 MiB/s wr, 5.68k op/s 2024-09-21T01:02:46.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:46 smithi114 ceph-mon[34309]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 39 MiB/s wr, 5.68k op/s 2024-09-21T01:02:46.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:46 smithi047 ceph-mon[30960]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 39 MiB/s wr, 5.68k op/s 2024-09-21T01:02:48.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:48 smithi134 ceph-mon[34785]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 45 MiB/s wr, 6.38k op/s 2024-09-21T01:02:48.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:48 smithi114 ceph-mon[34309]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 45 MiB/s wr, 6.38k op/s 2024-09-21T01:02:48.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:48 smithi047 ceph-mon[30960]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 45 MiB/s wr, 6.38k op/s 2024-09-21T01:02:49.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:49 smithi134 ceph-mon[34785]: Health check update: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:02:49.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:49 smithi114 ceph-mon[34309]: Health check update: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:02:49.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:49 smithi047 ceph-mon[30960]: Health check update: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:02:50.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:50 smithi134 ceph-mon[34785]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 42 MiB/s wr, 5.77k op/s 2024-09-21T01:02:50.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:50 smithi114 ceph-mon[34309]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 42 MiB/s wr, 5.77k op/s 2024-09-21T01:02:50.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:50 smithi047 ceph-mon[30960]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 42 MiB/s wr, 5.77k op/s 2024-09-21T01:02:52.705 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:52 smithi047 ceph-mon[30960]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 41 MiB/s wr, 5.65k op/s 2024-09-21T01:02:52.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:52 smithi134 ceph-mon[34785]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 41 MiB/s wr, 5.65k op/s 2024-09-21T01:02:52.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:52 smithi114 ceph-mon[34309]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 41 MiB/s wr, 5.65k op/s 2024-09-21T01:02:54.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:54 smithi134 ceph-mon[34785]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 45 MiB/s wr, 6.27k op/s 2024-09-21T01:02:54.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:54 smithi114 ceph-mon[34309]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 45 MiB/s wr, 6.27k op/s 2024-09-21T01:02:54.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:54 smithi047 ceph-mon[30960]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 45 MiB/s wr, 6.27k op/s 2024-09-21T01:02:56.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:56 smithi134 ceph-mon[34785]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 4.82k op/s 2024-09-21T01:02:56.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:56 smithi114 ceph-mon[34309]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 4.82k op/s 2024-09-21T01:02:56.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:56 smithi047 ceph-mon[30960]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 4.82k op/s 2024-09-21T01:02:58.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:58 smithi134 ceph-mon[34785]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 5.44k op/s 2024-09-21T01:02:58.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:58.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:58 smithi114 ceph-mon[34309]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 5.44k op/s 2024-09-21T01:02:58.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:58.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:58 smithi047 ceph-mon[30960]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 MiB/s wr, 5.44k op/s 2024-09-21T01:02:58.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:02:59.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:59.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:02:59.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:02:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:02:59.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:59.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:02:59.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:02:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:02:59.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:02:59.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:02:59.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:02:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:03:00.500 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:03:00.809 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:01.146 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:00 smithi047 ceph-mon[30960]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 MiB/s wr, 4.56k op/s 2024-09-21T01:03:01.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:00 smithi114 ceph-mon[34309]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 MiB/s wr, 4.56k op/s 2024-09-21T01:03:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:00 smithi134 ceph-mon[34785]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 MiB/s wr, 4.56k op/s 2024-09-21T01:03:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 -- 172.21.15.47:0/3697576009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54109e10 msgr2=0x7f3b54110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 --2- 172.21.15.47:0/3697576009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54109e10 0x7f3b54110640 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009ca0 tx=0x7f3b4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 -- 172.21.15.47:0/3697576009 shutdown_connections 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 --2- 172.21.15.47:0/3697576009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54109e10 0x7f3b54110640 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 --2- 172.21.15.47:0/3697576009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b541094c0 0x7f3b541098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 --2- 172.21.15.47:0/3697576009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b54103b80 0x7f3b54103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 -- 172.21.15.47:0/3697576009 >> 172.21.15.47:0/3697576009 conn(0x7f3b540ff610 msgr2=0x7f3b54101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 -- 172.21.15.47:0/3697576009 shutdown_connections 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.487+0000 7f3b5982a640 1 -- 172.21.15.47:0/3697576009 wait complete. 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.488+0000 7f3b5982a640 1 Processor -- start 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.488+0000 7f3b5982a640 1 -- start start 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b5982a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54103b80 0x7f3b5419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b5982a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b541094c0 0x7f3b5419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b5982a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b54109e10 0x7f3b541a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b5982a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54113ad0 con 0x7f3b54103b80 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b5982a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54113950 con 0x7f3b54109e10 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b5982a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54113c50 con 0x7f3b541094c0 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54103b80 0x7f3b5419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b527fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b541094c0 0x7f3b5419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54103b80 0x7f3b5419c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44782/0 (socket says 172.21.15.47:44782) 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b52ffd640 1 -- 172.21.15.47:0/2763790512 learned_addr learned my addr 172.21.15.47:0/2763790512 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b537fe640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b54109e10 0x7f3b541a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b52ffd640 1 -- 172.21.15.47:0/2763790512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b541094c0 msgr2=0x7f3b5419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b52ffd640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b541094c0 0x7f3b5419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b52ffd640 1 -- 172.21.15.47:0/2763790512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b54109e10 msgr2=0x7f3b541a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b52ffd640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b54109e10 0x7f3b541a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.489+0000 7f3b52ffd640 1 -- 172.21.15.47:0/2763790512 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b541a25b0 con 0x7f3b54103b80 2024-09-21T01:03:01.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.490+0000 7f3b52ffd640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54103b80 0x7f3b5419c640 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400e9f0 tx=0x7f3b4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:01.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.490+0000 7f3b58828640 1 -- 172.21.15.47:0/2763790512 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4400cd80 con 0x7f3b54103b80 2024-09-21T01:03:01.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.490+0000 7f3b58828640 1 -- 172.21.15.47:0/2763790512 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b440108e0 con 0x7f3b54103b80 2024-09-21T01:03:01.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.490+0000 7f3b5982a640 1 -- 172.21.15.47:0/2763790512 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b541a28a0 con 0x7f3b54103b80 2024-09-21T01:03:01.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.490+0000 7f3b5982a640 1 -- 172.21.15.47:0/2763790512 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b541a9000 con 0x7f3b54103b80 2024-09-21T01:03:01.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.490+0000 7f3b58828640 1 -- 172.21.15.47:0/2763790512 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44018980 con 0x7f3b54103b80 2024-09-21T01:03:01.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.493+0000 7f3b5fd9e740 1 Processor -- start 2024-09-21T01:03:01.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b5fd9e740 1 -- start start 2024-09-21T01:03:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a41070 0x556a26de8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26de8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a20390 0x556a26de90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a26d5ee50 con 0x556a26a41070 2024-09-21T01:03:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x556a26d4e280 con 0x556a26a181b0 2024-09-21T01:03:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556a26d52090 con 0x556a26a20390 2024-09-21T01:03:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b58828640 1 -- 172.21.15.47:0/2763790512 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3b44010430 con 0x7f3b54103b80 2024-09-21T01:03:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26de8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a41070 0x556a26de8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26de8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:42978/0 (socket says 172.21.15.47:42978) 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b52ffd640 1 -- 172.21.15.47:0/1421237451 learned_addr learned my addr 172.21.15.47:0/1421237451 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a41070 0x556a26de8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44784/0 (socket says 172.21.15.47:44784) 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.494+0000 7f3b527fc640 1 --2- 172.21.15.47:0/1421237451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a20390 0x556a26de90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.495+0000 7f3b537fe640 1 -- 172.21.15.47:0/1421237451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a20390 msgr2=0x556a26de90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.495+0000 7f3b537fe640 1 --2- 172.21.15.47:0/1421237451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a20390 0x556a26de90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.495+0000 7f3b537fe640 1 -- 172.21.15.47:0/1421237451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 msgr2=0x556a26de8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.495+0000 7f3b537fe640 1 --2- 172.21.15.47:0/1421237451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26de8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.495+0000 7f3b537fe640 1 -- 172.21.15.47:0/1421237451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a26aac650 con 0x556a26a41070 2024-09-21T01:03:01.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.495+0000 7f3b537fe640 1 --2- 172.21.15.47:0/1421237451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a41070 0x556a26de8650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c005e30 tx=0x7f3b4c02f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c0e59fa746b01a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:01.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.496+0000 7f3b39ffb640 1 -- 172.21.15.47:0/1421237451 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c031cf0 con 0x556a26a41070 2024-09-21T01:03:01.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.496+0000 7f3b39ffb640 1 -- 172.21.15.47:0/1421237451 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c036030 con 0x556a26a41070 2024-09-21T01:03:01.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.496+0000 7f3b39ffb640 1 -- 172.21.15.47:0/1421237451 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c004040 con 0x556a26a41070 2024-09-21T01:03:01.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.496+0000 7f3b58828640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3b3c0b6610 0x7f3b3c0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.497+0000 7f3b52ffd640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3b3c0b6610 0x7f3b3c0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.497+0000 7f3b58828640 1 -- 172.21.15.47:0/2763790512 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f3b440e73e0 con 0x7f3b54103b80 2024-09-21T01:03:01.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.497+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1421237451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a41070 msgr2=0x556a26de8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.497+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1421237451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a41070 0x556a26de8650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c005e30 tx=0x7f3b4c02f410 comp rx=0 tx=0).stop 2024-09-21T01:03:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.497+0000 7f3b52ffd640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3b3c0b6610 0x7f3b3c0b8b20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400c6a0 tx=0x7f3b440eaaa0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.498+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1421237451 shutdown_connections 2024-09-21T01:03:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.498+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1421237451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a20390 0x556a26de90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.498+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1421237451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26de8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.498+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1421237451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a41070 0x556a26de8650 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.498+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1421237451 >> 172.21.15.47:0/1421237451 conn(0x556a26a35460 msgr2=0x556a26de6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.498+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1421237451 shutdown_connections 2024-09-21T01:03:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.498+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1421237451 wait complete. 2024-09-21T01:03:01.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.498+0000 7f3b5fd9e740 1 -- start start 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.499+0000 7f3b5fd9e740 1 Processor -- start 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.499+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26dfcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.499+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a20390 0x556a26dfd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26dfcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26dfcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:42980/0 (socket says 172.21.15.47:42980) 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b527fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a20390 0x556a26dfd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b527fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a20390 0x556a26dfd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44794/0 (socket says 172.21.15.47:44794) 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 -- 172.21.15.47:0/1170101167 learned_addr learned my addr 172.21.15.47:0/1170101167 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26e022a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a26baf700 con 0x556a26a20390 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x556a26ce9110 con 0x556a26a181b0 2024-09-21T01:03:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556a26df6c50 con 0x556a26a41070 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26e022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b5fd9e740 10 client.0 _ll_register_callbacks cb 0x556a26d02990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 -- 172.21.15.47:0/1170101167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 msgr2=0x556a26e022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26e022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 -- 172.21.15.47:0/1170101167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a20390 msgr2=0x556a26dfd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a20390 0x556a26dfd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.500+0000 7f3b537fe640 1 -- 172.21.15.47:0/1170101167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a26d16c40 con 0x556a26a181b0 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b4c036030 con 0x556a26a181b0 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b527fc640 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a20390 0x556a26dfd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b537fe640 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26dfcca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c02a900 tx=0x7f3b4c005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e2e5183ad3d3c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b32ffd640 10 client.25553 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b32ffd640 1 -- 172.21.15.47:0/1170101167 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c058060 con 0x556a26a181b0 2024-09-21T01:03:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b32ffd640 1 -- 172.21.15.47:0/1170101167 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f3b4c031860 con 0x556a26a181b0 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b32ffd640 1 -- 172.21.15.47:0/1170101167 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3b4c04a040 con 0x556a26a181b0 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b5fd9e740 10 client.25553 fetch_fsmap learned FSMap version 19 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.501+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556a26e0b050 con 0x556a26a181b0 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.502+0000 7f3b32ffd640 1 -- 172.21.15.47:0/1170101167 <== mon.2 v2:172.21.15.114:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3b4c050070 con 0x556a26a181b0 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.502+0000 7f3b5fd9e740 10 client.25553 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.502+0000 7f3b5fd9e740 10 client.25553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.502+0000 7f3b5fd9e740 20 client.25553 populate_metadata read hostname 'smithi047' 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.502+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556a269ff9f0 0x556a26e0e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.502+0000 7f3b5fd9e740 4 client.25553 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.502+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a26d60da0 con 0x556a269ff9f0 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.502+0000 7f3b527fc640 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556a269ff9f0 0x556a26e0e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.503+0000 7f3b32ffd640 10 client.25553 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.503+0000 7f3b527fc640 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556a269ff9f0 0x556a26e0e3b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e6f303df1d575db server_cookie=fe4021e2cfe4cb8d in_seq=0 out_seq=0 2024-09-21T01:03:01.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.503+0000 7f3b32ffd640 1 -- 172.21.15.47:0/1170101167 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a26d60da0 con 0x556a269ff9f0 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.503+0000 7f3b32ffd640 10 client.25553 handle_command_reply: tid=0 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.503+0000 7f3b5fd9e740 1 client.25553 shutdown 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 msgr2=0x556a26dfcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26dfcca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c02a900 tx=0x7f3b4c005c50 comp rx=0 tx=0).stop 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 shutdown_connections 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556a269ff9f0 0x556a26e0e3b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26e022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a20390 0x556a26dfd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b32ffd640 0 client.25553 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/1170101167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a181b0 0x556a26dfcca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 >> 172.21.15.47:0/1170101167 conn(0x556a26a35460 msgr2=0x556a26deb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 shutdown_connections 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/1170101167 wait complete. 2024-09-21T01:03:01.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.504+0000 7f3b5fd9e740 20 client.25553 trim_cache size 0 max 16384 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.527+0000 7f3b5fd9e740 1 Processor -- start 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.527+0000 7f3b5fd9e740 1 -- start start 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26df6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 0x556a26de5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26de63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4000c2f0 con 0x556a26a181b0 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4000eb70 con 0x556a26a20390 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4000c960 con 0x556a26a41070 2024-09-21T01:03:01.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b537fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26de63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b537fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26de63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:42004/0 (socket says 172.21.15.47:42004) 2024-09-21T01:03:01.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b537fe640 1 -- 172.21.15.47:0/3298994572 learned_addr learned my addr 172.21.15.47:0/3298994572 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:01.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b527fc640 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 0x556a26de5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b537fe640 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26df6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b537fe640 1 -- 172.21.15.47:0/3298994572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 msgr2=0x556a26de5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:01.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.528+0000 7f3b537fe640 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 0x556a26de5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.529+0000 7f3b537fe640 1 -- 172.21.15.47:0/3298994572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 msgr2=0x556a26df6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:01.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.529+0000 7f3b537fe640 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26df6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.529+0000 7f3b537fe640 1 -- 172.21.15.47:0/3298994572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a26dea940 con 0x556a26a41070 2024-09-21T01:03:01.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.529+0000 7f3b537fe640 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26de63c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x556a26de1ed0 tx=0x7f3b4c050000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de21aa597006f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:01.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.529+0000 7f3b397fa640 1 -- 172.21.15.47:0/3298994572 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c058040 con 0x556a26a41070 2024-09-21T01:03:01.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.529+0000 7f3b397fa640 1 -- 172.21.15.47:0/3298994572 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c036030 con 0x556a26a41070 2024-09-21T01:03:01.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.529+0000 7f3b397fa640 1 -- 172.21.15.47:0/3298994572 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c030820 con 0x556a26a41070 2024-09-21T01:03:01.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/3298994572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 msgr2=0x556a26de63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26de63c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x556a26de1ed0 tx=0x7f3b4c050000 comp rx=0 tx=0).stop 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/3298994572 shutdown_connections 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26de63c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 0x556a26de5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/3298994572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26df6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/3298994572 >> 172.21.15.47:0/3298994572 conn(0x556a26a35460 msgr2=0x556a26dfb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/3298994572 shutdown_connections 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.530+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/3298994572 wait complete. 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.531+0000 7f3b5fd9e740 1 -- start start 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.531+0000 7f3b5fd9e740 1 Processor -- start 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.531+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26e02e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.531+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 0x556a26e03470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.531+0000 7f3b5fd9e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26e07ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.531+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4000d030 con 0x556a26a181b0 2024-09-21T01:03:01.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4000e4a0 con 0x556a26a20390 2024-09-21T01:03:01.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b5fd9e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4000d700 con 0x556a26a41070 2024-09-21T01:03:01.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b5fd9e740 10 client.0 _ll_register_callbacks cb 0x7f3b440eac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:01.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26e02e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26e02e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57324/0 (socket says 172.21.15.47:57324) 2024-09-21T01:03:01.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 -- 172.21.15.47:0/491580002 learned_addr learned my addr 172.21.15.47:0/491580002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:01.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26e07ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b527fc640 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 0x556a26e03470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 -- 172.21.15.47:0/491580002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 msgr2=0x556a26e07ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26e07ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 -- 172.21.15.47:0/491580002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 msgr2=0x556a26e03470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 0x556a26e03470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.532+0000 7f3b537fe640 1 -- 172.21.15.47:0/491580002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a26e08420 con 0x556a26a181b0 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b537fe640 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26e02e90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c02f500 tx=0x7f3b4c02f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3867d3736f65de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b32ffd640 1 -- 172.21.15.47:0/491580002 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c058030 con 0x556a26a181b0 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b32ffd640 1 -- 172.21.15.47:0/491580002 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f3b4c0307c0 con 0x556a26a181b0 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/491580002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b4c036030 con 0x556a26a181b0 2024-09-21T01:03:01.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b32ffd640 1 -- 172.21.15.47:0/491580002 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3b4c0317a0 con 0x556a26a181b0 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b5fd9e740 10 client.15891 fetch_fsmap learned FSMap version 19 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/491580002 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556a26e78c10 con 0x556a26a181b0 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.533+0000 7f3b32ffd640 1 -- 172.21.15.47:0/491580002 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c030e70 con 0x556a26a181b0 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.534+0000 7f3b32ffd640 1 -- 172.21.15.47:0/491580002 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3b4c043070 con 0x556a26a181b0 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.534+0000 7f3b5fd9e740 10 client.15891 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.534+0000 7f3b5fd9e740 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.534+0000 7f3b5fd9e740 20 client.15891 populate_metadata read hostname 'smithi047' 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.534+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556a269d4da0 0x556a26e7b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.534+0000 7f3b5fd9e740 4 client.15891 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.534+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/491580002 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3b4c036030 con 0x556a269d4da0 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.534+0000 7f3b527fc640 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556a269d4da0 0x556a26e7b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b32ffd640 10 client.15891 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b527fc640 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556a269d4da0 0x556a26e7b240 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae4f8e8b18f3152b server_cookie=887564858461b69b in_seq=0 out_seq=0 2024-09-21T01:03:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b32ffd640 1 -- 172.21.15.47:0/491580002 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1713 (crc 0 0 0) 0x7f3b4c036030 con 0x556a269d4da0 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b32ffd640 10 client.15891 handle_command_reply: tid=0 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b5fd9e740 1 client.15891 shutdown 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/491580002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 msgr2=0x556a26e02e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26e02e90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c02f500 tx=0x7f3b4c02f660 comp rx=0 tx=0).stop 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/491580002 shutdown_connections 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556a269d4da0 0x556a26e7b240 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a26a41070 0x556a26e07ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556a26a20390 0x556a26e03470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.535+0000 7f3b5fd9e740 1 --2- 172.21.15.47:0/491580002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a26a181b0 0x556a26e02e90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/491580002 >> 172.21.15.47:0/491580002 conn(0x556a26a35460 msgr2=0x556a26deb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b32ffd640 0 client.15891 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/491580002 shutdown_connections 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b5fd9e740 1 -- 172.21.15.47:0/491580002 wait complete. 2024-09-21T01:03:01.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b5fd9e740 20 client.15891 trim_cache size 0 max 16384 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (82 inodes in the stack)", 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "d3e1990b-bd4b-4192-9c40-656f04b77a20", 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:03:01.540 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:01.541 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:03:01.542 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:01.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:03:01.544 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:03:01.544 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:03:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b5982a640 1 -- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3b3c0b6610 msgr2=0x7f3b3c0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b5982a640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3b3c0b6610 0x7f3b3c0b8b20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400c6a0 tx=0x7f3b440eaaa0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b5982a640 1 -- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54103b80 msgr2=0x7f3b5419c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.536+0000 7f3b5982a640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54103b80 0x7f3b5419c640 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400e9f0 tx=0x7f3b4400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.537+0000 7f3b5982a640 1 -- 172.21.15.47:0/2763790512 shutdown_connections 2024-09-21T01:03:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.537+0000 7f3b5982a640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3b3c0b6610 0x7f3b3c0b8b20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.537+0000 7f3b5982a640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b54109e10 0x7f3b541a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.537+0000 7f3b5982a640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b541094c0 0x7f3b5419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.537+0000 7f3b5982a640 1 --2- 172.21.15.47:0/2763790512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b54103b80 0x7f3b5419c640 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.537+0000 7f3b5982a640 1 -- 172.21.15.47:0/2763790512 >> 172.21.15.47:0/2763790512 conn(0x7f3b540ff610 msgr2=0x7f3b54106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.537+0000 7f3b5982a640 1 -- 172.21.15.47:0/2763790512 shutdown_connections 2024-09-21T01:03:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:01.537+0000 7f3b5982a640 1 -- 172.21.15.47:0/2763790512 wait complete. 2024-09-21T01:03:02.463 INFO:tasks.cephfs.filesystem:scrub status for tag:d3e1990b-bd4b-4192-9c40-656f04b77a20 - {'path': '/', 'tag': 'd3e1990b-bd4b-4192-9c40-656f04b77a20', 'options': 'recursive,force'} 2024-09-21T01:03:03.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:02 smithi114 ceph-mon[34309]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 MiB/s wr, 4.26k op/s 2024-09-21T01:03:03.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:02 smithi047 ceph-mon[30960]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 MiB/s wr, 4.26k op/s 2024-09-21T01:03:03.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:02 smithi134 ceph-mon[34785]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 MiB/s wr, 4.26k op/s 2024-09-21T01:03:05.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:04 smithi114 ceph-mon[34309]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 42 MiB/s wr, 5.59k op/s 2024-09-21T01:03:05.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:04 smithi047 ceph-mon[30960]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 42 MiB/s wr, 5.59k op/s 2024-09-21T01:03:05.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:04 smithi134 ceph-mon[34785]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 42 MiB/s wr, 5.59k op/s 2024-09-21T01:03:07.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:06 smithi114 ceph-mon[34309]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 36 MiB/s wr, 4.82k op/s 2024-09-21T01:03:07.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:06 smithi047 ceph-mon[30960]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 36 MiB/s wr, 4.82k op/s 2024-09-21T01:03:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:06 smithi134 ceph-mon[34785]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 36 MiB/s wr, 4.82k op/s 2024-09-21T01:03:09.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:08 smithi114 ceph-mon[34309]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 45 MiB/s wr, 6.03k op/s 2024-09-21T01:03:09.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:08 smithi047 ceph-mon[30960]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 45 MiB/s wr, 6.03k op/s 2024-09-21T01:03:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:08 smithi134 ceph-mon[34785]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 45 MiB/s wr, 6.03k op/s 2024-09-21T01:03:11.146 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:10 smithi134 ceph-mon[34785]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 44 MiB/s wr, 5.82k op/s 2024-09-21T01:03:11.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:10 smithi114 ceph-mon[34309]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 44 MiB/s wr, 5.82k op/s 2024-09-21T01:03:11.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:10 smithi047 ceph-mon[30960]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 44 MiB/s wr, 5.82k op/s 2024-09-21T01:03:13.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:12 smithi114 ceph-mon[34309]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 43 MiB/s wr, 5.77k op/s 2024-09-21T01:03:13.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:12 smithi047 ceph-mon[30960]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 43 MiB/s wr, 5.77k op/s 2024-09-21T01:03:13.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:12 smithi134 ceph-mon[34785]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 43 MiB/s wr, 5.77k op/s 2024-09-21T01:03:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:14 smithi114 ceph-mon[34309]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 50 MiB/s wr, 6.66k op/s 2024-09-21T01:03:15.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:14 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:15.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:14 smithi047 ceph-mon[30960]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 50 MiB/s wr, 6.66k op/s 2024-09-21T01:03:15.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:14 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:14 smithi134 ceph-mon[34785]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 50 MiB/s wr, 6.66k op/s 2024-09-21T01:03:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:14 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T01:03:17.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:16 smithi114 ceph-mon[34309]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 38 MiB/s wr, 5.18k op/s 2024-09-21T01:03:17.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:16 smithi047 ceph-mon[30960]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 38 MiB/s wr, 5.18k op/s 2024-09-21T01:03:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:16 smithi134 ceph-mon[34785]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 38 MiB/s wr, 5.18k op/s 2024-09-21T01:03:19.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:18 smithi114 ceph-mon[34309]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 47 MiB/s wr, 6.23k op/s 2024-09-21T01:03:19.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:18 smithi047 ceph-mon[30960]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 47 MiB/s wr, 6.23k op/s 2024-09-21T01:03:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:18 smithi134 ceph-mon[34785]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 47 MiB/s wr, 6.23k op/s 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa821ffb640 1 -- 172.21.15.47:0/3183046630 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d0ba8b0f0 con 0x564d0b7071c0 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa821ffb640 10 client.15873 handle_command_reply: tid=0 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 client.15873 shutdown 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 -- 172.21.15.47:0/3183046630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 msgr2=0x564d0bb2df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb2df70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa830004ef0 tx=0x7fa830005fd0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 -- 172.21.15.47:0/3183046630 shutdown_connections 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564d0b7071c0 0x564d0bba2b00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d0b7731b0 0x564d0bb2eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d0b7524d0 0x564d0bb2df70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 --2- 172.21.15.47:0/3183046630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564d0b74a2f0 0x564d0bb2d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa847fd2740 1 -- 172.21.15.47:0/3183046630 >> 172.21.15.47:0/3183046630 conn(0x564d0b767300 msgr2=0x564d0bb14ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.051+0000 7fa821ffb640 0 client.15873 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.052+0000 7fa847fd2740 1 -- 172.21.15.47:0/3183046630 shutdown_connections 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.052+0000 7fa847fd2740 1 -- 172.21.15.47:0/3183046630 wait complete. 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.052+0000 7fa847fd2740 20 client.15873 trim_cache size 0 max 16384 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:03:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:03:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 -- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8240b6510 msgr2=0x7fa8240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8240b6510 0x7fa8240b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0a96a0 tx=0x7fa82c005880 comp rx=0 tx=0).stop 2024-09-21T01:03:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 -- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c1025a0 msgr2=0x7fa83c06b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c1025a0 0x7fa83c06b450 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00d950 tx=0x7fa82c00de10 comp rx=0 tx=0).stop 2024-09-21T01:03:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 -- 172.21.15.47:0/1077509048 shutdown_connections 2024-09-21T01:03:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8240b6510 0x7fa8240b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa83c103fc0 0x7fa83c1a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa83c103620 0x7fa83c19ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 --2- 172.21.15.47:0/1077509048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa83c1025a0 0x7fa83c06b450 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 -- 172.21.15.47:0/1077509048 >> 172.21.15.47:0/1077509048 conn(0x7fa83c0fdee0 msgr2=0x7fa83c106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 -- 172.21.15.47:0/1077509048 shutdown_connections 2024-09-21T01:03:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:21.053+0000 7fa840f89640 1 -- 172.21.15.47:0/1077509048 wait complete. 2024-09-21T01:03:21.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:20 smithi114 ceph-mon[34309]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 38 MiB/s wr, 4.95k op/s 2024-09-21T01:03:21.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:20 smithi047 ceph-mon[30960]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 38 MiB/s wr, 4.95k op/s 2024-09-21T01:03:21.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:20 smithi134 ceph-mon[34785]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 38 MiB/s wr, 4.95k op/s 2024-09-21T01:03:23.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:22 smithi114 ceph-mon[34309]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 38 MiB/s wr, 4.86k op/s 2024-09-21T01:03:23.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:22 smithi047 ceph-mon[30960]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 38 MiB/s wr, 4.86k op/s 2024-09-21T01:03:23.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:22 smithi134 ceph-mon[34785]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 38 MiB/s wr, 4.86k op/s 2024-09-21T01:03:25.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:24 smithi114 ceph-mon[34309]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 44 MiB/s wr, 5.66k op/s 2024-09-21T01:03:25.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:24 smithi047 ceph-mon[30960]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 44 MiB/s wr, 5.66k op/s 2024-09-21T01:03:25.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:24 smithi134 ceph-mon[34785]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 44 MiB/s wr, 5.66k op/s 2024-09-21T01:03:27.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:26 smithi114 ceph-mon[34309]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 36 MiB/s wr, 4.65k op/s 2024-09-21T01:03:27.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:26 smithi047 ceph-mon[30960]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 36 MiB/s wr, 4.65k op/s 2024-09-21T01:03:27.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:26 smithi134 ceph-mon[34785]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 36 MiB/s wr, 4.65k op/s 2024-09-21T01:03:29.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:28 smithi114 ceph-mon[34309]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 44 MiB/s wr, 5.53k op/s 2024-09-21T01:03:29.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:28 smithi047 ceph-mon[30960]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 44 MiB/s wr, 5.53k op/s 2024-09-21T01:03:29.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:28 smithi134 ceph-mon[34785]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 44 MiB/s wr, 5.53k op/s 2024-09-21T01:03:31.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:30 smithi114 ceph-mon[34309]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 37 MiB/s wr, 4.64k op/s 2024-09-21T01:03:31.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:30 smithi047 ceph-mon[30960]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 37 MiB/s wr, 4.64k op/s 2024-09-21T01:03:31.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:30 smithi134 ceph-mon[34785]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 37 MiB/s wr, 4.64k op/s 2024-09-21T01:03:32.465 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:03:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:03:33.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:32 smithi114 ceph-mon[34309]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 39 MiB/s wr, 4.98k op/s 2024-09-21T01:03:33.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:32 smithi047 ceph-mon[30960]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 39 MiB/s wr, 4.98k op/s 2024-09-21T01:03:33.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:32 smithi134 ceph-mon[34785]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 39 MiB/s wr, 4.98k op/s 2024-09-21T01:03:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 -- 172.21.15.47:0/2131670991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c1094d0 msgr2=0x7f279c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 --2- 172.21.15.47:0/2131670991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c1094d0 0x7f279c1098e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f278c009860 tx=0x7f278c02a340 comp rx=0 tx=0).stop 2024-09-21T01:03:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 -- 172.21.15.47:0/2131670991 shutdown_connections 2024-09-21T01:03:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 --2- 172.21.15.47:0/2131670991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f279c109e20 0x7f279c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 --2- 172.21.15.47:0/2131670991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c1094d0 0x7f279c1098e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 --2- 172.21.15.47:0/2131670991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c103b90 0x7f279c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 -- 172.21.15.47:0/2131670991 >> 172.21.15.47:0/2131670991 conn(0x7f279c0ff5e0 msgr2=0x7f279c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 -- 172.21.15.47:0/2131670991 shutdown_connections 2024-09-21T01:03:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.361+0000 7f27a4447640 1 -- 172.21.15.47:0/2131670991 wait complete. 2024-09-21T01:03:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a4447640 1 Processor -- start 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a4447640 1 -- start start 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a4447640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f279c103b90 0x7f279c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a4447640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c1094d0 0x7f279c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a4447640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c109e20 0x7f279c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a4447640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f279c113ae0 con 0x7f279c1094d0 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a4447640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f279c113960 con 0x7f279c109e20 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a4447640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f279c113c60 con 0x7f279c103b90 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a19e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c1094d0 0x7f279c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a21e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f279c103b90 0x7f279c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a19e2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c1094d0 0x7f279c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48732/0 (socket says 172.21.15.47:48732) 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a19e2640 1 -- 172.21.15.47:0/3129206091 learned_addr learned my addr 172.21.15.47:0/3129206091 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a21e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f279c103b90 0x7f279c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:58992/0 (socket says 172.21.15.47:58992) 2024-09-21T01:03:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.362+0000 7f27a29e4640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c109e20 0x7f279c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a21e3640 1 -- 172.21.15.47:0/3129206091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c109e20 msgr2=0x7f279c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a21e3640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c109e20 0x7f279c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a21e3640 1 -- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c1094d0 msgr2=0x7f279c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a21e3640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c1094d0 0x7f279c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a21e3640 1 -- 172.21.15.47:0/3129206091 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c1a8750 con 0x7f279c103b90 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a19e2640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c1094d0 0x7f279c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a29e4640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c109e20 0x7f279c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a21e3640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f279c103b90 0x7f279c075710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f279800e9f0 tx=0x7f279800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27937fe640 1 -- 172.21.15.47:0/3129206091 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279800ccc0 con 0x7f279c103b90 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a4447640 1 -- 172.21.15.47:0/3129206091 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c1a8a40 con 0x7f279c103b90 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27937fe640 1 -- 172.21.15.47:0/3129206091 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27980108e0 con 0x7f279c103b90 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.363+0000 7f27a4447640 1 -- 172.21.15.47:0/3129206091 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c1a8fa0 con 0x7f279c103b90 2024-09-21T01:03:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.364+0000 7f27937fe640 1 -- 172.21.15.47:0/3129206091 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798018880 con 0x7f279c103b90 2024-09-21T01:03:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.367+0000 7f27aa9bb740 1 Processor -- start 2024-09-21T01:03:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.367+0000 7f27aa9bb740 1 -- start start 2024-09-21T01:03:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27937fe640 1 -- 172.21.15.47:0/3129206091 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2798010430 con 0x7f279c103b90 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c82070 0x564306029270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x5643060297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c61390 0x564306029cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564305f9fe50 con 0x564305c61390 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x564305f8f280 con 0x564305c82070 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564305f93090 con 0x564305c591b0 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27a29e4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c82070 0x564306029270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27a29e4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c82070 0x564306029270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:51276/0 (socket says 172.21.15.47:51276) 2024-09-21T01:03:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27a29e4640 1 -- 172.21.15.47:0/1302614530 learned_addr learned my addr 172.21.15.47:0/1302614530 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27a21e3640 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x5643060297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.368+0000 7f27a19e2640 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c61390 0x564306029cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27a21e3640 1 -- 172.21.15.47:0/1302614530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c82070 msgr2=0x564306029270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27a21e3640 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c82070 0x564306029270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27a21e3640 1 -- 172.21.15.47:0/1302614530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c61390 msgr2=0x564306029cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27a21e3640 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c61390 0x564306029cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27a21e3640 1 -- 172.21.15.47:0/1302614530 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564305ced650 con 0x564305c591b0 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27a21e3640 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x5643060297b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f27980e50e0 tx=0x7f27980edbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac0b7f759d8eb621 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27937fe640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27880b6510 0x7f27880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27a19e2640 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c61390 0x564306029cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f2790d9a640 1 -- 172.21.15.47:0/1302614530 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980fa070 con 0x564305c591b0 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f27a29e4640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27880b6510 0x7f27880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f2790d9a640 1 -- 172.21.15.47:0/1302614530 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2798010720 con 0x564305c591b0 2024-09-21T01:03:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.369+0000 7f2790d9a640 1 -- 172.21.15.47:0/1302614530 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980acfc0 con 0x564305c591b0 2024-09-21T01:03:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.370+0000 7f27937fe640 1 -- 172.21.15.47:0/3129206091 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f27980e7570 con 0x7f279c103b90 2024-09-21T01:03:33.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.370+0000 7f27aa9bb740 1 -- 172.21.15.47:0/1302614530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 msgr2=0x5643060297b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.370+0000 7f27a29e4640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27880b6510 0x7f27880b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2794005c40 tx=0x7f27940095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.370+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x5643060297b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f27980e50e0 tx=0x7f27980edbb0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 -- 172.21.15.47:0/1302614530 shutdown_connections 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c61390 0x564306029cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x5643060297b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/1302614530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c82070 0x564306029270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 -- 172.21.15.47:0/1302614530 >> 172.21.15.47:0/1302614530 conn(0x564305c76460 msgr2=0x564306027080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 -- 172.21.15.47:0/1302614530 shutdown_connections 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 -- 172.21.15.47:0/1302614530 wait complete. 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 -- start start 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.371+0000 7f27aa9bb740 1 Processor -- start 2024-09-21T01:03:33.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x56430603d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 0x56430603d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564305df0700 con 0x564305c82070 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27a21e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x56430603d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x564305f2a110 con 0x564305c61390 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27a29e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27a19e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 0x56430603d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564306040180 con 0x564305c591b0 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27a21e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x56430603d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:59008/0 (socket says 172.21.15.47:59008) 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27a21e3640 1 -- 172.21.15.47:0/4214972487 learned_addr learned my addr 172.21.15.47:0/4214972487 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.372+0000 7f27aa9bb740 10 client.0 _ll_register_callbacks cb 0x564305f43990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f27a29e4640 1 -- 172.21.15.47:0/4214972487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 msgr2=0x56430603d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:33.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f27a29e4640 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x56430603d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f27a29e4640 1 -- 172.21.15.47:0/4214972487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 msgr2=0x56430603d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f27a29e4640 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 0x56430603d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f27a29e4640 1 -- 172.21.15.47:0/4214972487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564305f57c40 con 0x564305c82070 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f27aa9bb740 1 -- 172.21.15.47:0/4214972487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564305fa1da0 con 0x564305c82070 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f27a29e4640 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060494b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f279400b730 tx=0x7f2794004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13869121012a2c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f2785ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f2785ffb640 1 -- 172.21.15.47:0/4214972487 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279402a060 con 0x564305c82070 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.373+0000 7f2785ffb640 1 -- 172.21.15.47:0/4214972487 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f279401a670 con 0x564305c82070 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f2785ffb640 1 -- 172.21.15.47:0/4214972487 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f279401a8b0 con 0x564305c82070 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27aa9bb740 10 client.15903 fetch_fsmap learned FSMap version 19 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27aa9bb740 1 -- 172.21.15.47:0/4214972487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56430604be10 con 0x564305c82070 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f2785ffb640 1 -- 172.21.15.47:0/4214972487 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f279400b040 con 0x564305c82070 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27aa9bb740 10 client.15903 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27aa9bb740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27aa9bb740 20 client.15903 populate_metadata read hostname 'smithi047' 2024-09-21T01:03:33.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564305c409f0 0x56430604f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27aa9bb740 4 client.15903 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:33.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27aa9bb740 1 -- 172.21.15.47:0/4214972487 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564305f9d850 con 0x564305c409f0 2024-09-21T01:03:33.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.374+0000 7f27a21e3640 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564305c409f0 0x56430604f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.375+0000 7f27a21e3640 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564305c409f0 0x56430604f1f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00dc8645189ca45 server_cookie=fb1f17af801f7af4 in_seq=0 out_seq=0 2024-09-21T01:03:33.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.375+0000 7f2785ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f2785ffb640 1 -- 172.21.15.47:0/4214972487 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564305f9d850 con 0x564305c409f0 2024-09-21T01:03:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f2785ffb640 10 client.15903 handle_command_reply: tid=0 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 client.15903 shutdown 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 -- 172.21.15.47:0/4214972487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 msgr2=0x5643060494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060494b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f279400b730 tx=0x7f2794004ab0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 -- 172.21.15.47:0/4214972487 shutdown_connections 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564305c409f0 0x56430604f1f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060494b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 0x56430603d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/4214972487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c591b0 0x56430603d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f2785ffb640 0 client.15903 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 -- 172.21.15.47:0/4214972487 >> 172.21.15.47:0/4214972487 conn(0x564305c76460 msgr2=0x56430602c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 -- 172.21.15.47:0/4214972487 shutdown_connections 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.376+0000 7f27aa9bb740 1 -- 172.21.15.47:0/4214972487 wait complete. 2024-09-21T01:03:33.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.377+0000 7f27aa9bb740 20 client.15903 trim_cache size 0 max 16384 2024-09-21T01:03:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.398+0000 7f27aa9bb740 1 Processor -- start 2024-09-21T01:03:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27aa9bb740 1 -- start start 2024-09-21T01:03:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c591b0 0x56430603d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 0x56430603a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c82070 0x56430603a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ab1d0 con 0x564305c591b0 2024-09-21T01:03:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ada50 con 0x564305c61390 2024-09-21T01:03:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ab840 con 0x564305c82070 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a21e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c591b0 0x56430603d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a21e3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c591b0 0x56430603d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48768/0 (socket says 172.21.15.47:48768) 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a21e3640 1 -- 172.21.15.47:0/2277222194 learned_addr learned my addr 172.21.15.47:0/2277222194 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a19e2640 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 0x56430603a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a29e4640 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c82070 0x56430603a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a21e3640 1 -- 172.21.15.47:0/2277222194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c82070 msgr2=0x56430603a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a21e3640 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c82070 0x56430603a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a21e3640 1 -- 172.21.15.47:0/2277222194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 msgr2=0x56430603a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a21e3640 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 0x56430603a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.399+0000 7f27a21e3640 1 -- 172.21.15.47:0/2277222194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430603c080 con 0x564305c591b0 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.400+0000 7f27a21e3640 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c591b0 0x56430603d5e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f27980aaac0 tx=0x7f279800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce8b7463111e370 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.400+0000 7f2787fff640 1 -- 172.21.15.47:0/2277222194 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798013190 con 0x564305c591b0 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.400+0000 7f2787fff640 1 -- 172.21.15.47:0/2277222194 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27980152d0 con 0x564305c591b0 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.400+0000 7f2787fff640 1 -- 172.21.15.47:0/2277222194 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980133d0 con 0x564305c591b0 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2277222194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c591b0 msgr2=0x56430603d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c591b0 0x56430603d5e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f27980aaac0 tx=0x7f279800cef0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2277222194 shutdown_connections 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c82070 0x56430603a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c61390 0x56430603a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2277222194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c591b0 0x56430603d5e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2277222194 >> 172.21.15.47:0/2277222194 conn(0x564305c76460 msgr2=0x56430603ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2277222194 shutdown_connections 2024-09-21T01:03:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.401+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2277222194 wait complete. 2024-09-21T01:03:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.402+0000 7f27aa9bb740 1 -- start start 2024-09-21T01:03:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.402+0000 7f27aa9bb740 1 Processor -- start 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.402+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c591b0 0x564306045b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.402+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c61390 0x5643060410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27aa9bb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1abf10 con 0x564305c82070 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ad380 con 0x564305c591b0 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27aa9bb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ac5e0 con 0x564305c61390 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27aa9bb740 10 client.0 _ll_register_callbacks cb 0x7f279400ff50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a19e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c61390 0x5643060410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a19e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c61390 0x5643060410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:59024/0 (socket says 172.21.15.47:59024) 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a19e2640 1 -- 172.21.15.47:0/2733683614 learned_addr learned my addr 172.21.15.47:0/2733683614 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a21e3640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c591b0 0x564306045b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a29e4640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a19e2640 1 -- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c591b0 msgr2=0x564306045b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a19e2640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c591b0 0x564306045b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a19e2640 1 -- 172.21.15.47:0/2733683614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 msgr2=0x5643060415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a19e2640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a19e2640 1 -- 172.21.15.47:0/2733683614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564306041c80 con 0x564305c61390 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a29e4640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.403+0000 7f27a21e3640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c591b0 0x564306045b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.404+0000 7f27a19e2640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c61390 0x5643060410a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f278c02c010 tx=0x7f278c030d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcd98329e5023db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.404+0000 7f2785ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:03:33.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.404+0000 7f2785ffb640 1 -- 172.21.15.47:0/2733683614 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c037040 con 0x564305c61390 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.404+0000 7f2785ffb640 1 -- 172.21.15.47:0/2733683614 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f278c004450 con 0x564305c61390 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.404+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2733683614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564305f9ac80 con 0x564305c61390 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.404+0000 7f2785ffb640 1 -- 172.21.15.47:0/2733683614 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f278c030450 con 0x564305c61390 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.404+0000 7f27aa9bb740 10 client.25597 fetch_fsmap learned FSMap version 19 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.404+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2733683614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5643060b9a60 con 0x564305c61390 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f2785ffb640 1 -- 172.21.15.47:0/2733683614 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564305f9ac80 con 0x564305c61390 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f2785ffb640 1 -- 172.21.15.47:0/2733683614 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f278c03d040 con 0x564305c61390 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f27aa9bb740 10 client.25597 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f27aa9bb740 10 client.25597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f27aa9bb740 20 client.25597 populate_metadata read hostname 'smithi047' 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564305c15da0 0x5643060bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f27aa9bb740 4 client.25597 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:03:33.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2733683614 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564305f10a50 con 0x564305c15da0 2024-09-21T01:03:33.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.405+0000 7f27a21e3640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564305c15da0 0x5643060bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:33.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f2785ffb640 10 client.25597 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:33.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27a21e3640 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564305c15da0 0x5643060bc2a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=550e5ea67097ed79 server_cookie=a32b7b6aeabbe0d8 in_seq=0 out_seq=0 2024-09-21T01:03:33.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f2785ffb640 1 -- 172.21.15.47:0/2733683614 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x564305f10a50 con 0x564305c15da0 2024-09-21T01:03:33.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f2785ffb640 10 client.25597 handle_command_reply: tid=0 2024-09-21T01:03:33.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 client.25597 shutdown 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2733683614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c61390 msgr2=0x5643060410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c61390 0x5643060410a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f278c02c010 tx=0x7f278c030d80 comp rx=0 tx=0).stop 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2733683614 shutdown_connections 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x564305c15da0 0x5643060bc2a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564305c82070 0x5643060415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564305c61390 0x5643060410a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 --2- 172.21.15.47:0/2733683614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564305c591b0 0x564306045b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f2785ffb640 0 client.25597 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2733683614 >> 172.21.15.47:0/2733683614 conn(0x564305c76460 msgr2=0x56430602a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2733683614 shutdown_connections 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 1 -- 172.21.15.47:0/2733683614 wait complete. 2024-09-21T01:03:33.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.406+0000 7f27aa9bb740 20 client.25597 trim_cache size 0 max 16384 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "d3e1990b-bd4b-4192-9c40-656f04b77a20", 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:03:33.413 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:33.414 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:33.415 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:03:33.416 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:03:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 -- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27880b6510 msgr2=0x7f27880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27880b6510 0x7f27880b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2794005c40 tx=0x7f27940095c0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 -- 172.21.15.47:0/3129206091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f279c103b90 msgr2=0x7f279c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f279c103b90 0x7f279c075710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f279800e9f0 tx=0x7f279800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 -- 172.21.15.47:0/3129206091 shutdown_connections 2024-09-21T01:03:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f27880b6510 0x7f27880b8a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f279c109e20 0x7f279c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c1094d0 0x7f279c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 --2- 172.21.15.47:0/3129206091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f279c103b90 0x7f279c075710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:33.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 -- 172.21.15.47:0/3129206091 >> 172.21.15.47:0/3129206091 conn(0x7f279c0ff5e0 msgr2=0x7f279c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:33.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 -- 172.21.15.47:0/3129206091 shutdown_connections 2024-09-21T01:03:33.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:03:33.407+0000 7f27a4447640 1 -- 172.21.15.47:0/3129206091 wait complete. 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.167+0000 7f66d42ec640 1 -- 172.21.15.47:0/171403935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 msgr2=0x7f66cc106310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.167+0000 7f66d42ec640 1 --2- 172.21.15.47:0/171403935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 0x7f66cc106310 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009900 tx=0x7f66c802a410 comp rx=0 tx=0).stop 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 -- 172.21.15.47:0/171403935 shutdown_connections 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 --2- 172.21.15.47:0/171403935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66cc109410 0x7f66cc10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 --2- 172.21.15.47:0/171403935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc106850 0x7f66cc108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 --2- 172.21.15.47:0/171403935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 0x7f66cc106310 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 -- 172.21.15.47:0/171403935 >> 172.21.15.47:0/171403935 conn(0x7f66cc0fdf30 msgr2=0x7f66cc1003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 -- 172.21.15.47:0/171403935 shutdown_connections 2024-09-21T01:03:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 -- 172.21.15.47:0/171403935 wait complete. 2024-09-21T01:03:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 Processor -- start 2024-09-21T01:03:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 -- start start 2024-09-21T01:03:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 0x7f66cc199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc106850 0x7f66cc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.168+0000 7f66d42ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66cc109410 0x7f66cc19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d42ec640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc10f340 con 0x7f66cc06c4b0 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d42ec640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc10f1c0 con 0x7f66cc106850 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d42ec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc10f4c0 con 0x7f66cc109410 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 0x7f66cc199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 0x7f66cc199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48798/0 (socket says 172.21.15.47:48798) 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 -- 172.21.15.47:0/2045901281 learned_addr learned my addr 172.21.15.47:0/2045901281 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d1887640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc106850 0x7f66cc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2889640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66cc109410 0x7f66cc19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 -- 172.21.15.47:0/2045901281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66cc109410 msgr2=0x7f66cc19b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66cc109410 0x7f66cc19b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 -- 172.21.15.47:0/2045901281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc106850 msgr2=0x7f66cc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc106850 0x7f66cc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 -- 172.21.15.47:0/2045901281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc19b9d0 con 0x7f66cc06c4b0 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2889640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66cc109410 0x7f66cc19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d2088640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 0x7f66cc199f90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f66c8006010 tx=0x7f66c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66c37fe640 1 -- 172.21.15.47:0/2045901281 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c803f030 con 0x7f66cc06c4b0 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66c37fe640 1 -- 172.21.15.47:0/2045901281 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66c8031910 con 0x7f66cc06c4b0 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d42ec640 1 -- 172.21.15.47:0/2045901281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc19bc60 con 0x7f66cc06c4b0 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66c37fe640 1 -- 172.21.15.47:0/2045901281 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8035070 con 0x7f66cc06c4b0 2024-09-21T01:03:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.169+0000 7f66d42ec640 1 -- 172.21.15.47:0/2045901281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc1a23b0 con 0x7f66cc06c4b0 2024-09-21T01:03:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66db25b740 1 Processor -- start 2024-09-21T01:03:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66db25b740 1 -- start start 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66c37fe640 1 -- 172.21.15.47:0/2045901281 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f66c8042030 con 0x7f66cc06c4b0 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66db25b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66db25b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66db25b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66db25b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d82053f6f0 con 0x55d8202251b0 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66db25b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55d82052eb20 con 0x55d8201fc2f0 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.173+0000 7f66db25b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d820532930 con 0x55d8202044d0 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2088640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48804/0 (socket says 172.21.15.47:48804) 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 -- 172.21.15.47:0/2474771936 learned_addr learned my addr 172.21.15.47:0/2474771936 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d1887640 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 -- 172.21.15.47:0/2474771936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 msgr2=0x55d8205ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 -- 172.21.15.47:0/2474771936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 msgr2=0x55d8205cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 -- 172.21.15.47:0/2474771936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8204f4530 con 0x55d8202251b0 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2088640 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66d2889640 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205cce50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f66c4009fd0 tx=0x7f66c40108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b339fe267e1322 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66c0bfe640 1 -- 172.21.15.47:0/2474771936 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4011760 con 0x55d8202251b0 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66c37fe640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f66b80b6590 0x7f66b80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66c0bfe640 1 -- 172.21.15.47:0/2474771936 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66c4011db0 con 0x55d8202251b0 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.174+0000 7f66c0bfe640 1 -- 172.21.15.47:0/2474771936 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c400e3c0 con 0x55d8202251b0 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66d2088640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f66b80b6590 0x7f66b80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66c37fe640 1 -- 172.21.15.47:0/2045901281 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f66c81077d0 con 0x7f66cc06c4b0 2024-09-21T01:03:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66db25b740 1 -- 172.21.15.47:0/2474771936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 msgr2=0x55d8205cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66db25b740 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205cce50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f66c4009fd0 tx=0x7f66c40108e0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66d2088640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f66b80b6590 0x7f66b80b8aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f66c80cd990 tx=0x7f66c810d530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66db25b740 1 -- 172.21.15.47:0/2474771936 shutdown_connections 2024-09-21T01:03:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66db25b740 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66db25b740 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66db25b740 1 --2- 172.21.15.47:0/2474771936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205cce50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.175+0000 7f66db25b740 1 -- 172.21.15.47:0/2474771936 >> 172.21.15.47:0/2474771936 conn(0x55d820219300 msgr2=0x55d8205c88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 -- 172.21.15.47:0/2474771936 shutdown_connections 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 -- 172.21.15.47:0/2474771936 wait complete. 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 -- start start 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 Processor -- start 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205d6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205d6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202251b0 0x55d8205d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d820466ab0 con 0x55d8201fc2f0 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55d8204d4730 con 0x55d8202251b0 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d8205ceb30 con 0x55d8202044d0 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66d2889640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66db25b740 10 client.0 _ll_register_callbacks cb 0x55d8205286b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66d2889640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205d6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48806/0 (socket says 172.21.15.47:48806) 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66d2889640 1 -- 172.21.15.47:0/1704436698 learned_addr learned my addr 172.21.15.47:0/1704436698 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.176+0000 7f66d1887640 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205d6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66d2889640 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202251b0 0x55d8205d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66d2889640 1 -- 172.21.15.47:0/1704436698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 msgr2=0x55d8205d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66d2889640 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205d6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66d2889640 1 -- 172.21.15.47:0/1704436698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202251b0 msgr2=0x55d8205d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66d2889640 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202251b0 0x55d8205d7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66d2889640 1 -- 172.21.15.47:0/1704436698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d820290790 con 0x55d8201fc2f0 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66d2889640 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205d6600 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f66c401b790 tx=0x7f66c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef2037b09befea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66b5ffb640 1 -- 172.21.15.47:0/1704436698 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4011970 con 0x55d8201fc2f0 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66b5ffb640 1 -- 172.21.15.47:0/1704436698 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f66c4011b10 con 0x55d8201fc2f0 2024-09-21T01:03:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66db25b740 1 -- 172.21.15.47:0/1704436698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66c4011db0 con 0x55d8201fc2f0 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66b5ffb640 1 -- 172.21.15.47:0/1704436698 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f66c4005040 con 0x55d8201fc2f0 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66db25b740 10 client.15921 fetch_fsmap learned FSMap version 19 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66db25b740 1 -- 172.21.15.47:0/1704436698 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d820309620 con 0x55d8201fc2f0 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.177+0000 7f66b5ffb640 1 -- 172.21.15.47:0/1704436698 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66c4011db0 con 0x55d8201fc2f0 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66b5ffb640 1 -- 172.21.15.47:0/1704436698 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f66c4029020 con 0x55d8201fc2f0 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66db25b740 10 client.15921 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66db25b740 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66db25b740 20 client.15921 populate_metadata read hostname 'smithi047' 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66db25b740 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d8201e3d80 0x55d8205e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66db25b740 4 client.15921 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66db25b740 1 -- 172.21.15.47:0/1704436698 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d820541640 con 0x55d8201e3d80 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66d1887640 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d8201e3d80 0x55d8205e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66b5ffb640 10 client.15921 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.178+0000 7f66d1887640 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d8201e3d80 0x55d8205e3a20 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a82cc974080b513a server_cookie=ae121fba977c5b27 in_seq=0 out_seq=0 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66b5ffb640 1 -- 172.21.15.47:0/1704436698 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d820541640 con 0x55d8201e3d80 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66b5ffb640 10 client.15921 handle_command_reply: tid=0 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 client.15921 shutdown 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 -- 172.21.15.47:0/1704436698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 msgr2=0x55d8205d6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205d6600 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f66c401b790 tx=0x7f66c4009bb0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 -- 172.21.15.47:0/1704436698 shutdown_connections 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d8201e3d80 0x55d8205e3a20 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202251b0 0x55d8205d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205d6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 --2- 172.21.15.47:0/1704436698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205d6600 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66b5ffb640 0 client.15921 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 -- 172.21.15.47:0/1704436698 >> 172.21.15.47:0/1704436698 conn(0x55d820219300 msgr2=0x55d8205cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 -- 172.21.15.47:0/1704436698 shutdown_connections 2024-09-21T01:03:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 1 -- 172.21.15.47:0/1704436698 wait complete. 2024-09-21T01:03:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.179+0000 7f66db25b740 20 client.15921 trim_cache size 0 max 16384 2024-09-21T01:03:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66db25b740 1 Processor -- start 2024-09-21T01:03:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66db25b740 1 -- start start 2024-09-21T01:03:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66db25b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205d5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66db25b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205d5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66db25b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66db25b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc1a8e10 con 0x55d8202251b0 2024-09-21T01:03:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66db25b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc1ab670 con 0x55d8201fc2f0 2024-09-21T01:03:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66db25b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc1a9460 con 0x55d8202044d0 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66d2889640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66d2889640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205d5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66d2889640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205d5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:51348/0 (socket says 172.21.15.47:51348) 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66d2889640 1 -- 172.21.15.47:0/1712135723 learned_addr learned my addr 172.21.15.47:0/1712135723 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.196+0000 7f66d1887640 1 --2- 172.21.15.47:0/1712135723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66d2889640 1 -- 172.21.15.47:0/1712135723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 msgr2=0x55d8205d5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66d2889640 1 --2- 172.21.15.47:0/1712135723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205d5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66d2889640 1 -- 172.21.15.47:0/1712135723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 msgr2=0x55d8205ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66d2889640 1 --2- 172.21.15.47:0/1712135723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66d2889640 1 -- 172.21.15.47:0/1712135723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8205de7d0 con 0x55d8201fc2f0 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66d2889640 1 --2- 172.21.15.47:0/1712135723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205d5220 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66c401cc40 tx=0x7f66c4005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d0d4a46d2e0a6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66b7fff640 1 -- 172.21.15.47:0/1712135723 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c403c070 con 0x55d8201fc2f0 2024-09-21T01:03:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66b7fff640 1 -- 172.21.15.47:0/1712135723 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66c4020030 con 0x55d8201fc2f0 2024-09-21T01:03:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.197+0000 7f66b7fff640 1 -- 172.21.15.47:0/1712135723 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4005440 con 0x55d8201fc2f0 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 -- 172.21.15.47:0/1712135723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 msgr2=0x55d8205d5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 --2- 172.21.15.47:0/1712135723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205d5220 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66c401cc40 tx=0x7f66c4005fd0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 -- 172.21.15.47:0/1712135723 shutdown_connections 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 --2- 172.21.15.47:0/1712135723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8202251b0 0x55d8205ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 --2- 172.21.15.47:0/1712135723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202044d0 0x55d8205d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 --2- 172.21.15.47:0/1712135723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8201fc2f0 0x55d8205d5220 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 -- 172.21.15.47:0/1712135723 >> 172.21.15.47:0/1712135723 conn(0x55d820219300 msgr2=0x55d8205d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 -- 172.21.15.47:0/1712135723 shutdown_connections 2024-09-21T01:03:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 -- 172.21.15.47:0/1712135723 wait complete. 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 -- start start 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.198+0000 7f66db25b740 1 Processor -- start 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66db25b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205db610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66db25b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202044d0 0x55d8205dbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66db25b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202251b0 0x55d8205dc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66db25b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc1a9b30 con 0x55d8201fc2f0 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66db25b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc1aafa0 con 0x55d8202044d0 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66db25b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc1aa200 con 0x55d8202251b0 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66db25b740 10 client.0 _ll_register_callbacks cb 0x7f66c810d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205db610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205db610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48824/0 (socket says 172.21.15.47:48824) 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 -- 172.21.15.47:0/756397852 learned_addr learned my addr 172.21.15.47:0/756397852 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d1887640 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202044d0 0x55d8205dbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202251b0 0x55d8205dc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 -- 172.21.15.47:0/756397852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202251b0 msgr2=0x55d8205dc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202251b0 0x55d8205dc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 -- 172.21.15.47:0/756397852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202044d0 msgr2=0x55d8205dbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202044d0 0x55d8205dbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 -- 172.21.15.47:0/756397852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8205dcf30 con 0x55d8201fc2f0 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66d2889640 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205db610 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f66c4010920 tx=0x7f66c4009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f76657cae4feb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66b5ffb640 1 -- 172.21.15.47:0/756397852 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c403c040 con 0x55d8201fc2f0 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66b5ffb640 1 -- 172.21.15.47:0/756397852 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f66c40051e0 con 0x55d8201fc2f0 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.199+0000 7f66db25b740 1 -- 172.21.15.47:0/756397852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66c4020030 con 0x55d8201fc2f0 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66b5ffb640 1 -- 172.21.15.47:0/756397852 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f66c4057050 con 0x55d8201fc2f0 2024-09-21T01:03:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66db25b740 10 client.15927 fetch_fsmap learned FSMap version 19 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66db25b740 1 -- 172.21.15.47:0/756397852 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d8205dcf30 con 0x55d8201fc2f0 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66b5ffb640 1 -- 172.21.15.47:0/756397852 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66c4020030 con 0x55d8201fc2f0 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66b5ffb640 1 -- 172.21.15.47:0/756397852 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f66c404f020 con 0x55d8201fc2f0 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66db25b740 10 client.15927 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66db25b740 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66db25b740 20 client.15927 populate_metadata read hostname 'smithi047' 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66db25b740 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d8201b91c0 0x55d8206502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66db25b740 4 client.15927 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66db25b740 1 -- 172.21.15.47:0/756397852 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d82053d0f0 con 0x55d8201b91c0 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.200+0000 7f66d1887640 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d8201b91c0 0x55d8206502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.201+0000 7f66b5ffb640 10 client.15927 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:34.201+0000 7f66d1887640 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d8201b91c0 0x55d8206502c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0821adcf963310 server_cookie=1f65c74228630295 in_seq=0 out_seq=0 2024-09-21T01:03:34.416 INFO:tasks.cephfs.filesystem:scrub status for tag:d3e1990b-bd4b-4192-9c40-656f04b77a20 - {'path': '/', 'tag': 'd3e1990b-bd4b-4192-9c40-656f04b77a20', 'options': 'recursive,force'} 2024-09-21T01:03:35.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:34 smithi047 ceph-mon[30960]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 45 MiB/s wr, 5.72k op/s 2024-09-21T01:03:35.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:34 smithi134 ceph-mon[34785]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 45 MiB/s wr, 5.72k op/s 2024-09-21T01:03:35.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:34 smithi114 ceph-mon[34309]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 45 MiB/s wr, 5.72k op/s 2024-09-21T01:03:37.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:36 smithi047 ceph-mon[30960]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 38 MiB/s wr, 4.84k op/s 2024-09-21T01:03:37.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:36 smithi134 ceph-mon[34785]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 38 MiB/s wr, 4.84k op/s 2024-09-21T01:03:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:36 smithi114 ceph-mon[34309]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 38 MiB/s wr, 4.84k op/s 2024-09-21T01:03:39.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:38 smithi047 ceph-mon[30960]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 49 MiB/s wr, 6.24k op/s 2024-09-21T01:03:39.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:38 smithi134 ceph-mon[34785]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 49 MiB/s wr, 6.24k op/s 2024-09-21T01:03:39.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:38 smithi114 ceph-mon[34309]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 49 MiB/s wr, 6.24k op/s 2024-09-21T01:03:41.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:40 smithi047 ceph-mon[30960]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 41 MiB/s wr, 5.24k op/s 2024-09-21T01:03:41.210 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:40 smithi114 ceph-mon[34309]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 41 MiB/s wr, 5.24k op/s 2024-09-21T01:03:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:40 smithi134 ceph-mon[34785]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 41 MiB/s wr, 5.24k op/s 2024-09-21T01:03:43.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:42 smithi047 ceph-mon[30960]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 41 MiB/s wr, 5.23k op/s 2024-09-21T01:03:43.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:42 smithi134 ceph-mon[34785]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 41 MiB/s wr, 5.23k op/s 2024-09-21T01:03:43.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:42 smithi114 ceph-mon[34309]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 41 MiB/s wr, 5.23k op/s 2024-09-21T01:03:45.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:44 smithi047 ceph-mon[30960]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 45 MiB/s wr, 5.69k op/s 2024-09-21T01:03:45.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:44 smithi134 ceph-mon[34785]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 45 MiB/s wr, 5.69k op/s 2024-09-21T01:03:45.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:44 smithi114 ceph-mon[34309]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 45 MiB/s wr, 5.69k op/s 2024-09-21T01:03:47.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:46 smithi047 ceph-mon[30960]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 36 MiB/s wr, 4.62k op/s 2024-09-21T01:03:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:46 smithi134 ceph-mon[34785]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 36 MiB/s wr, 4.62k op/s 2024-09-21T01:03:47.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:46 smithi114 ceph-mon[34309]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 36 MiB/s wr, 4.62k op/s 2024-09-21T01:03:49.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:48 smithi047 ceph-mon[30960]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 45 MiB/s wr, 5.76k op/s 2024-09-21T01:03:49.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:48 smithi134 ceph-mon[34785]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 45 MiB/s wr, 5.76k op/s 2024-09-21T01:03:49.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:48 smithi114 ceph-mon[34309]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 45 MiB/s wr, 5.76k op/s 2024-09-21T01:03:51.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:50 smithi047 ceph-mon[30960]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 34 MiB/s wr, 4.20k op/s 2024-09-21T01:03:51.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:50 smithi134 ceph-mon[34785]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 34 MiB/s wr, 4.20k op/s 2024-09-21T01:03:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:50 smithi114 ceph-mon[34309]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 34 MiB/s wr, 4.20k op/s 2024-09-21T01:03:53.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:52 smithi047 ceph-mon[30960]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 37 MiB/s wr, 4.62k op/s 2024-09-21T01:03:53.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:52 smithi134 ceph-mon[34785]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 37 MiB/s wr, 4.62k op/s 2024-09-21T01:03:53.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:52 smithi114 ceph-mon[34309]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 37 MiB/s wr, 4.62k op/s 2024-09-21T01:03:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:54 smithi047 ceph-mon[30960]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 36 MiB/s wr, 4.53k op/s 2024-09-21T01:03:55.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:54 smithi047 ceph-mon[30960]: scrub summary: idle 2024-09-21T01:03:55.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:54 smithi134 ceph-mon[34785]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 36 MiB/s wr, 4.53k op/s 2024-09-21T01:03:55.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:54 smithi134 ceph-mon[34785]: scrub summary: idle 2024-09-21T01:03:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:54 smithi114 ceph-mon[34309]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 36 MiB/s wr, 4.53k op/s 2024-09-21T01:03:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:54 smithi114 ceph-mon[34309]: scrub summary: idle 2024-09-21T01:03:57.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:56 smithi047 ceph-mon[30960]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 31 MiB/s wr, 3.93k op/s 2024-09-21T01:03:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:56 smithi134 ceph-mon[34785]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 31 MiB/s wr, 3.93k op/s 2024-09-21T01:03:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:56 smithi114 ceph-mon[34309]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 31 MiB/s wr, 3.93k op/s 2024-09-21T01:03:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.069+0000 7f66b5ffb640 1 -- 172.21.15.47:0/756397852 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d82053d0f0 con 0x55d8201b91c0 2024-09-21T01:03:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.069+0000 7f66b5ffb640 10 client.15927 handle_command_reply: tid=0 2024-09-21T01:03:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.069+0000 7f66db25b740 1 client.15927 shutdown 2024-09-21T01:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66db25b740 1 -- 172.21.15.47:0/756397852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 msgr2=0x55d8205db610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66db25b740 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205db610 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f66c4010920 tx=0x7f66c4009280 comp rx=0 tx=0).stop 2024-09-21T01:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66db25b740 1 -- 172.21.15.47:0/756397852 shutdown_connections 2024-09-21T01:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66db25b740 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d8201b91c0 0x55d8206502c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66db25b740 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d8202251b0 0x55d8205dc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66db25b740 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8202044d0 0x55d8205dbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66db25b740 1 --2- 172.21.15.47:0/756397852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8201fc2f0 0x55d8205db610 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66db25b740 1 -- 172.21.15.47:0/756397852 >> 172.21.15.47:0/756397852 conn(0x55d820219300 msgr2=0x55d8205ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.071+0000 7f66b5ffb640 0 client.15927 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.072+0000 7f66db25b740 1 -- 172.21.15.47:0/756397852 shutdown_connections 2024-09-21T01:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.072+0000 7f66db25b740 1 -- 172.21.15.47:0/756397852 wait complete. 2024-09-21T01:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.073+0000 7f66db25b740 20 client.15927 trim_cache size 0 max 16384 2024-09-21T01:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:03:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:03:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.074+0000 7f66d42ec640 1 -- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f66b80b6590 msgr2=0x7f66b80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.074+0000 7f66d42ec640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f66b80b6590 0x7f66b80b8aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f66c80cd990 tx=0x7f66c810d530 comp rx=0 tx=0).stop 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.074+0000 7f66d42ec640 1 -- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 msgr2=0x7f66cc199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.074+0000 7f66d42ec640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 0x7f66cc199f90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f66c8006010 tx=0x7f66c80042f0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.075+0000 7f66d42ec640 1 -- 172.21.15.47:0/2045901281 shutdown_connections 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.075+0000 7f66d42ec640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f66b80b6590 0x7f66b80b8aa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.075+0000 7f66d42ec640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66cc109410 0x7f66cc19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.075+0000 7f66d42ec640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc106850 0x7f66cc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.075+0000 7f66d42ec640 1 --2- 172.21.15.47:0/2045901281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66cc06c4b0 0x7f66cc199f90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.075+0000 7f66d42ec640 1 -- 172.21.15.47:0/2045901281 >> 172.21.15.47:0/2045901281 conn(0x7f66cc0fdf30 msgr2=0x7f66cc104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.075+0000 7f66d42ec640 1 -- 172.21.15.47:0/2045901281 shutdown_connections 2024-09-21T01:03:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:03:59.075+0000 7f66d42ec640 1 -- 172.21.15.47:0/2045901281 wait complete. 2024-09-21T01:03:59.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:58 smithi047 ceph-mon[30960]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 34 MiB/s wr, 4.21k op/s 2024-09-21T01:03:59.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:58 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:58 smithi134 ceph-mon[34785]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 34 MiB/s wr, 4.21k op/s 2024-09-21T01:03:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:58 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:03:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:58 smithi114 ceph-mon[34309]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 34 MiB/s wr, 4.21k op/s 2024-09-21T01:03:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:58 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:04:00.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:00.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:00.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:03:59 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:04:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:03:59 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:04:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:04:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:04:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:03:59 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:04:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:00 smithi134 ceph-mon[34785]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 4.04k op/s 2024-09-21T01:04:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:00 smithi114 ceph-mon[34309]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 4.04k op/s 2024-09-21T01:04:01.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:00 smithi047 ceph-mon[30960]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 4.04k op/s 2024-09-21T01:04:03.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:02 smithi134 ceph-mon[34785]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 4.18k op/s 2024-09-21T01:04:03.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:02 smithi114 ceph-mon[34309]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 4.18k op/s 2024-09-21T01:04:03.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:02 smithi047 ceph-mon[30960]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 4.18k op/s 2024-09-21T01:04:04.417 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:04:04.685 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:05.120 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:04 smithi047 ceph-mon[30960]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-09-21T01:04:05.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.249+0000 7faafef41640 1 -- 172.21.15.47:0/1479157403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810a9e0 msgr2=0x7faaf810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:05.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.249+0000 7faafef41640 1 --2- 172.21.15.47:0/1479157403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810a9e0 0x7faaf810adf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faaec009900 tx=0x7faaec02a420 comp rx=0 tx=0).stop 2024-09-21T01:04:05.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.249+0000 7faafef41640 1 -- 172.21.15.47:0/1479157403 shutdown_connections 2024-09-21T01:04:05.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.249+0000 7faafef41640 1 --2- 172.21.15.47:0/1479157403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf811cc30 0x7faaf811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.249+0000 7faafef41640 1 --2- 172.21.15.47:0/1479157403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810a9e0 0x7faaf810adf0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faaec009900 tx=0x7faaec02a420 comp rx=0 tx=0).stop 2024-09-21T01:04:05.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.249+0000 7faafef41640 1 --2- 172.21.15.47:0/1479157403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaf8111f40 0x7faaf810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.249+0000 7faafef41640 1 -- 172.21.15.47:0/1479157403 >> 172.21.15.47:0/1479157403 conn(0x7faaf8070ec0 msgr2=0x7faaf80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:05.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.251+0000 7faafef41640 1 -- 172.21.15.47:0/1479157403 shutdown_connections 2024-09-21T01:04:05.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.258+0000 7faafef41640 1 -- 172.21.15.47:0/1479157403 wait complete. 2024-09-21T01:04:05.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.259+0000 7faafef41640 1 Processor -- start 2024-09-21T01:04:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.266+0000 7faafef41640 1 -- start start 2024-09-21T01:04:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.266+0000 7faafef41640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaf811cc30 0x7faaf811a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.266+0000 7faafef41640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf8113820 0x7faaf8113c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.266+0000 7faafef41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf81142d0 0x7faaf81191c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.266+0000 7faafef41640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8122910 con 0x7faaf811cc30 2024-09-21T01:04:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.266+0000 7faafef41640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8122790 con 0x7faaf81142d0 2024-09-21T01:04:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.266+0000 7faafef41640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8122a90 con 0x7faaf8113820 2024-09-21T01:04:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.269+0000 7faafd4de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf81142d0 0x7faaf81191c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.270+0000 7faafd4de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf81142d0 0x7faaf81191c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56298/0 (socket says 172.21.15.47:56298) 2024-09-21T01:04:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.270+0000 7faafd4de640 1 -- 172.21.15.47:0/1726936873 learned_addr learned my addr 172.21.15.47:0/1726936873 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.271+0000 7faafccdd640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaf811cc30 0x7faaf811a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.272+0000 7faafccdd640 1 -- 172.21.15.47:0/1726936873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf8113820 msgr2=0x7faaf8113c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:04:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.272+0000 7faafccdd640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf8113820 0x7faaf8113c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.272+0000 7faafccdd640 1 -- 172.21.15.47:0/1726936873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf81142d0 msgr2=0x7faaf81191c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.272+0000 7faafccdd640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf81142d0 0x7faaf81191c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.272+0000 7faafccdd640 1 -- 172.21.15.47:0/1726936873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf8119a80 con 0x7faaf811cc30 2024-09-21T01:04:05.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.273+0000 7faafccdd640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaf811cc30 0x7faaf811a610 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faaf8075540 tx=0x7faae800b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.279+0000 7faaf5ffb640 1 -- 172.21.15.47:0/1726936873 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8015020 con 0x7faaf811cc30 2024-09-21T01:04:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.279+0000 7faaf5ffb640 1 -- 172.21.15.47:0/1726936873 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faae8011ce0 con 0x7faaf811cc30 2024-09-21T01:04:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.279+0000 7faaf5ffb640 1 -- 172.21.15.47:0/1726936873 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8010d30 con 0x7faaf811cc30 2024-09-21T01:04:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.279+0000 7faafef41640 1 -- 172.21.15.47:0/1726936873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf8119d10 con 0x7faaf811cc30 2024-09-21T01:04:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.280+0000 7faafef41640 1 -- 172.21.15.47:0/1726936873 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81beea0 con 0x7faaf811cc30 2024-09-21T01:04:05.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.294+0000 7fab054b5740 1 Processor -- start 2024-09-21T01:04:05.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.294+0000 7faaf5ffb640 1 -- 172.21.15.47:0/1726936873 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7faae8018020 con 0x7faaf811cc30 2024-09-21T01:04:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.296+0000 7fab054b5740 1 -- start start 2024-09-21T01:04:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.297+0000 7fab054b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc35a070 0x557cbc701650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.297+0000 7fab054b5740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc701b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.297+0000 7fab054b5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc7020d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.297+0000 7fab054b5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557cbc677e50 con 0x557cbc339390 2024-09-21T01:04:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.297+0000 7faafccdd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc701b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.297+0000 7faafccdd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc701b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56300/0 (socket says 172.21.15.47:56300) 2024-09-21T01:04:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.297+0000 7faafccdd640 1 -- 172.21.15.47:0/3334816601 learned_addr learned my addr 172.21.15.47:0/3334816601 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.297+0000 7fab054b5740 1 -- 172.21.15.47:0/3334816601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x557cbc667280 con 0x557cbc3311b0 2024-09-21T01:04:05.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.298+0000 7fab054b5740 1 -- 172.21.15.47:0/3334816601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557cbc66b090 con 0x557cbc35a070 2024-09-21T01:04:05.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.298+0000 7faaf7fff640 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc7020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.298+0000 7faafccdd640 1 -- 172.21.15.47:0/3334816601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc35a070 msgr2=0x557cbc701650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:05.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.298+0000 7faafccdd640 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc35a070 0x557cbc701650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.298+0000 7faafccdd640 1 -- 172.21.15.47:0/3334816601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 msgr2=0x557cbc7020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:05.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.298+0000 7faafccdd640 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc7020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.298+0000 7faafccdd640 1 -- 172.21.15.47:0/3334816601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cbc3c5650 con 0x557cbc3311b0 2024-09-21T01:04:05.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.299+0000 7faaf7fff640 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc7020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:04:05.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.299+0000 7faaf5ffb640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faae00b66e0 0x7faae00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.299+0000 7faafccdd640 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc701b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faae80ec750 tx=0x7faae80ecc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd5b532e77f9a65d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:05.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.300+0000 7faadeffd640 1 -- 172.21.15.47:0/3334816601 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80f9070 con 0x557cbc3311b0 2024-09-21T01:04:05.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.300+0000 7faafd4de640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faae00b66e0 0x7faae00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.300+0000 7faadeffd640 1 -- 172.21.15.47:0/3334816601 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faae80ac370 con 0x557cbc3311b0 2024-09-21T01:04:05.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.300+0000 7faadeffd640 1 -- 172.21.15.47:0/3334816601 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80a8700 con 0x557cbc3311b0 2024-09-21T01:04:05.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.302+0000 7fab054b5740 1 -- 172.21.15.47:0/3334816601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 msgr2=0x557cbc701b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:05.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.302+0000 7fab054b5740 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc701b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faae80ec750 tx=0x7faae80ecc10 comp rx=0 tx=0).stop 2024-09-21T01:04:05.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.302+0000 7faaf5ffb640 1 -- 172.21.15.47:0/1726936873 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7faae80e66d0 con 0x7faaf811cc30 2024-09-21T01:04:05.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.306+0000 7faafd4de640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faae00b66e0 0x7faae00b8bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009270 tx=0x7faaf0009b00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:05.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.307+0000 7fab054b5740 1 -- 172.21.15.47:0/3334816601 shutdown_connections 2024-09-21T01:04:05.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.307+0000 7fab054b5740 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc7020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.307+0000 7fab054b5740 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc701b90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.307+0000 7fab054b5740 1 --2- 172.21.15.47:0/3334816601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc35a070 0x557cbc701650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.307+0000 7fab054b5740 1 -- 172.21.15.47:0/3334816601 >> 172.21.15.47:0/3334816601 conn(0x557cbc34e460 msgr2=0x557cbc6ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:05.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.307+0000 7fab054b5740 1 -- 172.21.15.47:0/3334816601 shutdown_connections 2024-09-21T01:04:05.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.307+0000 7fab054b5740 1 -- 172.21.15.47:0/3334816601 wait complete. 2024-09-21T01:04:05.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.310+0000 7fab054b5740 1 -- start start 2024-09-21T01:04:05.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.310+0000 7fab054b5740 1 Processor -- start 2024-09-21T01:04:05.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.311+0000 7fab054b5740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc70cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.311+0000 7fab054b5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc70d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7fab054b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc35a070 0x557cbc70d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7faaf7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc70d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7faafccdd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc70cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7faafccdd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc70cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56312/0 (socket says 172.21.15.47:56312) 2024-09-21T01:04:05.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7faafccdd640 1 -- 172.21.15.47:0/1511608042 learned_addr learned my addr 172.21.15.47:0/1511608042 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:05.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7faaf7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc70d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43152/0 (socket says 172.21.15.47:43152) 2024-09-21T01:04:05.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557cbc4c8700 con 0x557cbc339390 2024-09-21T01:04:05.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x557cbc602110 con 0x557cbc3311b0 2024-09-21T01:04:05.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.312+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557cbc70fcb0 con 0x557cbc35a070 2024-09-21T01:04:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.313+0000 7fab054b5740 10 client.0 _ll_register_callbacks cb 0x557cbc61b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.313+0000 7faafccdd640 1 -- 172.21.15.47:0/1511608042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc35a070 msgr2=0x557cbc70d740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:04:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.313+0000 7faafccdd640 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc35a070 0x557cbc70d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.313+0000 7faafccdd640 1 -- 172.21.15.47:0/1511608042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 msgr2=0x557cbc70d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.313+0000 7faafccdd640 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc70d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.313+0000 7faafccdd640 1 -- 172.21.15.47:0/1511608042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cbc62fc40 con 0x557cbc3311b0 2024-09-21T01:04:05.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.313+0000 7faaf7fff640 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc70d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.320+0000 7faafccdd640 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc70cc80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faae80ec720 tx=0x7faae80a8d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6d71e8faed5f27d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.320+0000 7faadc7f8640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.323+0000 7faadc7f8640 1 -- 172.21.15.47:0/1511608042 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80abfd0 con 0x557cbc3311b0 2024-09-21T01:04:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.323+0000 7faadc7f8640 1 -- 172.21.15.47:0/1511608042 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7faae80b5ff0 con 0x557cbc3311b0 2024-09-21T01:04:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.323+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faae80ac370 con 0x557cbc3311b0 2024-09-21T01:04:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.323+0000 7faadc7f8640 1 -- 172.21.15.47:0/1511608042 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faae80ac1b0 con 0x557cbc3311b0 2024-09-21T01:04:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.324+0000 7fab054b5740 10 client.25604 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.324+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557cbc71b9b0 con 0x557cbc3311b0 2024-09-21T01:04:05.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.324+0000 7faadc7f8640 1 -- 172.21.15.47:0/1511608042 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faae80acf60 con 0x557cbc3311b0 2024-09-21T01:04:05.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.326+0000 7faadc7f8640 1 -- 172.21.15.47:0/1511608042 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faae80adb90 con 0x557cbc3311b0 2024-09-21T01:04:05.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.326+0000 7fab054b5740 10 client.25604 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:05.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.326+0000 7fab054b5740 10 client.25604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:05.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.326+0000 7fab054b5740 20 client.25604 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:05.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.326+0000 7fab054b5740 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x557cbc3189f0 0x557cbc71edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.326+0000 7fab054b5740 4 client.25604 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:05.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.326+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faae80ac370 con 0x557cbc3189f0 2024-09-21T01:04:05.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.327+0000 7faaf7fff640 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x557cbc3189f0 0x557cbc71edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.328+0000 7faaf7fff640 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x557cbc3189f0 0x557cbc71edb0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58d7a7ab89249bcd server_cookie=a7c54f20f6897bd2 in_seq=0 out_seq=0 2024-09-21T01:04:05.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.328+0000 7faadc7f8640 10 client.25604 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:05.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.330+0000 7faadc7f8640 1 -- 172.21.15.47:0/1511608042 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7faae80ac370 con 0x557cbc3189f0 2024-09-21T01:04:05.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.330+0000 7faadc7f8640 10 client.25604 handle_command_reply: tid=0 2024-09-21T01:04:05.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.330+0000 7fab054b5740 1 client.25604 shutdown 2024-09-21T01:04:05.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.333+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 msgr2=0x557cbc70cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:05.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.334+0000 7fab054b5740 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc70cc80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faae80ec720 tx=0x7faae80a8d00 comp rx=0 tx=0).stop 2024-09-21T01:04:05.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.334+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 shutdown_connections 2024-09-21T01:04:05.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.334+0000 7fab054b5740 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x557cbc3189f0 0x557cbc71edb0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.334+0000 7fab054b5740 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc35a070 0x557cbc70d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.335+0000 7fab054b5740 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc70d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.335+0000 7fab054b5740 1 --2- 172.21.15.47:0/1511608042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc3311b0 0x557cbc70cc80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.335+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 >> 172.21.15.47:0/1511608042 conn(0x557cbc34e460 msgr2=0x557cbc7047e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.335+0000 7faadc7f8640 0 client.25604 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.335+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 shutdown_connections 2024-09-21T01:04:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.335+0000 7fab054b5740 1 -- 172.21.15.47:0/1511608042 wait complete. 2024-09-21T01:04:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.335+0000 7fab054b5740 20 client.25604 trim_cache size 0 max 16384 2024-09-21T01:04:05.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:04 smithi134 ceph-mon[34785]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-09-21T01:04:05.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.393+0000 7fab054b5740 1 Processor -- start 2024-09-21T01:04:05.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.393+0000 7fab054b5740 1 -- start start 2024-09-21T01:04:05.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.394+0000 7fab054b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc3311b0 0x557cbc6feb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.394+0000 7fab054b5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc6ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.395+0000 7faafccdd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc3311b0 0x557cbc6feb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.395+0000 7faafccdd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc3311b0 0x557cbc6feb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:36208/0 (socket says 172.21.15.47:36208) 2024-09-21T01:04:05.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.395+0000 7faafccdd640 1 -- 172.21.15.47:0/2832050041 learned_addr learned my addr 172.21.15.47:0/2832050041 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:05.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.395+0000 7fab054b5740 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc70ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.396+0000 7fab054b5740 1 -- 172.21.15.47:0/2832050041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faae400c330 con 0x557cbc339390 2024-09-21T01:04:05.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.396+0000 7faaf7fff640 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc6ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.397+0000 7faafd4de640 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc70ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.397+0000 7fab054b5740 1 -- 172.21.15.47:0/2832050041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faae400eb00 con 0x557cbc35a070 2024-09-21T01:04:05.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.397+0000 7fab054b5740 1 -- 172.21.15.47:0/2832050041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faae400c8f0 con 0x557cbc3311b0 2024-09-21T01:04:05.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.403+0000 7faafd4de640 1 -- 172.21.15.47:0/2832050041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc3311b0 msgr2=0x557cbc6feb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:05.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.403+0000 7faafd4de640 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc3311b0 0x557cbc6feb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.403+0000 7faafd4de640 1 -- 172.21.15.47:0/2832050041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 msgr2=0x557cbc6ff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:05.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.403+0000 7faafd4de640 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc6ff0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.403+0000 7faafd4de640 1 -- 172.21.15.47:0/2832050041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cbc702470 con 0x557cbc35a070 2024-09-21T01:04:05.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.406+0000 7faafd4de640 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc70ca30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x557cbc70f9a0 tx=0x7faaf0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=400bd1bc0fbf1ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.406+0000 7faade7fc640 1 -- 172.21.15.47:0/2832050041 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf000e820 con 0x557cbc35a070 2024-09-21T01:04:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.406+0000 7faade7fc640 1 -- 172.21.15.47:0/2832050041 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaf001f420 con 0x557cbc35a070 2024-09-21T01:04:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.406+0000 7faade7fc640 1 -- 172.21.15.47:0/2832050041 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0027660 con 0x557cbc35a070 2024-09-21T01:04:05.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.408+0000 7fab054b5740 1 -- 172.21.15.47:0/2832050041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 msgr2=0x557cbc70ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:05.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.408+0000 7fab054b5740 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc70ca30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x557cbc70f9a0 tx=0x7faaf0014000 comp rx=0 tx=0).stop 2024-09-21T01:04:05.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.408+0000 7fab054b5740 1 -- 172.21.15.47:0/2832050041 shutdown_connections 2024-09-21T01:04:05.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.409+0000 7fab054b5740 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc70ca30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.409+0000 7fab054b5740 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc339390 0x557cbc6ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.409+0000 7fab054b5740 1 --2- 172.21.15.47:0/2832050041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc3311b0 0x557cbc6feb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:04 smithi114 ceph-mon[34309]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-09-21T01:04:05.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.409+0000 7fab054b5740 1 -- 172.21.15.47:0/2832050041 >> 172.21.15.47:0/2832050041 conn(0x557cbc34e460 msgr2=0x557cbc70b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.413+0000 7fab054b5740 1 -- 172.21.15.47:0/2832050041 shutdown_connections 2024-09-21T01:04:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.413+0000 7fab054b5740 1 -- 172.21.15.47:0/2832050041 wait complete. 2024-09-21T01:04:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.413+0000 7fab054b5740 1 -- start start 2024-09-21T01:04:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.414+0000 7fab054b5740 1 Processor -- start 2024-09-21T01:04:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.415+0000 7fab054b5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc3311b0 0x557cbc7103e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.415+0000 7fab054b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc339390 0x557cbc710940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.415+0000 7faafccdd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc3311b0 0x557cbc7103e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.415+0000 7faafccdd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc3311b0 0x557cbc7103e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43166/0 (socket says 172.21.15.47:43166) 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.416+0000 7faafccdd640 1 -- 172.21.15.47:0/129318920 learned_addr learned my addr 172.21.15.47:0/129318920 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.416+0000 7fab054b5740 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc787760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.416+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faae400cfc0 con 0x557cbc3311b0 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.416+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faae400e430 con 0x557cbc35a070 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.417+0000 7faaf7fff640 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc339390 0x557cbc710940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.417+0000 7faafd4de640 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc787760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.417+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faae400d690 con 0x557cbc339390 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.418+0000 7faafccdd640 1 -- 172.21.15.47:0/129318920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc339390 msgr2=0x557cbc710940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.418+0000 7faafccdd640 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc339390 0x557cbc710940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.418+0000 7faafccdd640 1 -- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 msgr2=0x557cbc787760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:05.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.418+0000 7faafccdd640 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc787760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.418+0000 7faafccdd640 1 -- 172.21.15.47:0/129318920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cbc787ca0 con 0x557cbc3311b0 2024-09-21T01:04:05.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.419+0000 7fab054b5740 10 client.0 _ll_register_callbacks cb 0x7faae80f7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:05.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.419+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaf001f420 con 0x557cbc3311b0 2024-09-21T01:04:05.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.433+0000 7faafccdd640 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc3311b0 0x557cbc7103e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faae800bd00 tx=0x7faae80adec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7290376ced8b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:05.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.433+0000 7faadc7f8640 10 client.15939 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:04:05.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.434+0000 7faadc7f8640 1 -- 172.21.15.47:0/129318920 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80ece60 con 0x557cbc3311b0 2024-09-21T01:04:05.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.434+0000 7faadc7f8640 1 -- 172.21.15.47:0/129318920 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7faae80abac0 con 0x557cbc3311b0 2024-09-21T01:04:05.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.435+0000 7faadc7f8640 1 -- 172.21.15.47:0/129318920 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faae80ac630 con 0x557cbc3311b0 2024-09-21T01:04:05.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.435+0000 7fab054b5740 10 client.15939 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:05.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.435+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557cbc788c30 con 0x557cbc3311b0 2024-09-21T01:04:05.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.436+0000 7faadc7f8640 1 -- 172.21.15.47:0/129318920 <== mon.0 v2:172.21.15.47:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faae8010380 con 0x557cbc3311b0 2024-09-21T01:04:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.436+0000 7fab054b5740 10 client.15939 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.436+0000 7fab054b5740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.436+0000 7fab054b5740 20 client.15939 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.436+0000 7fab054b5740 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x557cbc2edda0 0x557cbc78b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.437+0000 7fab054b5740 4 client.15939 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:04:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.437+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557cbc679da0 con 0x557cbc2edda0 2024-09-21T01:04:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.437+0000 7faaf7fff640 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x557cbc2edda0 0x557cbc78b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:05.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.439+0000 7faaf7fff640 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x557cbc2edda0 0x557cbc78b0e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c9ad2bbdeba8ed server_cookie=d13c9fde815878ee in_seq=0 out_seq=0 2024-09-21T01:04:05.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.439+0000 7faadc7f8640 10 client.15939 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:05.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.439+0000 7faadc7f8640 1 -- 172.21.15.47:0/129318920 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x557cbc679da0 con 0x557cbc2edda0 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.439+0000 7faadc7f8640 10 client.15939 handle_command_reply: tid=0 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.439+0000 7fab054b5740 1 client.15939 shutdown 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.440+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc3311b0 msgr2=0x557cbc7103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.440+0000 7fab054b5740 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc3311b0 0x557cbc7103e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faae800bd00 tx=0x7faae80adec0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.440+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 shutdown_connections 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.440+0000 7fab054b5740 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x557cbc2edda0 0x557cbc78b0e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.440+0000 7fab054b5740 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cbc35a070 0x557cbc787760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.440+0000 7faadc7f8640 0 client.15939 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.441+0000 7fab054b5740 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557cbc339390 0x557cbc710940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.441+0000 7fab054b5740 1 --2- 172.21.15.47:0/129318920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557cbc3311b0 0x557cbc7103e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.441+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 >> 172.21.15.47:0/129318920 conn(0x557cbc34e460 msgr2=0x557cbc70ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.441+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 shutdown_connections 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.442+0000 7fab054b5740 1 -- 172.21.15.47:0/129318920 wait complete. 2024-09-21T01:04:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.442+0000 7fab054b5740 20 client.15939 trim_cache size 0 max 16384 2024-09-21T01:04:05.447 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:04:05.447 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-09-21T01:04:05.447 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-09-21T01:04:05.447 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:04:05.447 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:04:05.447 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:05.448 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:05.449 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:05.450 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:05.450 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:05.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:05.450 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:04:05.450 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:04:05.450 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:05.450 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:05.451 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:05.451 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:05.451 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:05.451 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:05.451 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:05.451 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:04:05.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 -- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faae00b66e0 msgr2=0x7faae00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:05.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faae00b66e0 0x7faae00b8bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009270 tx=0x7faaf0009b00 comp rx=0 tx=0).stop 2024-09-21T01:04:05.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 -- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaf811cc30 msgr2=0x7faaf811a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:05.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaf811cc30 0x7faaf811a610 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faaf8075540 tx=0x7faae800b800 comp rx=0 tx=0).stop 2024-09-21T01:04:05.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 -- 172.21.15.47:0/1726936873 shutdown_connections 2024-09-21T01:04:05.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7faae00b66e0 0x7faae00b8bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf81142d0 0x7faaf81191c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf8113820 0x7faaf8113c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 --2- 172.21.15.47:0/1726936873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faaf811cc30 0x7faaf811a610 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:05.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.450+0000 7faafef41640 1 -- 172.21.15.47:0/1726936873 >> 172.21.15.47:0/1726936873 conn(0x7faaf8070ec0 msgr2=0x7faaf8071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:05.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.452+0000 7faafef41640 1 -- 172.21.15.47:0/1726936873 shutdown_connections 2024-09-21T01:04:05.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:05.453+0000 7faafef41640 1 -- 172.21.15.47:0/1726936873 wait complete. 2024-09-21T01:04:06.715 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:04:06.715 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:04:06.980 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:07.225 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:06 smithi047 ceph-mon[30960]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-09-21T01:04:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:06 smithi134 ceph-mon[34785]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-09-21T01:04:07.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:06 smithi114 ceph-mon[34309]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 4.75k op/s 2024-09-21T01:04:07.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.657+0000 7f76eff36640 1 -- 172.21.15.47:0/2590406686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76e810a9e0 msgr2=0x7f76e810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:07.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.657+0000 7f76eff36640 1 --2- 172.21.15.47:0/2590406686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76e810a9e0 0x7f76e810adf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009ca0 tx=0x7f76d802a8f0 comp rx=0 tx=0).stop 2024-09-21T01:04:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.658+0000 7f76eff36640 1 -- 172.21.15.47:0/2590406686 shutdown_connections 2024-09-21T01:04:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.658+0000 7f76eff36640 1 --2- 172.21.15.47:0/2590406686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e811cc30 0x7f76e811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.658+0000 7f76eff36640 1 --2- 172.21.15.47:0/2590406686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76e810a9e0 0x7f76e810adf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.658+0000 7f76eff36640 1 --2- 172.21.15.47:0/2590406686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76e8111f40 0x7f76e810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.658+0000 7f76eff36640 1 -- 172.21.15.47:0/2590406686 >> 172.21.15.47:0/2590406686 conn(0x7f76e8070ec0 msgr2=0x7f76e80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.658+0000 7f76eff36640 1 -- 172.21.15.47:0/2590406686 shutdown_connections 2024-09-21T01:04:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.658+0000 7f76eff36640 1 -- 172.21.15.47:0/2590406686 wait complete. 2024-09-21T01:04:07.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.659+0000 7f76eff36640 1 Processor -- start 2024-09-21T01:04:07.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.659+0000 7f76eff36640 1 -- start start 2024-09-21T01:04:07.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.659+0000 7f76eff36640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e810a9e0 0x7f76e811a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:07.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.659+0000 7f76eff36640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76e8111f40 0x7f76e8113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:07.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.659+0000 7f76eff36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76e811cc30 0x7f76e8113d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:07.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.659+0000 7f76eff36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8122940 con 0x7f76e811cc30 2024-09-21T01:04:07.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.659+0000 7f76eff36640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76e81227c0 con 0x7f76e810a9e0 2024-09-21T01:04:07.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.659+0000 7f76eff36640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8122ac0 con 0x7f76e8111f40 2024-09-21T01:04:07.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.660+0000 7f76ed4d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76e8111f40 0x7f76e8113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:07.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.660+0000 7f76ed4d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76e8111f40 0x7f76e8113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:36230/0 (socket says 172.21.15.47:36230) 2024-09-21T01:04:07.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.660+0000 7f76ed4d1640 1 -- 172.21.15.47:0/2354365344 learned_addr learned my addr 172.21.15.47:0/2354365344 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:07.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.660+0000 7f76ed4d1640 1 -- 172.21.15.47:0/2354365344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e810a9e0 msgr2=0x7f76e811a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:07.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.661+0000 7f76edcd2640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e810a9e0 0x7f76e811a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.661+0000 7f76ed4d1640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e810a9e0 0x7f76e811a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.661+0000 7f76ed4d1640 1 -- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76e811cc30 msgr2=0x7f76e8113d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.661+0000 7f76ed4d1640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76e811cc30 0x7f76e8113d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.661+0000 7f76ed4d1640 1 -- 172.21.15.47:0/2354365344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e81190b0 con 0x7f76e8111f40 2024-09-21T01:04:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.661+0000 7f76ed4d1640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76e8111f40 0x7f76e8113710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000f80 tx=0x7f76d8030b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.661+0000 7f76e6ffd640 1 -- 172.21.15.47:0/2354365344 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8009760 con 0x7f76e8111f40 2024-09-21T01:04:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.662+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e8119340 con 0x7f76e8111f40 2024-09-21T01:04:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.662+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e8119880 con 0x7f76e8111f40 2024-09-21T01:04:07.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.662+0000 7f76e6ffd640 1 -- 172.21.15.47:0/2354365344 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76d8036040 con 0x7f76e8111f40 2024-09-21T01:04:07.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.662+0000 7f76e6ffd640 1 -- 172.21.15.47:0/2354365344 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d802f710 con 0x7f76e8111f40 2024-09-21T01:04:07.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.664+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c8005290 con 0x7f76e8111f40 2024-09-21T01:04:07.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.667+0000 7f76e6ffd640 1 -- 172.21.15.47:0/2354365344 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f76d8043030 con 0x7f76e8111f40 2024-09-21T01:04:07.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.668+0000 7f76e6ffd640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f76d40b6710 0x7f76d40b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:07.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.669+0000 7f76e6ffd640 1 -- 172.21.15.47:0/2354365344 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f76d8107c40 con 0x7f76e8111f40 2024-09-21T01:04:07.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.670+0000 7f76edcd2640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f76d40b6710 0x7f76d40b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:07.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.671+0000 7f76edcd2640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f76d40b6710 0x7f76d40b8c20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76e0005fd0 tx=0x7f76e0009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:07.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:07.677+0000 7f76e6ffd640 1 -- 172.21.15.47:0/2354365344 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76d80ce4d0 con 0x7f76e8111f40 2024-09-21T01:04:08.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.076+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76c8005580 con 0x7f76e8111f40 2024-09-21T01:04:08.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.077+0000 7f76e6ffd640 1 -- 172.21.15.47:0/2354365344 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f76d80d28b0 con 0x7f76e8111f40 2024-09-21T01:04:08.078 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:04:08.078 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:04:08.078 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f76d40b6710 msgr2=0x7f76d40b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f76d40b6710 0x7f76d40b8c20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76e0005fd0 tx=0x7f76e0009470 comp rx=0 tx=0).stop 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76e8111f40 msgr2=0x7f76e8113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76e8111f40 0x7f76e8113710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000f80 tx=0x7f76d8030b70 comp rx=0 tx=0).stop 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 shutdown_connections 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f76d40b6710 0x7f76d40b8c20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76e811cc30 0x7f76e8113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76e8111f40 0x7f76e8113710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:08.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 --2- 172.21.15.47:0/2354365344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e810a9e0 0x7f76e811a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:08.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 >> 172.21.15.47:0/2354365344 conn(0x7f76e8070ec0 msgr2=0x7f76e8071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:08.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 shutdown_connections 2024-09-21T01:04:08.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:08.079+0000 7f76eff36640 1 -- 172.21.15.47:0/2354365344 wait complete. 2024-09-21T01:04:08.894 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:04:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:09.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:08 smithi047 ceph-mon[30960]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 36 MiB/s wr, 5.37k op/s 2024-09-21T01:04:09.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:08 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2354365344' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:08 smithi134 ceph-mon[34785]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 36 MiB/s wr, 5.37k op/s 2024-09-21T01:04:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:08 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2354365344' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:09.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:08 smithi114 ceph-mon[34309]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 36 MiB/s wr, 5.37k op/s 2024-09-21T01:04:09.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:08 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2354365344' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:09.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 -- 172.21.15.47:0/3351923952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964102a60 msgr2=0x7f1964102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 --2- 172.21.15.47:0/3351923952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964102a60 0x7f1964102e70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1960009860 tx=0x7f196002a340 comp rx=0 tx=0).stop 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 -- 172.21.15.47:0/3351923952 shutdown_connections 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 --2- 172.21.15.47:0/3351923952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1964108cf0 0x7f196410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 --2- 172.21.15.47:0/3351923952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19641083a0 0x7f19641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 --2- 172.21.15.47:0/3351923952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964102a60 0x7f1964102e70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 -- 172.21.15.47:0/3351923952 >> 172.21.15.47:0/3351923952 conn(0x7f1964079730 msgr2=0x7f1964079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 -- 172.21.15.47:0/3351923952 shutdown_connections 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.675+0000 7f196b9a1640 1 -- 172.21.15.47:0/3351923952 wait complete. 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.676+0000 7f196b9a1640 1 Processor -- start 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.676+0000 7f196b9a1640 1 -- start start 2024-09-21T01:04:09.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.676+0000 7f196b9a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964102a60 0x7f1964104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.676+0000 7f196b9a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19641083a0 0x7f1964104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.676+0000 7f196b9a1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964108cf0 0x7f1964104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.676+0000 7f196b9a1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1964112960 con 0x7f19641083a0 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.676+0000 7f196b9a1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f19641127e0 con 0x7f1964108cf0 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.676+0000 7f196b9a1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1964112ae0 con 0x7f1964102a60 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19641083a0 0x7f1964104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19641083a0 0x7f1964104790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43196/0 (socket says 172.21.15.47:43196) 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1968f3c640 1 -- 172.21.15.47:0/885945552 learned_addr learned my addr 172.21.15.47:0/885945552 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1969f3e640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964108cf0 0x7f1964104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f196973d640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964102a60 0x7f1964104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1969f3e640 1 -- 172.21.15.47:0/885945552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964102a60 msgr2=0x7f1964104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1969f3e640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964102a60 0x7f1964104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1969f3e640 1 -- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19641083a0 msgr2=0x7f1964104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1969f3e640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19641083a0 0x7f1964104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1969f3e640 1 -- 172.21.15.47:0/885945552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19641a8820 con 0x7f1964108cf0 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f1969f3e640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964108cf0 0x7f1964104cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f195c00efc0 tx=0x7f195c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f195a7fc640 1 -- 172.21.15.47:0/885945552 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c003970 con 0x7f1964108cf0 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f195a7fc640 1 -- 172.21.15.47:0/885945552 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f195c004020 con 0x7f1964108cf0 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.677+0000 7f196b9a1640 1 -- 172.21.15.47:0/885945552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19641a8b10 con 0x7f1964108cf0 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.678+0000 7f195a7fc640 1 -- 172.21.15.47:0/885945552 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c00b940 con 0x7f1964108cf0 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.678+0000 7f196b9a1640 1 -- 172.21.15.47:0/885945552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19641a9000 con 0x7f1964108cf0 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.680+0000 7f1971f15740 1 Processor -- start 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.680+0000 7f195a7fc640 1 -- 172.21.15.47:0/885945552 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f195c01d020 con 0x7f1964108cf0 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.680+0000 7f1971f15740 1 -- start start 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1971f15740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb5836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1971f15740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb583be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1971f15740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1bb390 0x55cfbb584120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1971f15740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb4f9ea0 con 0x55cfbb1dc070 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1971f15740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb4e92d0 con 0x55cfbb1b31b0 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1971f15740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb4ed0e0 con 0x55cfbb1bb390 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb5836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb5836a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43202/0 (socket says 172.21.15.47:43202) 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 -- 172.21.15.47:0/2779392306 learned_addr learned my addr 172.21.15.47:0/2779392306 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f196973d640 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb583be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1bb390 0x55cfbb584120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 -- 172.21.15.47:0/2779392306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1bb390 msgr2=0x55cfbb584120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1bb390 0x55cfbb584120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 -- 172.21.15.47:0/2779392306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 msgr2=0x55cfbb583be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb583be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f195a7fc640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f19500b6510 0x7f19500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f1968f3c640 1 -- 172.21.15.47:0/2779392306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbb247650 con 0x55cfbb1dc070 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.681+0000 7f196973d640 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb583be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.682+0000 7f195a7fc640 1 -- 172.21.15.47:0/885945552 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f195c0e7070 con 0x7f1964108cf0 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.682+0000 7f1968f3c640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f19500b6510 0x7f19500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.682+0000 7f1968f3c640 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb5836a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1954009e80 tx=0x7f19540099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce43a514bd0a997d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.682+0000 7f194f7fe640 1 -- 172.21.15.47:0/2779392306 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19540042b0 con 0x55cfbb1dc070 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.682+0000 7f194f7fe640 1 -- 172.21.15.47:0/2779392306 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f195401b030 con 0x55cfbb1dc070 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.682+0000 7f194f7fe640 1 -- 172.21.15.47:0/2779392306 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954021630 con 0x55cfbb1dc070 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 -- 172.21.15.47:0/2779392306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 msgr2=0x55cfbb5836a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1968f3c640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f19500b6510 0x7f19500b8a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1954004650 tx=0x7f1954021c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb5836a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1954009e80 tx=0x7f19540099e0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 -- 172.21.15.47:0/2779392306 shutdown_connections 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1bb390 0x55cfbb584120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb583be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 --2- 172.21.15.47:0/2779392306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb5836a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 -- 172.21.15.47:0/2779392306 >> 172.21.15.47:0/2779392306 conn(0x55cfbb1d0460 msgr2=0x55cfbb581590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 -- 172.21.15.47:0/2779392306 shutdown_connections 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 -- 172.21.15.47:0/2779392306 wait complete. 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.683+0000 7f1971f15740 1 -- start start 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1971f15740 1 Processor -- start 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1971f15740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb58ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1971f15740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1bb390 0x55cfbb58f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1971f15740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1dc070 0x55cfbb58f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1971f15740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb34a700 con 0x55cfbb1bb390 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1971f15740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb484160 con 0x55cfbb1b31b0 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1971f15740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cfbb591e80 con 0x55cfbb1dc070 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1971f15740 10 client.0 _ll_register_callbacks cb 0x55cfbb49d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1bb390 0x55cfbb58f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f196973d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb58ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1bb390 0x55cfbb58f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43214/0 (socket says 172.21.15.47:43214) 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1968f3c640 1 -- 172.21.15.47:0/3323116171 learned_addr learned my addr 172.21.15.47:0/3323116171 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.684+0000 7f1969f3e640 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1dc070 0x55cfbb58f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1968f3c640 1 -- 172.21.15.47:0/3323116171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1dc070 msgr2=0x55cfbb58f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1968f3c640 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1dc070 0x55cfbb58f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1968f3c640 1 -- 172.21.15.47:0/3323116171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 msgr2=0x55cfbb58ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1968f3c640 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb58ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1968f3c640 1 -- 172.21.15.47:0/3323116171 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbb4b1c90 con 0x55cfbb1bb390 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1969f3e640 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1dc070 0x55cfbb58f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f196973d640 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb58ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1968f3c640 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1bb390 0x55cfbb58f170 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1954003c90 tx=0x7f1954014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c1bcd423a47c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f194cff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f194cff9640 1 -- 172.21.15.47:0/3323116171 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195401a050 con 0x55cfbb1bb390 2024-09-21T01:04:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1971f15740 1 -- 172.21.15.47:0/3323116171 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f195401b030 con 0x55cfbb1bb390 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f194cff9640 1 -- 172.21.15.47:0/3323116171 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f19540035f0 con 0x55cfbb1bb390 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f194cff9640 1 -- 172.21.15.47:0/3323116171 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1954040050 con 0x55cfbb1bb390 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1971f15740 10 client.15954 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.685+0000 7f1971f15740 1 -- 172.21.15.47:0/3323116171 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cfbb59da30 con 0x55cfbb1bb390 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f194cff9640 1 -- 172.21.15.47:0/3323116171 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f195401b030 con 0x55cfbb1bb390 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f194cff9640 1 -- 172.21.15.47:0/3323116171 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1954021430 con 0x55cfbb1bb390 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f1971f15740 10 client.15954 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f1971f15740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f1971f15740 20 client.15954 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f1971f15740 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cfbb19a9f0 0x55cfbb5a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f1971f15740 4 client.15954 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f1971f15740 1 -- 172.21.15.47:0/3323116171 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfbb4fbdf0 con 0x55cfbb19a9f0 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f196973d640 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cfbb19a9f0 0x55cfbb5a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.686+0000 7f194cff9640 10 client.15954 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.687+0000 7f196973d640 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cfbb19a9f0 0x55cfbb5a0de0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7978c4c7e9d734e server_cookie=d18a98f57e593ee4 in_seq=0 out_seq=0 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.687+0000 7f194cff9640 1 -- 172.21.15.47:0/3323116171 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfbb4fbdf0 con 0x55cfbb19a9f0 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.687+0000 7f194cff9640 10 client.15954 handle_command_reply: tid=0 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.687+0000 7f1971f15740 1 client.15954 shutdown 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.687+0000 7f1971f15740 1 -- 172.21.15.47:0/3323116171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1bb390 msgr2=0x55cfbb58f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.687+0000 7f1971f15740 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1bb390 0x55cfbb58f170 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1954003c90 tx=0x7f1954014000 comp rx=0 tx=0).stop 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 1 -- 172.21.15.47:0/3323116171 shutdown_connections 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cfbb19a9f0 0x55cfbb5a0de0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1dc070 0x55cfbb58f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1bb390 0x55cfbb58f170 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 1 --2- 172.21.15.47:0/3323116171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1b31b0 0x55cfbb58ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 1 -- 172.21.15.47:0/3323116171 >> 172.21.15.47:0/3323116171 conn(0x55cfbb1d0460 msgr2=0x55cfbb586880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f194cff9640 0 client.15954 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 1 -- 172.21.15.47:0/3323116171 shutdown_connections 2024-09-21T01:04:09.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 1 -- 172.21.15.47:0/3323116171 wait complete. 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.688+0000 7f1971f15740 20 client.15954 trim_cache size 0 max 16384 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.701+0000 7f1971f15740 1 Processor -- start 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.701+0000 7f1971f15740 1 -- start start 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1971f15740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb590150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1971f15740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb580bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1971f15740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb581100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1971f15740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19641af400 con 0x55cfbb1dc070 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1971f15740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f19641b1c80 con 0x55cfbb1bb390 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1971f15740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19641afa70 con 0x55cfbb1b31b0 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb580bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1969f3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb581100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb580bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56382/0 (socket says 172.21.15.47:56382) 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 -- 172.21.15.47:0/3272608135 learned_addr learned my addr 172.21.15.47:0/3272608135 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f196973d640 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb590150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 -- 172.21.15.47:0/3272608135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 msgr2=0x55cfbb590150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb590150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 -- 172.21.15.47:0/3272608135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 msgr2=0x55cfbb581100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb581100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 -- 172.21.15.47:0/3272608135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbb591000 con 0x55cfbb1bb390 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f196973d640 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb590150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f1968f3c640 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb580bc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1954004620 tx=0x7f19540207b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68de68401fd071 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f194effd640 1 -- 172.21.15.47:0/3272608135 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195403d070 con 0x55cfbb1bb390 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.702+0000 7f194effd640 1 -- 172.21.15.47:0/3272608135 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f195400f790 con 0x55cfbb1bb390 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f194effd640 1 -- 172.21.15.47:0/3272608135 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195401a040 con 0x55cfbb1bb390 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 -- 172.21.15.47:0/3272608135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 msgr2=0x55cfbb580bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb580bc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1954004620 tx=0x7f19540207b0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 -- 172.21.15.47:0/3272608135 shutdown_connections 2024-09-21T01:04:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb581100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb580bc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 --2- 172.21.15.47:0/3272608135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb590150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 -- 172.21.15.47:0/3272608135 >> 172.21.15.47:0/3272608135 conn(0x55cfbb1d0460 msgr2=0x55cfbb585090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 -- 172.21.15.47:0/3272608135 shutdown_connections 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.703+0000 7f1971f15740 1 -- 172.21.15.47:0/3272608135 wait complete. 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 1 -- start start 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 1 Processor -- start 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb592870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb592db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb609700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19641b0140 con 0x55cfbb1dc070 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f19641b15b0 con 0x55cfbb1bb390 2024-09-21T01:04:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f19641b0810 con 0x55cfbb1b31b0 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1971f15740 10 client.0 _ll_register_callbacks cb 0x7f1954009f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f196973d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb592870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb592db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1969f3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb609700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f196973d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb592870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:36272/0 (socket says 172.21.15.47:36272) 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.704+0000 7f1968f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb592db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:56384/0 (socket says 172.21.15.47:56384) 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f196973d640 1 -- 172.21.15.47:0/3621274373 learned_addr learned my addr 172.21.15.47:0/3621274373 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1969f3e640 1 -- 172.21.15.47:0/3621274373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 msgr2=0x55cfbb592870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1969f3e640 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb592870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1969f3e640 1 -- 172.21.15.47:0/3621274373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 msgr2=0x55cfbb592db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1969f3e640 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb592db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1969f3e640 1 -- 172.21.15.47:0/3621274373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbb609c90 con 0x55cfbb1dc070 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1968f3c640 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb592db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1969f3e640 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb609700 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f195c0e4c60 tx=0x7f195c004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5404a8aeabdc65a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f194cff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f194cff9640 1 -- 172.21.15.47:0/3621274373 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c058d30 con 0x55cfbb1dc070 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f194cff9640 1 -- 172.21.15.47:0/3621274373 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f195c0ac500 con 0x55cfbb1dc070 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1971f15740 1 -- 172.21.15.47:0/3621274373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f195400f790 con 0x55cfbb1dc070 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f194cff9640 1 -- 172.21.15.47:0/3621274373 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f195c0ad9a0 con 0x55cfbb1dc070 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1971f15740 10 client.15960 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.705+0000 7f1971f15740 1 -- 172.21.15.47:0/3621274373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cfbb60af10 con 0x55cfbb1dc070 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f194cff9640 1 -- 172.21.15.47:0/3621274373 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f195400f790 con 0x55cfbb1dc070 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f194cff9640 1 -- 172.21.15.47:0/3621274373 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f195c00b040 con 0x55cfbb1dc070 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f1971f15740 10 client.15960 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f1971f15740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f1971f15740 20 client.15960 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f1971f15740 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cfbb16fda0 0x55cfbb60d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f1971f15740 4 client.15960 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f1971f15740 1 -- 172.21.15.47:0/3621274373 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfbb4f78a0 con 0x55cfbb16fda0 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.706+0000 7f196973d640 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cfbb16fda0 0x55cfbb60d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f194cff9640 10 client.15960 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f196973d640 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cfbb16fda0 0x55cfbb60d6d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=708501b196520d78 server_cookie=66aa1c2cb9989bea in_seq=0 out_seq=0 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f194cff9640 1 -- 172.21.15.47:0/3621274373 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cfbb4f78a0 con 0x55cfbb16fda0 2024-09-21T01:04:09.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f194cff9640 10 client.15960 handle_command_reply: tid=0 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 client.15960 shutdown 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 -- 172.21.15.47:0/3621274373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 msgr2=0x55cfbb609700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb609700 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f195c0e4c60 tx=0x7f195c004720 comp rx=0 tx=0).stop 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 -- 172.21.15.47:0/3621274373 shutdown_connections 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55cfbb16fda0 0x55cfbb60d6d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cfbb1dc070 0x55cfbb609700 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55cfbb1bb390 0x55cfbb592db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f194cff9640 0 client.15960 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 --2- 172.21.15.47:0/3621274373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfbb1b31b0 0x55cfbb592870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 -- 172.21.15.47:0/3621274373 >> 172.21.15.47:0/3621274373 conn(0x55cfbb1d0460 msgr2=0x55cfbb5867a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:09.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 -- 172.21.15.47:0/3621274373 shutdown_connections 2024-09-21T01:04:09.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 1 -- 172.21.15.47:0/3621274373 wait complete. 2024-09-21T01:04:09.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.707+0000 7f1971f15740 20 client.15960 trim_cache size 0 max 16384 2024-09-21T01:04:09.996 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-09-21T01:04:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 -- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f19500b6510 msgr2=0x7f19500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f19500b6510 0x7f19500b8a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1954004650 tx=0x7f1954021c80 comp rx=0 tx=0).stop 2024-09-21T01:04:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 -- 172.21.15.47:0/885945552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964108cf0 msgr2=0x7f1964104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964108cf0 0x7f1964104cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f195c00efc0 tx=0x7f195c00c800 comp rx=0 tx=0).stop 2024-09-21T01:04:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 -- 172.21.15.47:0/885945552 shutdown_connections 2024-09-21T01:04:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f19500b6510 0x7f19500b8a20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1964108cf0 0x7f1964104cd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19641083a0 0x7f1964104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 --2- 172.21.15.47:0/885945552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1964102a60 0x7f1964104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:09.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 -- 172.21.15.47:0/885945552 >> 172.21.15.47:0/885945552 conn(0x7f1964079730 msgr2=0x7f1964101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:09.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 -- 172.21.15.47:0/885945552 shutdown_connections 2024-09-21T01:04:09.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:09.708+0000 7f196b9a1640 1 -- 172.21.15.47:0/885945552 wait complete. 2024-09-21T01:04:11.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:10 smithi134 ceph-mon[34785]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 35 MiB/s wr, 5.53k op/s 2024-09-21T01:04:11.402 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:10 smithi047 ceph-mon[30960]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 35 MiB/s wr, 5.53k op/s 2024-09-21T01:04:11.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:10 smithi114 ceph-mon[34309]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 35 MiB/s wr, 5.53k op/s 2024-09-21T01:04:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 -- 172.21.15.47:0/805677155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744103630 msgr2=0x7f6744103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 --2- 172.21.15.47:0/805677155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744103630 0x7f6744103a40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6738009900 tx=0x7f673802a410 comp rx=0 tx=0).stop 2024-09-21T01:04:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 -- 172.21.15.47:0/805677155 shutdown_connections 2024-09-21T01:04:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 --2- 172.21.15.47:0/805677155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6744103fd0 0x7f674410a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 --2- 172.21.15.47:0/805677155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744103630 0x7f6744103a40 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 --2- 172.21.15.47:0/805677155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67441025b0 0x7f6744102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 -- 172.21.15.47:0/805677155 >> 172.21.15.47:0/805677155 conn(0x7f67440fdf30 msgr2=0x7f67441003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 -- 172.21.15.47:0/805677155 shutdown_connections 2024-09-21T01:04:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.240+0000 7f674c7e6640 1 -- 172.21.15.47:0/805677155 wait complete. 2024-09-21T01:04:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674c7e6640 1 Processor -- start 2024-09-21T01:04:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674c7e6640 1 -- start start 2024-09-21T01:04:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674c7e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67441025b0 0x7f6744199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674c7e6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744103630 0x7f674419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674c7e6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6744103fd0 0x7f674419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674c7e6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f674410e1f0 con 0x7f6744103630 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674c7e6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f674410e070 con 0x7f6744103fd0 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674c7e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f674410e370 con 0x7f67441025b0 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674a582640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67441025b0 0x7f6744199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674ad83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6744103fd0 0x7f674419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674a582640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67441025b0 0x7f6744199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:47620/0 (socket says 172.21.15.47:47620) 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f674a582640 1 -- 172.21.15.47:0/3673224003 learned_addr learned my addr 172.21.15.47:0/3673224003 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.241+0000 7f6749d81640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744103630 0x7f674419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f674a582640 1 -- 172.21.15.47:0/3673224003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6744103fd0 msgr2=0x7f674419b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f674a582640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6744103fd0 0x7f674419b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f674a582640 1 -- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744103630 msgr2=0x7f674419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f674a582640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744103630 0x7f674419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f674a582640 1 -- 172.21.15.47:0/3673224003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674419ba00 con 0x7f67441025b0 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f674a582640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67441025b0 0x7f6744199fc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f674000ea60 tx=0x7f674000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f67377fe640 1 -- 172.21.15.47:0/3673224003 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674000cd20 con 0x7f67441025b0 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f674c7e6640 1 -- 172.21.15.47:0/3673224003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674419bcf0 con 0x7f67441025b0 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f67377fe640 1 -- 172.21.15.47:0/3673224003 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67400035f0 con 0x7f67441025b0 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f67377fe640 1 -- 172.21.15.47:0/3673224003 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740010690 con 0x7f67441025b0 2024-09-21T01:04:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.242+0000 7f674c7e6640 1 -- 172.21.15.47:0/3673224003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67441a23e0 con 0x7f67441025b0 2024-09-21T01:04:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.246+0000 7f675382f740 1 Processor -- start 2024-09-21T01:04:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.246+0000 7f675382f740 1 -- start start 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f675382f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f675382f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f675382f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f675382f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a3b31236f0 con 0x55a3b2e091b0 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f675382f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a3b3112b20 con 0x55a3b2de02f0 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f675382f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a3b3116930 con 0x55a3b2de84d0 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f674ad83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f674ad83640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39046/0 (socket says 172.21.15.47:39046) 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f6749d81640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f674ad83640 1 -- 172.21.15.47:0/2003856673 learned_addr learned my addr 172.21.15.47:0/2003856673 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f6749d81640 1 -- 172.21.15.47:0/2003856673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 msgr2=0x55a3b31b14c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:04:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.247+0000 7f67377fe640 1 -- 172.21.15.47:0/3673224003 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f67400037a0 con 0x7f67441025b0 2024-09-21T01:04:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f6749d81640 1 --2- 172.21.15.47:0/2003856673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f6749d81640 1 -- 172.21.15.47:0/2003856673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 msgr2=0x55a3b31b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f6749d81640 1 --2- 172.21.15.47:0/2003856673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f6749d81640 1 -- 172.21.15.47:0/2003856673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3b30d8530 con 0x55a3b2de84d0 2024-09-21T01:04:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f674ad83640 1 --2- 172.21.15.47:0/2003856673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f6749d81640 1 --2- 172.21.15.47:0/2003856673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31b2010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6738005ab0 tx=0x7f6738009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53baf864e150569 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f6734ff9640 1 -- 172.21.15.47:0/2003856673 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738035030 con 0x55a3b2de84d0 2024-09-21T01:04:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f6734ff9640 1 -- 172.21.15.47:0/2003856673 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6738040070 con 0x55a3b2de84d0 2024-09-21T01:04:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.248+0000 7f6734ff9640 1 -- 172.21.15.47:0/2003856673 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67380038e0 con 0x55a3b2de84d0 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.249+0000 7f67377fe640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67300b6590 0x7f67300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.249+0000 7f675382f740 1 -- 172.21.15.47:0/2003856673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 msgr2=0x55a3b31b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.249+0000 7f675382f740 1 --2- 172.21.15.47:0/2003856673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31b2010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6738005ab0 tx=0x7f6738009600 comp rx=0 tx=0).stop 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f67377fe640 1 -- 172.21.15.47:0/3673224003 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f67400e75d0 con 0x7f67441025b0 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f674ad83640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67300b6590 0x7f67300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f675382f740 1 -- 172.21.15.47:0/2003856673 shutdown_connections 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f675382f740 1 --2- 172.21.15.47:0/2003856673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31b2010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f675382f740 1 --2- 172.21.15.47:0/2003856673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f675382f740 1 --2- 172.21.15.47:0/2003856673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f675382f740 1 -- 172.21.15.47:0/2003856673 >> 172.21.15.47:0/2003856673 conn(0x55a3b2dfd300 msgr2=0x55a3b31ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f675382f740 1 -- 172.21.15.47:0/2003856673 shutdown_connections 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f675382f740 1 -- 172.21.15.47:0/2003856673 wait complete. 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.250+0000 7f674ad83640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67300b6590 0x7f67300b8aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f673c009df0 tx=0x7f673c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 1 -- start start 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 1 Processor -- start 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31beab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 0x55a3b31bf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 0x55a3b31bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a3b304aab0 con 0x55a3b2de84d0 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a3b30b8730 con 0x55a3b2de02f0 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a3b31b2ad0 con 0x55a3b2e091b0 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f674a582640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f674a582640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31beab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:50284/0 (socket says 172.21.15.47:50284) 2024-09-21T01:04:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f674a582640 1 -- 172.21.15.47:0/3652338207 learned_addr learned my addr 172.21.15.47:0/3652338207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f674ad83640 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 0x55a3b31bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f6749d81640 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 0x55a3b31bf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.251+0000 7f675382f740 10 client.0 _ll_register_callbacks cb 0x55a3b310c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f674a582640 1 -- 172.21.15.47:0/3652338207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 msgr2=0x55a3b31bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f674a582640 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 0x55a3b31bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f674a582640 1 -- 172.21.15.47:0/3652338207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 msgr2=0x55a3b31bf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f674a582640 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 0x55a3b31bf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f674a582640 1 -- 172.21.15.47:0/3652338207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3b2e74790 con 0x55a3b2de02f0 2024-09-21T01:04:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f674a582640 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31beab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6740004610 tx=0x7f6740003cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f58d58484f22fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f672dffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f672dffb640 1 -- 172.21.15.47:0/3652338207 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400b2020 con 0x55a3b2de02f0 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f675382f740 1 -- 172.21.15.47:0/3652338207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6738040070 con 0x55a3b2de02f0 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f672dffb640 1 -- 172.21.15.47:0/3652338207 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f67400e72e0 con 0x55a3b2de02f0 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f672dffb640 1 -- 172.21.15.47:0/3652338207 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f67400a7e60 con 0x55a3b2de02f0 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f675382f740 10 client.25637 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f675382f740 1 -- 172.21.15.47:0/3652338207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a3b2eed620 con 0x55a3b2de02f0 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.252+0000 7f672dffb640 1 -- 172.21.15.47:0/3652338207 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6738040070 con 0x55a3b2de02f0 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f672dffb640 1 -- 172.21.15.47:0/3652338207 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f67400a90b0 con 0x55a3b2de02f0 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f675382f740 10 client.25637 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f675382f740 10 client.25637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f675382f740 20 client.25637 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f675382f740 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a3b2dc7d80 0x55a3b31cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f675382f740 4 client.25637 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f675382f740 1 -- 172.21.15.47:0/3652338207 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3b3125640 con 0x55a3b2dc7d80 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f6749d81640 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a3b2dc7d80 0x55a3b31cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f6749d81640 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a3b2dc7d80 0x55a3b31cc5f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3868f68604b051c server_cookie=543928231810e01b in_seq=0 out_seq=0 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.253+0000 7f672dffb640 10 client.25637 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f672dffb640 1 -- 172.21.15.47:0/3652338207 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3b3125640 con 0x55a3b2dc7d80 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f672dffb640 10 client.25637 handle_command_reply: tid=0 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 client.25637 shutdown 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 -- 172.21.15.47:0/3652338207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 msgr2=0x55a3b31beab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31beab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6740004610 tx=0x7f6740003cf0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 -- 172.21.15.47:0/3652338207 shutdown_connections 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a3b2dc7d80 0x55a3b31cc5f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 0x55a3b31bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 0x55a3b31bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 --2- 172.21.15.47:0/3652338207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31beab0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 -- 172.21.15.47:0/3652338207 >> 172.21.15.47:0/3652338207 conn(0x55a3b2dfd300 msgr2=0x55a3b31aaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f672dffb640 0 client.25637 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 -- 172.21.15.47:0/3652338207 shutdown_connections 2024-09-21T01:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 1 -- 172.21.15.47:0/3652338207 wait complete. 2024-09-21T01:04:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.254+0000 7f675382f740 20 client.25637 trim_cache size 0 max 16384 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f675382f740 1 Processor -- start 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f675382f740 1 -- start start 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f675382f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31bd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f675382f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31ac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f675382f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f675382f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67441a6c60 con 0x55a3b2e091b0 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f675382f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67441a94c0 con 0x55a3b2de02f0 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f675382f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f67441a72b0 con 0x55a3b2de84d0 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674a582640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31bd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674a582640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31bd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:50300/0 (socket says 172.21.15.47:50300) 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674a582640 1 -- 172.21.15.47:0/759793508 learned_addr learned my addr 172.21.15.47:0/759793508 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f6749d81640 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674ad83640 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674a582640 1 -- 172.21.15.47:0/759793508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 msgr2=0x55a3b31ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674a582640 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674a582640 1 -- 172.21.15.47:0/759793508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 msgr2=0x55a3b31bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674a582640 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f674a582640 1 -- 172.21.15.47:0/759793508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3b31c0050 con 0x55a3b2de02f0 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.270+0000 7f6749d81640 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.271+0000 7f674a582640 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31bd3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67400a9d30 tx=0x7f67400e7890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d46514c31ef6e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.271+0000 7f672ffff640 1 -- 172.21.15.47:0/759793508 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400b2040 con 0x55a3b2de02f0 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.271+0000 7f672ffff640 1 -- 172.21.15.47:0/759793508 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67400ad270 con 0x55a3b2de02f0 2024-09-21T01:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.271+0000 7f672ffff640 1 -- 172.21.15.47:0/759793508 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400b2240 con 0x55a3b2de02f0 2024-09-21T01:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 -- 172.21.15.47:0/759793508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 msgr2=0x55a3b31bd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31bd3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67400a9d30 tx=0x7f67400e7890 comp rx=0 tx=0).stop 2024-09-21T01:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 -- 172.21.15.47:0/759793508 shutdown_connections 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2e091b0 0x55a3b31bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2de84d0 0x55a3b31ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 --2- 172.21.15.47:0/759793508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31bd3d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 -- 172.21.15.47:0/759793508 >> 172.21.15.47:0/759793508 conn(0x55a3b2dfd300 msgr2=0x55a3b31aaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 -- 172.21.15.47:0/759793508 shutdown_connections 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 -- 172.21.15.47:0/759793508 wait complete. 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 -- start start 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.272+0000 7f675382f740 1 Processor -- start 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f675382f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31c1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f675382f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 0x55a3b31c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f675382f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 0x55a3b31c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f675382f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67441a7980 con 0x55a3b2de84d0 2024-09-21T01:04:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f675382f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67441a8df0 con 0x55a3b2de02f0 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f675382f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f67441a8050 con 0x55a3b2e091b0 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f675382f740 10 client.0 _ll_register_callbacks cb 0x7f674000ef90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f6749d81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 0x55a3b31c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31c1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:50310/0 (socket says 172.21.15.47:50310) 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 -- 172.21.15.47:0/3417001610 learned_addr learned my addr 172.21.15.47:0/3417001610 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674ad83640 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 0x55a3b31c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 -- 172.21.15.47:0/3417001610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 msgr2=0x55a3b31c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 0x55a3b31c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 -- 172.21.15.47:0/3417001610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 msgr2=0x55a3b31c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 0x55a3b31c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 -- 172.21.15.47:0/3417001610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3b31c2c50 con 0x55a3b2de02f0 2024-09-21T01:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f674a582640 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31c1350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6740000c00 tx=0x7f6740005ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e774e2e5b7e8c664 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f672dffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.273+0000 7f672dffb640 1 -- 172.21.15.47:0/3417001610 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400b2040 con 0x55a3b2de02f0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f672dffb640 1 -- 172.21.15.47:0/3417001610 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f67400e72c0 con 0x55a3b2de02f0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 1 -- 172.21.15.47:0/3417001610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67400ad270 con 0x55a3b2de02f0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f672dffb640 1 -- 172.21.15.47:0/3417001610 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f67400b2240 con 0x55a3b2de02f0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 10 client.25643 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 1 -- 172.21.15.47:0/3417001610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a3b31c5f50 con 0x55a3b2de02f0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f672dffb640 1 -- 172.21.15.47:0/3417001610 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67400ad270 con 0x55a3b2de02f0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f672dffb640 1 -- 172.21.15.47:0/3417001610 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f67400aea90 con 0x55a3b2de02f0 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 10 client.25643 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 10 client.25643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 20 client.25643 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a3b2d9d1c0 0x55a3b31c6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 4 client.25643 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f675382f740 1 -- 172.21.15.47:0/3417001610 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3b31210f0 con 0x55a3b2d9d1c0 2024-09-21T01:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.274+0000 7f6749d81640 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a3b2d9d1c0 0x55a3b31c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.275+0000 7f672dffb640 10 client.25643 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:12.275+0000 7f6749d81640 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a3b2d9d1c0 0x55a3b31c6650 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0c708d8537028 server_cookie=dd829ce55e0e3e8b in_seq=0 out_seq=0 2024-09-21T01:04:12.433 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:04:12.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:04:12.702 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:13.132 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:12 smithi047 ceph-mon[30960]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 30 MiB/s wr, 5.01k op/s 2024-09-21T01:04:13.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:12 smithi134 ceph-mon[34785]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 30 MiB/s wr, 5.01k op/s 2024-09-21T01:04:13.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:12 smithi114 ceph-mon[34309]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 30 MiB/s wr, 5.01k op/s 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.729+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/1311925160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e44102590 msgr2=0x7f9e44107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.729+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/1311925160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e44102590 0x7f9e44107990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009900 tx=0x7f9e3402a440 comp rx=0 tx=0).stop 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.729+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/1311925160 shutdown_connections 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.729+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/1311925160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e441029a0 0x7f9e44107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.729+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/1311925160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e44102590 0x7f9e44107990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.729+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/1311925160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e4406a5d0 0x7f9e44102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.729+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/1311925160 >> 172.21.15.47:0/1311925160 conn(0x7f9e44077ae0 msgr2=0x7f9e44077f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.733+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/1311925160 shutdown_connections 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.733+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/1311925160 wait complete. 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.734+0000 7f9e4c3cb640 1 Processor -- start 2024-09-21T01:04:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.734+0000 7f9e4c3cb640 1 -- start start 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.735+0000 7f9e4c3cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4406a5d0 0x7f9e4410ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.735+0000 7f9e4c3cb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e44102590 0x7f9e4410f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.735+0000 7f9e4c3cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e441029a0 0x7f9e4410f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.735+0000 7f9e4c3cb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4410b700 con 0x7f9e4406a5d0 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.735+0000 7f9e4c3cb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4410b580 con 0x7f9e44102590 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.735+0000 7f9e4c3cb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4410b880 con 0x7f9e441029a0 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.738+0000 7f9e4a167640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4406a5d0 0x7f9e4410ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.738+0000 7f9e4a167640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4406a5d0 0x7f9e4410ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39086/0 (socket says 172.21.15.47:39086) 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.738+0000 7f9e4a167640 1 -- 172.21.15.47:0/2121960094 learned_addr learned my addr 172.21.15.47:0/2121960094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.738+0000 7f9e4a968640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e441029a0 0x7f9e4410f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.738+0000 7f9e49966640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e44102590 0x7f9e4410f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.739+0000 7f9e4a968640 1 -- 172.21.15.47:0/2121960094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e44102590 msgr2=0x7f9e4410f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.739+0000 7f9e4a968640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e44102590 0x7f9e4410f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.739+0000 7f9e4a968640 1 -- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4406a5d0 msgr2=0x7f9e4410ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.739+0000 7f9e4a968640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4406a5d0 0x7f9e4410ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.739+0000 7f9e4a968640 1 -- 172.21.15.47:0/2121960094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e440740c0 con 0x7f9e441029a0 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.739+0000 7f9e4a968640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e441029a0 0x7f9e4410f910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00be20 tx=0x7f9e3c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.740+0000 7f9e3b7fe640 1 -- 172.21.15.47:0/2121960094 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c019070 con 0x7f9e441029a0 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.740+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/2121960094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e440743b0 con 0x7f9e441029a0 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.740+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/2121960094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e440748c0 con 0x7f9e441029a0 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.740+0000 7f9e3b7fe640 1 -- 172.21.15.47:0/2121960094 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e3c0148f0 con 0x7f9e441029a0 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.740+0000 7f9e3b7fe640 1 -- 172.21.15.47:0/2121960094 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c012840 con 0x7f9e441029a0 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.744+0000 7f9e5293f740 1 Processor -- start 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.745+0000 7f9e3b7fe640 1 -- 172.21.15.47:0/2121960094 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9e3c01c070 con 0x7f9e441029a0 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.746+0000 7f9e3b7fe640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f9e300b6610 0x7f9e300b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.747+0000 7f9e3b7fe640 1 -- 172.21.15.47:0/2121960094 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f9e3c0e6770 con 0x7f9e441029a0 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.747+0000 7f9e49966640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f9e300b6610 0x7f9e300b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.747+0000 7f9e5293f740 1 -- start start 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1d7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e5293f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55824f14de60 con 0x55824ee0f670 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e5293f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55824f13d290 con 0x55824ee30350 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e5293f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55824f1410a0 con 0x55824ee07490 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e4a167640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e4a167640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1d7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:50334/0 (socket says 172.21.15.47:50334) 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e4a167640 1 -- 172.21.15.47:0/3698448581 learned_addr learned my addr 172.21.15.47:0/3698448581 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e49966640 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1d7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.748+0000 7f9e4a968640 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.749+0000 7f9e4a167640 1 -- 172.21.15.47:0/3698448581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 msgr2=0x55824f1d7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.749+0000 7f9e4a167640 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1d7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.749+0000 7f9e4a167640 1 -- 172.21.15.47:0/3698448581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 msgr2=0x55824f1d8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.749+0000 7f9e4a167640 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1d8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.749+0000 7f9e4a167640 1 -- 172.21.15.47:0/3698448581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824ee9b930 con 0x55824ee30350 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.749+0000 7f9e49966640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f9e300b6610 0x7f9e300b8b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000c00 tx=0x7f9e34005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.749+0000 7f9e4a167640 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1d7610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009d70 tx=0x7f9e40011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de702d5333a2494b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.750+0000 7f9e38d9a640 1 -- 172.21.15.47:0/3698448581 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4001e070 con 0x55824ee30350 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.750+0000 7f9e38d9a640 1 -- 172.21.15.47:0/3698448581 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e40019ae0 con 0x55824ee30350 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.751+0000 7f9e5293f740 1 -- 172.21.15.47:0/3698448581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 msgr2=0x55824f1d7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.751+0000 7f9e5293f740 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1d7610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009d70 tx=0x7f9e40011810 comp rx=0 tx=0).stop 2024-09-21T01:04:13.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.752+0000 7f9e5293f740 1 -- 172.21.15.47:0/3698448581 shutdown_connections 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.752+0000 7f9e5293f740 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1d8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.752+0000 7f9e5293f740 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1d7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.752+0000 7f9e5293f740 1 --2- 172.21.15.47:0/3698448581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1d7610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.752+0000 7f9e5293f740 1 -- 172.21.15.47:0/3698448581 >> 172.21.15.47:0/3698448581 conn(0x55824ee24740 msgr2=0x55824f1d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.753+0000 7f9e5293f740 1 -- 172.21.15.47:0/3698448581 shutdown_connections 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.753+0000 7f9e5293f740 1 -- 172.21.15.47:0/3698448581 wait complete. 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.753+0000 7f9e5293f740 1 -- start start 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.754+0000 7f9e5293f740 1 Processor -- start 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.754+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1e3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.754+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.754+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1ef210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.754+0000 7f9e5293f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55824ef9e890 con 0x55824ee0f670 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.754+0000 7f9e5293f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55824f0d7d40 con 0x55824ee30350 2024-09-21T01:04:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.754+0000 7f9e5293f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55824f1e5e40 con 0x55824ee07490 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.754+0000 7f9e5293f740 10 client.0 _ll_register_callbacks cb 0x55824f13bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.755+0000 7f9e49966640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.755+0000 7f9e49966640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39106/0 (socket says 172.21.15.47:39106) 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.755+0000 7f9e49966640 1 -- 172.21.15.47:0/1290647513 learned_addr learned my addr 172.21.15.47:0/1290647513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.756+0000 7f9e4a167640 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.756+0000 7f9e4a968640 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1ef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.758+0000 7f9e49966640 1 -- 172.21.15.47:0/1290647513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 msgr2=0x55824f1e3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.758+0000 7f9e49966640 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1e3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.758+0000 7f9e49966640 1 -- 172.21.15.47:0/1290647513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 msgr2=0x55824f1ef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.758+0000 7f9e49966640 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1ef210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.758+0000 7f9e49966640 1 -- 172.21.15.47:0/1290647513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824f1ef780 con 0x55824ee0f670 2024-09-21T01:04:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.759+0000 7f9e49966640 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e36b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9e440758f0 tx=0x7f9e3402a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af970a348be491fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.759+0000 7f9e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.760+0000 7f9e2dffb640 1 -- 172.21.15.47:0/1290647513 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3404a850 con 0x55824ee0f670 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.760+0000 7f9e2dffb640 1 -- 172.21.15.47:0/1290647513 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f9e3404a9f0 con 0x55824ee0f670 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.760+0000 7f9e5293f740 1 -- 172.21.15.47:0/1290647513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55824f14fdb0 con 0x55824ee0f670 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.761+0000 7f9e2dffb640 1 -- 172.21.15.47:0/1290647513 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9e3404abf0 con 0x55824ee0f670 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.761+0000 7f9e5293f740 10 client.15987 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.761+0000 7f9e5293f740 1 -- 172.21.15.47:0/1290647513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55824f1f20e0 con 0x55824ee0f670 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.762+0000 7f9e2dffb640 1 -- 172.21.15.47:0/1290647513 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55824f14fdb0 con 0x55824ee0f670 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.762+0000 7f9e2dffb640 1 -- 172.21.15.47:0/1290647513 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9e34031440 con 0x55824ee0f670 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.762+0000 7f9e5293f740 10 client.15987 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.762+0000 7f9e5293f740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.762+0000 7f9e5293f740 20 client.15987 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.762+0000 7f9e5293f740 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55824edeecd0 0x55824f1f5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.762+0000 7f9e5293f740 4 client.15987 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.762+0000 7f9e5293f740 1 -- 172.21.15.47:0/1290647513 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55824f14b860 con 0x55824edeecd0 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.763+0000 7f9e4a167640 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55824edeecd0 0x55824f1f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.764+0000 7f9e4a167640 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55824edeecd0 0x55824f1f5620 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d083d82dbdc92c5 server_cookie=21675a8d0b36f952 in_seq=0 out_seq=0 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.764+0000 7f9e2dffb640 10 client.15987 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.765+0000 7f9e2dffb640 1 -- 172.21.15.47:0/1290647513 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55824f14b860 con 0x55824edeecd0 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.765+0000 7f9e2dffb640 10 client.15987 handle_command_reply: tid=0 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.765+0000 7f9e5293f740 1 client.15987 shutdown 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 -- 172.21.15.47:0/1290647513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 msgr2=0x55824f1e36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e36b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9e440758f0 tx=0x7f9e3402a440 comp rx=0 tx=0).stop 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 -- 172.21.15.47:0/1290647513 shutdown_connections 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55824edeecd0 0x55824f1f5620 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee30350 0x55824f1ef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e36b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 --2- 172.21.15.47:0/1290647513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1e3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 -- 172.21.15.47:0/1290647513 >> 172.21.15.47:0/1290647513 conn(0x55824ee24740 msgr2=0x55824f1da7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:13.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e2dffb640 0 client.15987 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:13.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.766+0000 7f9e5293f740 1 -- 172.21.15.47:0/1290647513 shutdown_connections 2024-09-21T01:04:13.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.767+0000 7f9e5293f740 1 -- 172.21.15.47:0/1290647513 wait complete. 2024-09-21T01:04:13.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.767+0000 7f9e5293f740 20 client.15987 trim_cache size 0 max 16384 2024-09-21T01:04:13.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.805+0000 7f9e5293f740 1 Processor -- start 2024-09-21T01:04:13.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.806+0000 7f9e5293f740 1 -- start start 2024-09-21T01:04:13.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.807+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.809+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee0f670 0x55824f1d5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.809+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee30350 0x55824f1e0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.809+0000 7f9e49966640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee0f670 0x55824f1d5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.810+0000 7f9e5293f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800c470 con 0x55824ee30350 2024-09-21T01:04:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.810+0000 7f9e5293f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800ecf0 con 0x55824ee0f670 2024-09-21T01:04:13.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.810+0000 7f9e5293f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800cae0 con 0x55824ee07490 2024-09-21T01:04:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.811+0000 7f9e4a968640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee30350 0x55824f1e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.811+0000 7f9e4a968640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee30350 0x55824f1e0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39122/0 (socket says 172.21.15.47:39122) 2024-09-21T01:04:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.811+0000 7f9e4a968640 1 -- 172.21.15.47:0/2887356446 learned_addr learned my addr 172.21.15.47:0/2887356446 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.811+0000 7f9e4a167640 1 --2- 172.21.15.47:0/2887356446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.812+0000 7f9e4a968640 1 -- 172.21.15.47:0/2887356446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 msgr2=0x55824f1d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.812+0000 7f9e4a968640 1 --2- 172.21.15.47:0/2887356446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1d4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.812+0000 7f9e4a968640 1 -- 172.21.15.47:0/2887356446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee0f670 msgr2=0x55824f1d5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.812+0000 7f9e4a968640 1 --2- 172.21.15.47:0/2887356446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee0f670 0x55824f1d5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.812+0000 7f9e4a968640 1 -- 172.21.15.47:0/2887356446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824f1e1ed0 con 0x55824ee30350 2024-09-21T01:04:13.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.813+0000 7f9e4a968640 1 --2- 172.21.15.47:0/2887356446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee30350 0x55824f1e0160 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0e4270 tx=0x7f9e3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1abe206507f120 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:13.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.814+0000 7f9e2ffff640 1 -- 172.21.15.47:0/2887356446 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0a8120 con 0x55824ee30350 2024-09-21T01:04:13.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.814+0000 7f9e2ffff640 1 -- 172.21.15.47:0/2887356446 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e3c0b11c0 con 0x55824ee30350 2024-09-21T01:04:13.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 -- 172.21.15.47:0/2887356446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee30350 msgr2=0x55824f1e0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2887356446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee30350 0x55824f1e0160 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0e4270 tx=0x7f9e3c004a40 comp rx=0 tx=0).stop 2024-09-21T01:04:13.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 -- 172.21.15.47:0/2887356446 shutdown_connections 2024-09-21T01:04:13.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2887356446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee30350 0x55824f1e0160 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2887356446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824ee0f670 0x55824f1d5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2887356446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1d4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 -- 172.21.15.47:0/2887356446 >> 172.21.15.47:0/2887356446 conn(0x55824ee24740 msgr2=0x55824f1de120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:13.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 -- 172.21.15.47:0/2887356446 shutdown_connections 2024-09-21T01:04:13.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.816+0000 7f9e5293f740 1 -- 172.21.15.47:0/2887356446 wait complete. 2024-09-21T01:04:13.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.817+0000 7f9e5293f740 1 -- start start 2024-09-21T01:04:13.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.818+0000 7f9e5293f740 1 Processor -- start 2024-09-21T01:04:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.819+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.819+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.819+0000 7f9e5293f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824edc4080 0x55824f1e6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.820+0000 7f9e5293f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800d1b0 con 0x55824ee0f670 2024-09-21T01:04:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.820+0000 7f9e5293f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800e620 con 0x55824edc4080 2024-09-21T01:04:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.820+0000 7f9e5293f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2800d880 con 0x55824ee07490 2024-09-21T01:04:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.820+0000 7f9e5293f740 10 client.0 _ll_register_callbacks cb 0x7f9e34004c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:13.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.821+0000 7f9e49966640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.822+0000 7f9e4a968640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824edc4080 0x55824f1e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.822+0000 7f9e4a167640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.822+0000 7f9e4a968640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824edc4080 0x55824f1e6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:50360/0 (socket says 172.21.15.47:50360) 2024-09-21T01:04:13.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.822+0000 7f9e4a968640 1 -- 172.21.15.47:0/2347761305 learned_addr learned my addr 172.21.15.47:0/2347761305 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:13.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.823+0000 7f9e49966640 1 -- 172.21.15.47:0/2347761305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 msgr2=0x55824f1ebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:13.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.823+0000 7f9e49966640 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1ebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.823+0000 7f9e49966640 1 -- 172.21.15.47:0/2347761305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824edc4080 msgr2=0x55824f1e6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:13.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.823+0000 7f9e49966640 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824edc4080 0x55824f1e6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.823+0000 7f9e49966640 1 -- 172.21.15.47:0/2347761305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824f25ffe0 con 0x55824ee0f670 2024-09-21T01:04:13.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.824+0000 7f9e49966640 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e6130 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9e340094b0 tx=0x7f9e34004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c0d18a16f78b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:13.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.824+0000 7f9e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:04:13.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.824+0000 7f9e2dffb640 1 -- 172.21.15.47:0/2347761305 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34031c90 con 0x55824ee0f670 2024-09-21T01:04:13.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.825+0000 7f9e5293f740 1 -- 172.21.15.47:0/2347761305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55824f148c90 con 0x55824ee0f670 2024-09-21T01:04:13.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.825+0000 7f9e2dffb640 1 -- 172.21.15.47:0/2347761305 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f9e3404a850 con 0x55824ee0f670 2024-09-21T01:04:13.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.825+0000 7f9e2dffb640 1 -- 172.21.15.47:0/2347761305 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9e34053470 con 0x55824ee0f670 2024-09-21T01:04:13.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.826+0000 7f9e5293f740 10 client.15993 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:13.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.826+0000 7f9e5293f740 1 -- 172.21.15.47:0/2347761305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55824f261180 con 0x55824ee0f670 2024-09-21T01:04:13.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.826+0000 7f9e2dffb640 1 -- 172.21.15.47:0/2347761305 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55824f148c90 con 0x55824ee0f670 2024-09-21T01:04:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.826+0000 7f9e2dffb640 1 -- 172.21.15.47:0/2347761305 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9e3406f050 con 0x55824ee0f670 2024-09-21T01:04:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.828+0000 7f9e5293f740 10 client.15993 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.828+0000 7f9e5293f740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.828+0000 7f9e5293f740 20 client.15993 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.828+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55824f2618d0 0x55824f263cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.828+0000 7f9e5293f740 4 client.15993 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:04:13.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.828+0000 7f9e5293f740 1 -- 172.21.15.47:0/2347761305 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55824f0be990 con 0x55824f2618d0 2024-09-21T01:04:13.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.832+0000 7f9e4a167640 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55824f2618d0 0x55824f263cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:13.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.847+0000 7f9e4a167640 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55824f2618d0 0x55824f263cf0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6147894639ee2c43 server_cookie=77315fa8383aa2b7 in_seq=0 out_seq=0 2024-09-21T01:04:13.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.847+0000 7f9e2dffb640 10 client.15993 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:13.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.849+0000 7f9e2dffb640 1 -- 172.21.15.47:0/2347761305 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55824f0be990 con 0x55824f2618d0 2024-09-21T01:04:13.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.849+0000 7f9e2dffb640 10 client.15993 handle_command_reply: tid=0 2024-09-21T01:04:13.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.849+0000 7f9e5293f740 1 client.15993 shutdown 2024-09-21T01:04:13.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.852+0000 7f9e5293f740 1 -- 172.21.15.47:0/2347761305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 msgr2=0x55824f1e6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.852+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e6130 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9e340094b0 tx=0x7f9e34004b90 comp rx=0 tx=0).stop 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.854+0000 7f9e5293f740 1 -- 172.21.15.47:0/2347761305 shutdown_connections 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.854+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55824f2618d0 0x55824f263cf0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.855+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55824edc4080 0x55824f1e6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.855+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55824ee0f670 0x55824f1e6130 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.855+0000 7f9e5293f740 1 --2- 172.21.15.47:0/2347761305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55824ee07490 0x55824f1ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.855+0000 7f9e5293f740 1 -- 172.21.15.47:0/2347761305 >> 172.21.15.47:0/2347761305 conn(0x55824ee24740 msgr2=0x55824f1d4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.855+0000 7f9e2dffb640 0 client.15993 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.855+0000 7f9e5293f740 1 -- 172.21.15.47:0/2347761305 shutdown_connections 2024-09-21T01:04:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.855+0000 7f9e5293f740 1 -- 172.21.15.47:0/2347761305 wait complete. 2024-09-21T01:04:13.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.855+0000 7f9e5293f740 20 client.15993 trim_cache size 0 max 16384 2024-09-21T01:04:13.857 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:04:13.857 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-09-21T01:04:13.857 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87", 2024-09-21T01:04:13.857 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-09-21T01:04:13.857 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:04:13.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.856+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f9e300b6610 msgr2=0x7f9e300b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.856+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f9e300b6610 0x7f9e300b8b20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000c00 tx=0x7f9e34005fd0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.856+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/2121960094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e441029a0 msgr2=0x7f9e4410f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:13.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.856+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e441029a0 0x7f9e4410f910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00be20 tx=0x7f9e3c00bf10 comp rx=0 tx=0).stop 2024-09-21T01:04:13.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.857+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/2121960094 shutdown_connections 2024-09-21T01:04:13.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.857+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f9e300b6610 0x7f9e300b8b20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.857+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e441029a0 0x7f9e4410f910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.857+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e44102590 0x7f9e4410f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.857+0000 7f9e4c3cb640 1 --2- 172.21.15.47:0/2121960094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e4406a5d0 0x7f9e4410ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:13.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.857+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/2121960094 >> 172.21.15.47:0/2121960094 conn(0x7f9e44077ae0 msgr2=0x7f9e44104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:13.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.857+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/2121960094 shutdown_connections 2024-09-21T01:04:13.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:13.857+0000 7f9e4c3cb640 1 -- 172.21.15.47:0/2121960094 wait complete. 2024-09-21T01:04:15.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:04:15.243 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:14 smithi047 ceph-mon[30960]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 36 MiB/s wr, 5.88k op/s 2024-09-21T01:04:15.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:14 smithi047 ceph-mon[30960]: scrub queued for path: / 2024-09-21T01:04:15.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:14 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:15.244 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:14 smithi047 ceph-mon[30960]: scrub summary: active paths [/] 2024-09-21T01:04:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:14 smithi134 ceph-mon[34785]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 36 MiB/s wr, 5.88k op/s 2024-09-21T01:04:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:14 smithi134 ceph-mon[34785]: scrub queued for path: / 2024-09-21T01:04:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:14 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:14 smithi134 ceph-mon[34785]: scrub summary: active paths [/] 2024-09-21T01:04:15.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:14 smithi114 ceph-mon[34309]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 36 MiB/s wr, 5.88k op/s 2024-09-21T01:04:15.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:14 smithi114 ceph-mon[34309]: scrub queued for path: / 2024-09-21T01:04:15.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:14 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:15.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:14 smithi114 ceph-mon[34309]: scrub summary: active paths [/] 2024-09-21T01:04:15.493 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 -- 172.21.15.47:0/128864217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15041025d0 msgr2=0x7f15041029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 --2- 172.21.15.47:0/128864217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15041025d0 0x7f15041029e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009900 tx=0x7f14f802a480 comp rx=0 tx=0).stop 2024-09-21T01:04:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 -- 172.21.15.47:0/128864217 shutdown_connections 2024-09-21T01:04:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 --2- 172.21.15.47:0/128864217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1504110180 0x7f15041125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 --2- 172.21.15.47:0/128864217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1504102f20 0x7f150410fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 --2- 172.21.15.47:0/128864217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15041025d0 0x7f15041029e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 -- 172.21.15.47:0/128864217 >> 172.21.15.47:0/128864217 conn(0x7f1504079730 msgr2=0x7f1504079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 -- 172.21.15.47:0/128864217 shutdown_connections 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.348+0000 7f150aaca640 1 -- 172.21.15.47:0/128864217 wait complete. 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f150aaca640 1 Processor -- start 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f150aaca640 1 -- start start 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f150aaca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15041025d0 0x7f150419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f150aaca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1504102f20 0x7f150419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f150aaca640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1504110180 0x7f15041a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f150aaca640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1504115c70 con 0x7f1504102f20 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f150aaca640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1504115af0 con 0x7f1504110180 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f150aaca640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1504115df0 con 0x7f15041025d0 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f1503fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1504102f20 0x7f150419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f1503fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1504102f20 0x7f150419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39156/0 (socket says 172.21.15.47:39156) 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f1503fff640 1 -- 172.21.15.47:0/822113631 learned_addr learned my addr 172.21.15.47:0/822113631 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f1508866640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15041025d0 0x7f150419c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.349+0000 7f1509067640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1504110180 0x7f15041a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1503fff640 1 -- 172.21.15.47:0/822113631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15041025d0 msgr2=0x7f150419c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1503fff640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15041025d0 0x7f150419c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1503fff640 1 -- 172.21.15.47:0/822113631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1504110180 msgr2=0x7f15041a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1503fff640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1504110180 0x7f15041a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1503fff640 1 -- 172.21.15.47:0/822113631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15041a25d0 con 0x7f1504102f20 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1509067640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1504110180 0x7f15041a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1508866640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15041025d0 0x7f150419c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:16.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1503fff640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1504102f20 0x7f150419cc00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f14f000e9f0 tx=0x7f14f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1501ffb640 1 -- 172.21.15.47:0/822113631 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f000cd80 con 0x7f1504102f20 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f150aaca640 1 -- 172.21.15.47:0/822113631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15041a28c0 con 0x7f1504102f20 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1501ffb640 1 -- 172.21.15.47:0/822113631 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14f00054d0 con 0x7f1504102f20 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f1501ffb640 1 -- 172.21.15.47:0/822113631 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0010690 con 0x7f1504102f20 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.350+0000 7f150aaca640 1 -- 172.21.15.47:0/822113631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15041a9020 con 0x7f1504102f20 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.353+0000 7f151103e740 1 Processor -- start 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.353+0000 7f151103e740 1 -- start start 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1501ffb640 1 -- 172.21.15.47:0/822113631 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f14f0004e90 con 0x7f1504102f20 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f151103e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4df4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f151103e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a241b0 0x5595d4df47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f151103e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a2c390 0x5595d4df4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f151103e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5595d4d6ae50 con 0x5595d4a4d070 2024-09-21T01:04:16.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f151103e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5595d4d5a280 con 0x5595d4a2c390 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f151103e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5595d4d5e090 con 0x5595d4a241b0 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1509067640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4df4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1509067640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4df4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39166/0 (socket says 172.21.15.47:39166) 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1509067640 1 -- 172.21.15.47:0/4174331545 learned_addr learned my addr 172.21.15.47:0/4174331545 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1503fff640 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a2c390 0x5595d4df4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1508866640 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a241b0 0x5595d4df47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1509067640 1 -- 172.21.15.47:0/4174331545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a241b0 msgr2=0x5595d4df47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1509067640 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a241b0 0x5595d4df47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1509067640 1 -- 172.21.15.47:0/4174331545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a2c390 msgr2=0x5595d4df4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1509067640 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a2c390 0x5595d4df4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.354+0000 7f1509067640 1 -- 172.21.15.47:0/4174331545 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d4ab8650 con 0x5595d4a4d070 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.355+0000 7f1509067640 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4df4270 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009fd0 tx=0x7f14fc0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1578d1c70c355d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:16.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.355+0000 7f14eeffd640 1 -- 172.21.15.47:0/4174331545 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc011760 con 0x5595d4a4d070 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.355+0000 7f14eeffd640 1 -- 172.21.15.47:0/4174331545 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14fc011db0 con 0x5595d4a4d070 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.355+0000 7f1501ffb640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f14f40b6510 0x7f14f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.355+0000 7f14eeffd640 1 -- 172.21.15.47:0/4174331545 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00e3c0 con 0x5595d4a4d070 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.355+0000 7f1508866640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f14f40b6510 0x7f14f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.355+0000 7f1501ffb640 1 -- 172.21.15.47:0/822113631 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f14f00e7700 con 0x7f1504102f20 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f1508866640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f14f40b6510 0x7f14f40b8a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f14f8031440 tx=0x7f14f8032ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 -- 172.21.15.47:0/4174331545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 msgr2=0x5595d4df4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4df4270 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009fd0 tx=0x7f14fc0108e0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 -- 172.21.15.47:0/4174331545 shutdown_connections 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a2c390 0x5595d4df4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a241b0 0x5595d4df47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 --2- 172.21.15.47:0/4174331545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4df4270 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 -- 172.21.15.47:0/4174331545 >> 172.21.15.47:0/4174331545 conn(0x5595d4a41460 msgr2=0x5595d4df2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:16.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 -- 172.21.15.47:0/4174331545 shutdown_connections 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 -- 172.21.15.47:0/4174331545 wait complete. 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 -- start start 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.356+0000 7f151103e740 1 Processor -- start 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f151103e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4dff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f151103e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4dffe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f151103e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e0bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f151103e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5595d4bbb700 con 0x5595d4a4d070 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f151103e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5595d4cf5110 con 0x5595d4a241b0 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f151103e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5595d4e02a50 con 0x5595d4a2c390 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f151103e740 10 client.0 _ll_register_callbacks cb 0x5595d4d0e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1509067640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e0bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1508866640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4dff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1509067640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e0bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39178/0 (socket says 172.21.15.47:39178) 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1509067640 1 -- 172.21.15.47:0/1973388631 learned_addr learned my addr 172.21.15.47:0/1973388631 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1503fff640 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4dffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1508866640 1 -- 172.21.15.47:0/1973388631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 msgr2=0x5595d4dffe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1508866640 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4dffe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1508866640 1 -- 172.21.15.47:0/1973388631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 msgr2=0x5595d4e0bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1508866640 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e0bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.357+0000 7f1508866640 1 -- 172.21.15.47:0/1973388631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d4d22c40 con 0x5595d4a241b0 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f1508866640 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4dff8e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009230 tx=0x7f14f8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49be359026657ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f14e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f14e3fff640 1 -- 172.21.15.47:0/1973388631 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f804d070 con 0x5595d4a241b0 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f14e3fff640 1 -- 172.21.15.47:0/1973388631 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f14f8004460 con 0x5595d4a241b0 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f151103e740 1 -- 172.21.15.47:0/1973388631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14fc011db0 con 0x5595d4a241b0 2024-09-21T01:04:16.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f14e3fff640 1 -- 172.21.15.47:0/1973388631 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f14f8059050 con 0x5595d4a241b0 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f151103e740 10 client.25673 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f151103e740 1 -- 172.21.15.47:0/1973388631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5595d4e0e720 con 0x5595d4a241b0 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f14e3fff640 1 -- 172.21.15.47:0/1973388631 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14fc011db0 con 0x5595d4a241b0 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.358+0000 7f14e3fff640 1 -- 172.21.15.47:0/1973388631 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f14f8003ab0 con 0x5595d4a241b0 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f151103e740 10 client.25673 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f151103e740 10 client.25673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f151103e740 20 client.25673 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f151103e740 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5595d4a0b9f0 0x5595d4e11bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f151103e740 4 client.25673 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f151103e740 1 -- 172.21.15.47:0/1973388631 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595d4d6cda0 con 0x5595d4a0b9f0 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f1503fff640 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5595d4a0b9f0 0x5595d4e11bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f14e3fff640 10 client.25673 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.359+0000 7f1503fff640 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5595d4a0b9f0 0x5595d4e11bf0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=340989e36c51fef0 server_cookie=926e0d3aa4972427 in_seq=0 out_seq=0 2024-09-21T01:04:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f14e3fff640 1 -- 172.21.15.47:0/1973388631 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595d4d6cda0 con 0x5595d4a0b9f0 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f14e3fff640 10 client.25673 handle_command_reply: tid=0 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 client.25673 shutdown 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 -- 172.21.15.47:0/1973388631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 msgr2=0x5595d4dff8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4dff8e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009230 tx=0x7f14f8009260 comp rx=0 tx=0).stop 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 -- 172.21.15.47:0/1973388631 shutdown_connections 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5595d4a0b9f0 0x5595d4e11bf0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e0bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4dffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 --2- 172.21.15.47:0/1973388631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4dff8e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 -- 172.21.15.47:0/1973388631 >> 172.21.15.47:0/1973388631 conn(0x5595d4a41460 msgr2=0x5595d4df7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f14e3fff640 0 client.25673 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 -- 172.21.15.47:0/1973388631 shutdown_connections 2024-09-21T01:04:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 1 -- 172.21.15.47:0/1973388631 wait complete. 2024-09-21T01:04:16.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.360+0000 7f151103e740 20 client.25673 trim_cache size 0 max 16384 2024-09-21T01:04:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f151103e740 1 Processor -- start 2024-09-21T01:04:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f151103e740 1 -- start start 2024-09-21T01:04:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f151103e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f151103e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a2c390 0x5595d4df59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f151103e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a4d070 0x5595d4e0bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f151103e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15041af3c0 con 0x5595d4a2c390 2024-09-21T01:04:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f151103e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f15041b1c40 con 0x5595d4a241b0 2024-09-21T01:04:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f151103e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15041afa30 con 0x5595d4a4d070 2024-09-21T01:04:16.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f1503fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a2c390 0x5595d4df59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f1503fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a2c390 0x5595d4df59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39194/0 (socket says 172.21.15.47:39194) 2024-09-21T01:04:16.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f1503fff640 1 -- 172.21.15.47:0/114961848 learned_addr learned my addr 172.21.15.47:0/114961848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:16.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f1509067640 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a4d070 0x5595d4e0bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.385+0000 7f1508866640 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f1509067640 1 -- 172.21.15.47:0/114961848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 msgr2=0x5595d4e017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f1509067640 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f1509067640 1 -- 172.21.15.47:0/114961848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a2c390 msgr2=0x5595d4df59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f1509067640 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a2c390 0x5595d4df59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f1509067640 1 -- 172.21.15.47:0/114961848 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d4ded580 con 0x5595d4a4d070 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f1509067640 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a4d070 0x5595d4e0bc40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f14fc011fa0 tx=0x7f14fc009d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e6d1206dbc294f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f14ee7fc640 1 -- 172.21.15.47:0/114961848 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc01b630 con 0x5595d4a4d070 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f14ee7fc640 1 -- 172.21.15.47:0/114961848 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14fc02a070 con 0x5595d4a4d070 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.386+0000 7f14ee7fc640 1 -- 172.21.15.47:0/114961848 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc011b40 con 0x5595d4a4d070 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 -- 172.21.15.47:0/114961848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a4d070 msgr2=0x5595d4e0bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a4d070 0x5595d4e0bc40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f14fc011fa0 tx=0x7f14fc009d60 comp rx=0 tx=0).stop 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 -- 172.21.15.47:0/114961848 shutdown_connections 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a4d070 0x5595d4e0bc40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a2c390 0x5595d4df59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 --2- 172.21.15.47:0/114961848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 -- 172.21.15.47:0/114961848 >> 172.21.15.47:0/114961848 conn(0x5595d4a41460 msgr2=0x5595d4df52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 -- 172.21.15.47:0/114961848 shutdown_connections 2024-09-21T01:04:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.387+0000 7f151103e740 1 -- 172.21.15.47:0/114961848 wait complete. 2024-09-21T01:04:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 1 -- start start 2024-09-21T01:04:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 1 Processor -- start 2024-09-21T01:04:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e03e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4e043b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15041b0100 con 0x5595d4a4d070 2024-09-21T01:04:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f15041b1570 con 0x5595d4a241b0 2024-09-21T01:04:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15041b07d0 con 0x5595d4a2c390 2024-09-21T01:04:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f151103e740 10 client.0 _ll_register_callbacks cb 0x7f14f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f1503fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4e043b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f1508866640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e03e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f1503fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4e043b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:47766/0 (socket says 172.21.15.47:47766) 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f1503fff640 1 -- 172.21.15.47:0/902264889 learned_addr learned my addr 172.21.15.47:0/902264889 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.388+0000 7f1509067640 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f1508866640 1 -- 172.21.15.47:0/902264889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 msgr2=0x5595d4e043b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f1508866640 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4e043b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f1508866640 1 -- 172.21.15.47:0/902264889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 msgr2=0x5595d4e048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f1508866640 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f1508866640 1 -- 172.21.15.47:0/902264889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d4e7b7b0 con 0x5595d4a241b0 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f1503fff640 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4e043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f1508866640 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e03e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f14f8033000 tx=0x7f14f8009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b1ab314ff5ce71e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f14e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f14e3fff640 1 -- 172.21.15.47:0/902264889 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f804d040 con 0x5595d4a241b0 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f14e3fff640 1 -- 172.21.15.47:0/902264889 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f14f8004460 con 0x5595d4a241b0 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f151103e740 1 -- 172.21.15.47:0/902264889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14fc02a070 con 0x5595d4a241b0 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.389+0000 7f14e3fff640 1 -- 172.21.15.47:0/902264889 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f14f8035040 con 0x5595d4a241b0 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f151103e740 10 client.25679 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f151103e740 1 -- 172.21.15.47:0/902264889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5595d4e7ca40 con 0x5595d4a241b0 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f14e3fff640 1 -- 172.21.15.47:0/902264889 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14fc02a070 con 0x5595d4a241b0 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f14e3fff640 1 -- 172.21.15.47:0/902264889 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f14f8003a00 con 0x5595d4a241b0 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f151103e740 10 client.25679 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f151103e740 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f151103e740 20 client.25679 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f151103e740 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5595d49e0da0 0x5595d4e7f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:16.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f151103e740 4 client.25679 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f151103e740 1 -- 172.21.15.47:0/902264889 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5595d4d68850 con 0x5595d49e0da0 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.390+0000 7f1503fff640 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5595d49e0da0 0x5595d4e7f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f14e3fff640 10 client.25679 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f1503fff640 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5595d49e0da0 0x5595d4e7f200 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39a16220bdddfef4 server_cookie=76258a8cdcc1f531 in_seq=0 out_seq=0 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f14e3fff640 1 -- 172.21.15.47:0/902264889 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1998 (crc 0 0 0) 0x5595d4d68850 con 0x5595d49e0da0 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f14e3fff640 10 client.25679 handle_command_reply: tid=0 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 client.25679 shutdown 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 -- 172.21.15.47:0/902264889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 msgr2=0x5595d4e03e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e03e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f14f8033000 tx=0x7f14f8009610 comp rx=0 tx=0).stop 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 -- 172.21.15.47:0/902264889 shutdown_connections 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5595d49e0da0 0x5595d4e7f200 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d4a4d070 0x5595d4e048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595d4a2c390 0x5595d4e043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f14e3fff640 0 client.25679 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 --2- 172.21.15.47:0/902264889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595d4a241b0 0x5595d4e03e70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 -- 172.21.15.47:0/902264889 >> 172.21.15.47:0/902264889 conn(0x5595d4a41460 msgr2=0x5595d4e01580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 -- 172.21.15.47:0/902264889 shutdown_connections 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 1 -- 172.21.15.47:0/902264889 wait complete. 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.391+0000 7f151103e740 20 client.25679 trim_cache size 0 max 16384 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (110 inodes in the stack)", 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:04:16.397 INFO:teuthology.orchestra.run.smithi047.stdout: "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87": { 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87", 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87": { 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:13.847440+0000", 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:16.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:16.399 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:04:16.400 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:16.401 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:16.402 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:04:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 -- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f14f40b6510 msgr2=0x7f14f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f14f40b6510 0x7f14f40b8a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f14f8031440 tx=0x7f14f8032ed0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 -- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1504102f20 msgr2=0x7f150419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1504102f20 0x7f150419cc00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f14f000e9f0 tx=0x7f14f000edf0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 -- 172.21.15.47:0/822113631 shutdown_connections 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f14f40b6510 0x7f14f40b8a20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1504110180 0x7f15041a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1504102f20 0x7f150419cc00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 --2- 172.21.15.47:0/822113631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15041025d0 0x7f150419c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 -- 172.21.15.47:0/822113631 >> 172.21.15.47:0/822113631 conn(0x7f1504079730 msgr2=0x7f1504109cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 -- 172.21.15.47:0/822113631 shutdown_connections 2024-09-21T01:04:16.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:16.392+0000 7f150aaca640 1 -- 172.21.15.47:0/822113631 wait complete. 2024-09-21T01:04:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:16 smithi134 ceph-mon[34785]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 33 MiB/s wr, 5.30k op/s 2024-09-21T01:04:17.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:16 smithi114 ceph-mon[34309]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 33 MiB/s wr, 5.30k op/s 2024-09-21T01:04:17.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:16 smithi047 ceph-mon[30960]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 33 MiB/s wr, 5.30k op/s 2024-09-21T01:04:17.491 INFO:tasks.cephfs.filesystem:scrub status for tag:471bdb03-cfd3-4b33-8a48-5de4a9ff8c87 - {'path': '/', 'tag': '471bdb03-cfd3-4b33-8a48-5de4a9ff8c87', 'options': 'recursive,force'} 2024-09-21T01:04:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:18 smithi134 ceph-mon[34785]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 35 MiB/s wr, 5.67k op/s 2024-09-21T01:04:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:18 smithi114 ceph-mon[34309]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 35 MiB/s wr, 5.67k op/s 2024-09-21T01:04:19.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:18 smithi047 ceph-mon[30960]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 35 MiB/s wr, 5.67k op/s 2024-09-21T01:04:21.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:20 smithi134 ceph-mon[34785]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 31 MiB/s wr, 5.01k op/s 2024-09-21T01:04:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:20 smithi114 ceph-mon[34309]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 31 MiB/s wr, 5.01k op/s 2024-09-21T01:04:21.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:20 smithi047 ceph-mon[30960]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 31 MiB/s wr, 5.01k op/s 2024-09-21T01:04:23.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:22 smithi047 ceph-mon[30960]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 31 MiB/s wr, 4.96k op/s 2024-09-21T01:04:23.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:23 smithi134 ceph-mon[34785]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 31 MiB/s wr, 4.96k op/s 2024-09-21T01:04:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:22 smithi114 ceph-mon[34309]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 31 MiB/s wr, 4.96k op/s 2024-09-21T01:04:25.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:25 smithi134 ceph-mon[34785]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 45 MiB/s wr, 6.56k op/s 2024-09-21T01:04:25.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:25 smithi114 ceph-mon[34309]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 45 MiB/s wr, 6.56k op/s 2024-09-21T01:04:25.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:24 smithi047 ceph-mon[30960]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 45 MiB/s wr, 6.56k op/s 2024-09-21T01:04:27.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:27 smithi134 ceph-mon[34785]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 40 MiB/s wr, 5.72k op/s 2024-09-21T01:04:27.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:27 smithi114 ceph-mon[34309]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 40 MiB/s wr, 5.72k op/s 2024-09-21T01:04:27.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:27 smithi047 ceph-mon[30960]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 40 MiB/s wr, 5.72k op/s 2024-09-21T01:04:29.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:29 smithi134 ceph-mon[34785]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 48 MiB/s wr, 6.70k op/s 2024-09-21T01:04:29.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:29 smithi114 ceph-mon[34309]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 48 MiB/s wr, 6.70k op/s 2024-09-21T01:04:29.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:29 smithi047 ceph-mon[30960]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 48 MiB/s wr, 6.70k op/s 2024-09-21T01:04:31.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:31 smithi134 ceph-mon[34785]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 46 MiB/s wr, 6.32k op/s 2024-09-21T01:04:31.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:31 smithi114 ceph-mon[34309]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 46 MiB/s wr, 6.32k op/s 2024-09-21T01:04:31.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:31 smithi047 ceph-mon[30960]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 46 MiB/s wr, 6.32k op/s 2024-09-21T01:04:33.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:33 smithi134 ceph-mon[34785]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 46 MiB/s wr, 6.25k op/s 2024-09-21T01:04:33.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:33 smithi114 ceph-mon[34309]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 46 MiB/s wr, 6.25k op/s 2024-09-21T01:04:33.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:33 smithi047 ceph-mon[30960]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 46 MiB/s wr, 6.25k op/s 2024-09-21T01:04:35.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:35 smithi134 ceph-mon[34785]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 48 MiB/s wr, 6.67k op/s 2024-09-21T01:04:35.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:35 smithi114 ceph-mon[34309]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 48 MiB/s wr, 6.67k op/s 2024-09-21T01:04:35.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:35 smithi047 ceph-mon[30960]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 48 MiB/s wr, 6.67k op/s 2024-09-21T01:04:37.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:37 smithi134 ceph-mon[34785]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 32 MiB/s wr, 4.59k op/s 2024-09-21T01:04:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:37 smithi114 ceph-mon[34309]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 32 MiB/s wr, 4.59k op/s 2024-09-21T01:04:37.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:37 smithi047 ceph-mon[30960]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 32 MiB/s wr, 4.59k op/s 2024-09-21T01:04:39.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:39 smithi134 ceph-mon[34785]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 38 MiB/s wr, 5.55k op/s 2024-09-21T01:04:39.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:39 smithi114 ceph-mon[34309]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 38 MiB/s wr, 5.55k op/s 2024-09-21T01:04:39.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:39 smithi047 ceph-mon[30960]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 38 MiB/s wr, 5.55k op/s 2024-09-21T01:04:41.271 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:41 smithi047 ceph-mon[30960]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 32 MiB/s wr, 4.65k op/s 2024-09-21T01:04:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:41 smithi134 ceph-mon[34785]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 32 MiB/s wr, 4.65k op/s 2024-09-21T01:04:41.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:41 smithi114 ceph-mon[34309]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 32 MiB/s wr, 4.65k op/s 2024-09-21T01:04:43.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:43 smithi134 ceph-mon[34785]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 31 MiB/s wr, 4.49k op/s 2024-09-21T01:04:43.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:43 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:43 smithi114 ceph-mon[34309]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 31 MiB/s wr, 4.49k op/s 2024-09-21T01:04:43.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:43 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:43.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:43 smithi047 ceph-mon[30960]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 31 MiB/s wr, 4.49k op/s 2024-09-21T01:04:43.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:43 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:45.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:45 smithi134 ceph-mon[34785]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 37 MiB/s wr, 5.48k op/s 2024-09-21T01:04:45.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:45 smithi134 ceph-mon[34785]: scrub summary: idle 2024-09-21T01:04:45.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:45 smithi114 ceph-mon[34309]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 37 MiB/s wr, 5.48k op/s 2024-09-21T01:04:45.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:45 smithi114 ceph-mon[34309]: scrub summary: idle 2024-09-21T01:04:45.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:45 smithi047 ceph-mon[30960]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 37 MiB/s wr, 5.48k op/s 2024-09-21T01:04:45.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:45 smithi047 ceph-mon[30960]: scrub summary: idle 2024-09-21T01:04:47.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:47 smithi134 ceph-mon[34785]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 33 MiB/s wr, 4.70k op/s 2024-09-21T01:04:47.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:47 smithi114 ceph-mon[34309]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 33 MiB/s wr, 4.70k op/s 2024-09-21T01:04:47.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:47 smithi047 ceph-mon[30960]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 33 MiB/s wr, 4.70k op/s 2024-09-21T01:04:47.492 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:04:47.838 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:48.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.368+0000 7f43279a1640 1 -- 172.21.15.47:0/2395138427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4320103b90 msgr2=0x7f4320103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.368+0000 7f43279a1640 1 --2- 172.21.15.47:0/2395138427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4320103b90 0x7f4320103fa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f431c009900 tx=0x7f431c02a410 comp rx=0 tx=0).stop 2024-09-21T01:04:48.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.369+0000 7f43279a1640 1 -- 172.21.15.47:0/2395138427 shutdown_connections 2024-09-21T01:04:48.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.369+0000 7f43279a1640 1 --2- 172.21.15.47:0/2395138427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4320109e20 0x7f4320110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.369+0000 7f43279a1640 1 --2- 172.21.15.47:0/2395138427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43201094d0 0x7f43201098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.369+0000 7f43279a1640 1 --2- 172.21.15.47:0/2395138427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4320103b90 0x7f4320103fa0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.369+0000 7f43279a1640 1 -- 172.21.15.47:0/2395138427 >> 172.21.15.47:0/2395138427 conn(0x7f43200ff5e0 msgr2=0x7f4320101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:48.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.369+0000 7f43279a1640 1 -- 172.21.15.47:0/2395138427 shutdown_connections 2024-09-21T01:04:48.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.369+0000 7f43279a1640 1 -- 172.21.15.47:0/2395138427 wait complete. 2024-09-21T01:04:48.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f43279a1640 1 Processor -- start 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f43279a1640 1 -- start start 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f43279a1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4320103b90 0x7f4320075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f43279a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43201094d0 0x7f4320075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f43279a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4320109e20 0x7f4320076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f43279a1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4320113b30 con 0x7f43201094d0 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f43279a1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f43201139b0 con 0x7f4320103b90 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f43279a1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4320113cb0 con 0x7f4320109e20 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.370+0000 7f4324f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43201094d0 0x7f4320075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f4324f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43201094d0 0x7f4320075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42356/0 (socket says 172.21.15.47:42356) 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f432573d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4320103b90 0x7f4320075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f4324f3c640 1 -- 172.21.15.47:0/3796270498 learned_addr learned my addr 172.21.15.47:0/3796270498 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:48.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f4325f3e640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4320109e20 0x7f4320076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f432573d640 1 -- 172.21.15.47:0/3796270498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4320109e20 msgr2=0x7f4320076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f432573d640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4320109e20 0x7f4320076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f432573d640 1 -- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43201094d0 msgr2=0x7f4320075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f432573d640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43201094d0 0x7f4320075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f432573d640 1 -- 172.21.15.47:0/3796270498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43201a87a0 con 0x7f4320103b90 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f4325f3e640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4320109e20 0x7f4320076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f432573d640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4320103b90 0x7f4320075710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f431c02aa00 tx=0x7f431c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.371+0000 7f43167fc640 1 -- 172.21.15.47:0/3796270498 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c03f070 con 0x7f4320103b90 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.372+0000 7f43167fc640 1 -- 172.21.15.47:0/3796270498 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431c031b50 con 0x7f4320103b90 2024-09-21T01:04:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.372+0000 7f43279a1640 1 -- 172.21.15.47:0/3796270498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43201a8a30 con 0x7f4320103b90 2024-09-21T01:04:48.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.372+0000 7f43167fc640 1 -- 172.21.15.47:0/3796270498 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c035030 con 0x7f4320103b90 2024-09-21T01:04:48.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.372+0000 7f43279a1640 1 -- 172.21.15.47:0/3796270498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43201a8f30 con 0x7f4320103b90 2024-09-21T01:04:48.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.375+0000 7f432df15740 1 Processor -- start 2024-09-21T01:04:48.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.375+0000 7f432df15740 1 -- start start 2024-09-21T01:04:48.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f432df15740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5a81270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f432df15740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b11b0 0x5601d5a817b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f432df15740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a81cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f432df15740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5601d59f7e50 con 0x5601d56b11b0 2024-09-21T01:04:48.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f432df15740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5601d59e7280 con 0x5601d56b9390 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f432df15740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5601d59eb090 con 0x5601d56da070 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f43167fc640 1 -- 172.21.15.47:0/3796270498 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f431c042070 con 0x7f4320103b90 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4325f3e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5a81270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4325f3e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5a81270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:60452/0 (socket says 172.21.15.47:60452) 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4325f3e640 1 -- 172.21.15.47:0/2251937868 learned_addr learned my addr 172.21.15.47:0/2251937868 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4324f3c640 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a81cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f432573d640 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b11b0 0x5601d5a817b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4325f3e640 1 -- 172.21.15.47:0/2251937868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 msgr2=0x5601d5a81cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4325f3e640 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a81cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4325f3e640 1 -- 172.21.15.47:0/2251937868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b11b0 msgr2=0x5601d5a817b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4325f3e640 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b11b0 0x5601d5a817b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.376+0000 7f4325f3e640 1 -- 172.21.15.47:0/2251937868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601d5745650 con 0x5601d56da070 2024-09-21T01:04:48.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.377+0000 7f4325f3e640 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5a81270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4318011810 tx=0x7f4318011cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=648022ef9eec5710 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:48.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.377+0000 7f430b7fe640 1 -- 172.21.15.47:0/2251937868 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318011310 con 0x5601d56da070 2024-09-21T01:04:48.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.377+0000 7f43167fc640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f430c0b6590 0x7f430c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.377+0000 7f430b7fe640 1 -- 172.21.15.47:0/2251937868 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431800f9a0 con 0x5601d56da070 2024-09-21T01:04:48.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.377+0000 7f430b7fe640 1 -- 172.21.15.47:0/2251937868 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43180056d0 con 0x5601d56da070 2024-09-21T01:04:48.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.377+0000 7f432573d640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f430c0b6590 0x7f430c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.377+0000 7f43167fc640 1 -- 172.21.15.47:0/3796270498 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f431c1076e0 con 0x7f4320103b90 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432df15740 1 -- 172.21.15.47:0/2251937868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 msgr2=0x5601d5a81270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432df15740 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5a81270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4318011810 tx=0x7f4318011cd0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432df15740 1 -- 172.21.15.47:0/2251937868 shutdown_connections 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432df15740 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a81cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432df15740 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b11b0 0x5601d5a817b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432df15740 1 --2- 172.21.15.47:0/2251937868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5a81270 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432df15740 1 -- 172.21.15.47:0/2251937868 >> 172.21.15.47:0/2251937868 conn(0x5601d56ce460 msgr2=0x5601d5a7f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432573d640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f430c0b6590 0x7f430c0b8aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f431c000c00 tx=0x7f431c02a410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.378+0000 7f432df15740 1 -- 172.21.15.47:0/2251937868 shutdown_connections 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.379+0000 7f432df15740 1 -- 172.21.15.47:0/2251937868 wait complete. 2024-09-21T01:04:48.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.379+0000 7f432df15740 1 -- start start 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.379+0000 7f432df15740 1 Processor -- start 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f432df15740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b11b0 0x5601d5a95170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f432df15740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b9390 0x5601d5a956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f432df15740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5aa1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f432df15740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5601d5848700 con 0x5601d56b9390 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f432df15740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5601d5982110 con 0x5601d56b11b0 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f432df15740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5601d5a98180 con 0x5601d56da070 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f432df15740 10 client.0 _ll_register_callbacks cb 0x5601d599b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f4324f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b9390 0x5601d5a956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f4324f3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b9390 0x5601d5a956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42372/0 (socket says 172.21.15.47:42372) 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f4324f3c640 1 -- 172.21.15.47:0/1722551528 learned_addr learned my addr 172.21.15.47:0/1722551528 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f4325f3e640 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b11b0 0x5601d5a95170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.380+0000 7f4325f3e640 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5aa1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4324f3c640 1 -- 172.21.15.47:0/1722551528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 msgr2=0x5601d5aa1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4324f3c640 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5aa1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4324f3c640 1 -- 172.21.15.47:0/1722551528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b11b0 msgr2=0x5601d5a95170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4324f3c640 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b11b0 0x5601d5a95170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4324f3c640 1 -- 172.21.15.47:0/1722551528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601d59afc40 con 0x5601d56b9390 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4324f3c640 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b9390 0x5601d5a956b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4310012700 tx=0x7f4310012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca4067956babcb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4308ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4308ff9640 1 -- 172.21.15.47:0/1722551528 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431000f8c0 con 0x5601d56b9390 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f4308ff9640 1 -- 172.21.15.47:0/1722551528 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f431000fa60 con 0x5601d56b9390 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.381+0000 7f432df15740 1 -- 172.21.15.47:0/1722551528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431800f9a0 con 0x5601d56b9390 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f4308ff9640 1 -- 172.21.15.47:0/1722551528 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f431000fc60 con 0x5601d56b9390 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f432df15740 10 client.16023 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:48.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f432df15740 1 -- 172.21.15.47:0/1722551528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5601d5aa3fc0 con 0x5601d56b9390 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f4308ff9640 1 -- 172.21.15.47:0/1722551528 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431000fe00 con 0x5601d56b9390 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f4308ff9640 1 -- 172.21.15.47:0/1722551528 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f431001c540 con 0x5601d56b9390 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f432df15740 10 client.16023 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f432df15740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f432df15740 20 client.16023 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f432df15740 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5601d56989f0 0x5601d5aa74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f432df15740 4 client.16023 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f432df15740 1 -- 172.21.15.47:0/1722551528 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f431800f9a0 con 0x5601d56989f0 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.382+0000 7f4325f3e640 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5601d56989f0 0x5601d5aa74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.383+0000 7f4308ff9640 10 client.16023 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:48.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.383+0000 7f4325f3e640 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5601d56989f0 0x5601d5aa74c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fee9b2eb461f8ef server_cookie=54c50ec3d785ee35 in_seq=0 out_seq=0 2024-09-21T01:04:48.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f4308ff9640 1 -- 172.21.15.47:0/1722551528 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f431800f9a0 con 0x5601d56989f0 2024-09-21T01:04:48.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f4308ff9640 10 client.16023 handle_command_reply: tid=0 2024-09-21T01:04:48.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 client.16023 shutdown 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 -- 172.21.15.47:0/1722551528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b9390 msgr2=0x5601d5a956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b9390 0x5601d5a956b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4310012700 tx=0x7f4310012bc0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 -- 172.21.15.47:0/1722551528 shutdown_connections 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5601d56989f0 0x5601d5aa74c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56da070 0x5601d5aa1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56b9390 0x5601d5a956b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 --2- 172.21.15.47:0/1722551528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b11b0 0x5601d5a95170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 -- 172.21.15.47:0/1722551528 >> 172.21.15.47:0/1722551528 conn(0x5601d56ce460 msgr2=0x5601d5a7d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f4308ff9640 0 client.16023 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 -- 172.21.15.47:0/1722551528 shutdown_connections 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 1 -- 172.21.15.47:0/1722551528 wait complete. 2024-09-21T01:04:48.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.384+0000 7f432df15740 20 client.16023 trim_cache size 0 max 16384 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f432df15740 1 Processor -- start 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f432df15740 1 -- start start 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f432df15740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 0x5601d5a7f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f432df15740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5aa1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f432df15740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a92360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f432df15740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ab000 con 0x5601d56da070 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f432df15740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ad860 con 0x5601d56b9390 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f432df15740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ab650 con 0x5601d56b11b0 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f4325f3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a92360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f4324f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5aa1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f4324f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5aa1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:47964/0 (socket says 172.21.15.47:47964) 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f4324f3c640 1 -- 172.21.15.47:0/3867137361 learned_addr learned my addr 172.21.15.47:0/3867137361 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f4325f3e640 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a92360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42382/0 (socket says 172.21.15.47:42382) 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.405+0000 7f4325f3e640 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 0x5601d5a7f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f4325f3e640 1 -- 172.21.15.47:0/3867137361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 msgr2=0x5601d5a7f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f4325f3e640 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 0x5601d5a7f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f4325f3e640 1 -- 172.21.15.47:0/3867137361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 msgr2=0x5601d5aa1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f4325f3e640 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5aa1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f4325f3e640 1 -- 172.21.15.47:0/3867137361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601d5a96210 con 0x5601d56da070 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f4324f3c640 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5aa1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f4325f3e640 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a92360 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x5601d5aa7c20 tx=0x7f4318005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf6334d1b6d4554 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f430affd640 1 -- 172.21.15.47:0/3867137361 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431801e040 con 0x5601d56da070 2024-09-21T01:04:48.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f430affd640 1 -- 172.21.15.47:0/3867137361 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431800f790 con 0x5601d56da070 2024-09-21T01:04:48.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.406+0000 7f430affd640 1 -- 172.21.15.47:0/3867137361 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43180058f0 con 0x5601d56da070 2024-09-21T01:04:48.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 -- 172.21.15.47:0/3867137361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 msgr2=0x5601d5a92360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a92360 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x5601d5aa7c20 tx=0x7f4318005230 comp rx=0 tx=0).stop 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 -- 172.21.15.47:0/3867137361 shutdown_connections 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a92360 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5aa1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 --2- 172.21.15.47:0/3867137361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 0x5601d5a7f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 -- 172.21.15.47:0/3867137361 >> 172.21.15.47:0/3867137361 conn(0x5601d56ce460 msgr2=0x5601d5a7eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 -- 172.21.15.47:0/3867137361 shutdown_connections 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.407+0000 7f432df15740 1 -- 172.21.15.47:0/3867137361 wait complete. 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 1 -- start start 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 1 Processor -- start 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 0x5601d5a99370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a99df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43201abd20 con 0x5601d56da070 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ad190 con 0x5601d56b9390 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ac3f0 con 0x5601d56b11b0 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f432df15740 10 client.0 _ll_register_callbacks cb 0x7f4310009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f4324f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.408+0000 7f4325f3e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 0x5601d5a99370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4324f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:47972/0 (socket says 172.21.15.47:47972) 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4324f3c640 1 -- 172.21.15.47:0/1162154518 learned_addr learned my addr 172.21.15.47:0/1162154518 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:48.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4325f3e640 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a99df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4324f3c640 1 -- 172.21.15.47:0/1162154518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 msgr2=0x5601d5a99370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4324f3c640 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 0x5601d5a99370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4324f3c640 1 -- 172.21.15.47:0/1162154518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 msgr2=0x5601d5a99df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4324f3c640 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a99df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4324f3c640 1 -- 172.21.15.47:0/1162154518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601d5b10e80 con 0x5601d56b9390 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4324f3c640 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a998b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f431001c990 tx=0x7f43100056e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7b8b3c49f644df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4308ff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4308ff9640 1 -- 172.21.15.47:0/1162154518 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431001cd40 con 0x5601d56b9390 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f432df15740 1 -- 172.21.15.47:0/1162154518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431800f790 con 0x5601d56b9390 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4308ff9640 1 -- 172.21.15.47:0/1162154518 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f4310018070 con 0x5601d56b9390 2024-09-21T01:04:48.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f4308ff9640 1 -- 172.21.15.47:0/1162154518 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4310036050 con 0x5601d56b9390 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f432df15740 10 client.25697 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.409+0000 7f432df15740 1 -- 172.21.15.47:0/1162154518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5601d5b12030 con 0x5601d56b9390 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f4308ff9640 1 -- 172.21.15.47:0/1162154518 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431800f790 con 0x5601d56b9390 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f4308ff9640 1 -- 172.21.15.47:0/1162154518 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4310004650 con 0x5601d56b9390 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f432df15740 10 client.25697 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f432df15740 10 client.25697 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f432df15740 20 client.25697 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f432df15740 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5601d566dda0 0x5601d5b14870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f432df15740 4 client.25697 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f432df15740 1 -- 172.21.15.47:0/1162154518 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5601d59f9da0 con 0x5601d566dda0 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.410+0000 7f4325f3e640 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5601d566dda0 0x5601d5b14870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f4325f3e640 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5601d566dda0 0x5601d5b14870 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c97246683512f12f server_cookie=82b0a758acb4faae in_seq=0 out_seq=0 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f4308ff9640 10 client.25697 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f4308ff9640 1 -- 172.21.15.47:0/1162154518 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x5601d59f9da0 con 0x5601d566dda0 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f4308ff9640 10 client.25697 handle_command_reply: tid=0 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 client.25697 shutdown 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 -- 172.21.15.47:0/1162154518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 msgr2=0x5601d5a998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a998b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f431001c990 tx=0x7f43100056e0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 -- 172.21.15.47:0/1162154518 shutdown_connections 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5601d566dda0 0x5601d5b14870 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5601d56da070 0x5601d5a99df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5601d56b9390 0x5601d5a998b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f4308ff9640 0 client.25697 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:48.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 --2- 172.21.15.47:0/1162154518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5601d56b11b0 0x5601d5a99370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 -- 172.21.15.47:0/1162154518 >> 172.21.15.47:0/1162154518 conn(0x5601d56ce460 msgr2=0x5601d5a822a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:48.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 -- 172.21.15.47:0/1162154518 shutdown_connections 2024-09-21T01:04:48.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 1 -- 172.21.15.47:0/1162154518 wait complete. 2024-09-21T01:04:48.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.411+0000 7f432df15740 20 client.25697 trim_cache size 0 max 16384 2024-09-21T01:04:48.418 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:04:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-09-21T01:04:48.418 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87": { 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:13.847440+0000", 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:04:48.419 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:48.420 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:48.421 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:48.422 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:48.423 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:04:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 -- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f430c0b6590 msgr2=0x7f430c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f430c0b6590 0x7f430c0b8aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f431c000c00 tx=0x7f431c02a410 comp rx=0 tx=0).stop 2024-09-21T01:04:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 -- 172.21.15.47:0/3796270498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4320103b90 msgr2=0x7f4320075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4320103b90 0x7f4320075710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f431c02aa00 tx=0x7f431c003b90 comp rx=0 tx=0).stop 2024-09-21T01:04:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 -- 172.21.15.47:0/3796270498 shutdown_connections 2024-09-21T01:04:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f430c0b6590 0x7f430c0b8aa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4320109e20 0x7f4320076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43201094d0 0x7f4320075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:48.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 --2- 172.21.15.47:0/3796270498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4320103b90 0x7f4320075710 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f431c02aa00 tx=0x7f431c003b90 comp rx=0 tx=0).stop 2024-09-21T01:04:48.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 -- 172.21.15.47:0/3796270498 >> 172.21.15.47:0/3796270498 conn(0x7f43200ff5e0 msgr2=0x7f4320101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:48.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 -- 172.21.15.47:0/3796270498 shutdown_connections 2024-09-21T01:04:48.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:48.412+0000 7f43279a1640 1 -- 172.21.15.47:0/3796270498 wait complete. 2024-09-21T01:04:49.245 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:49 smithi047 ceph-mon[30960]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 39 MiB/s wr, 5.53k op/s 2024-09-21T01:04:49.280 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:04:49.280 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:04:49.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:49 smithi134 ceph-mon[34785]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 39 MiB/s wr, 5.53k op/s 2024-09-21T01:04:49.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:49 smithi114 ceph-mon[34309]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 39 MiB/s wr, 5.53k op/s 2024-09-21T01:04:49.578 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.114+0000 7ffb35061640 1 -- 172.21.15.47:0/843824718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb301094c0 msgr2=0x7ffb301098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.114+0000 7ffb35061640 1 --2- 172.21.15.47:0/843824718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb301094c0 0x7ffb301098d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009900 tx=0x7ffb1802a410 comp rx=0 tx=0).stop 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.114+0000 7ffb35061640 1 -- 172.21.15.47:0/843824718 shutdown_connections 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.114+0000 7ffb35061640 1 --2- 172.21.15.47:0/843824718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb30109e10 0x7ffb30110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.114+0000 7ffb35061640 1 --2- 172.21.15.47:0/843824718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb301094c0 0x7ffb301098d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.114+0000 7ffb35061640 1 --2- 172.21.15.47:0/843824718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb30103b80 0x7ffb30103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.114+0000 7ffb35061640 1 -- 172.21.15.47:0/843824718 >> 172.21.15.47:0/843824718 conn(0x7ffb300ff610 msgr2=0x7ffb30101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.115+0000 7ffb35061640 1 -- 172.21.15.47:0/843824718 shutdown_connections 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.115+0000 7ffb35061640 1 -- 172.21.15.47:0/843824718 wait complete. 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.116+0000 7ffb35061640 1 Processor -- start 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.116+0000 7ffb35061640 1 -- start start 2024-09-21T01:04:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.116+0000 7ffb35061640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb30103b80 0x7ffb301a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.116+0000 7ffb35061640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb301094c0 0x7ffb301a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.116+0000 7ffb35061640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb30109e10 0x7ffb301ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.116+0000 7ffb35061640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffb30113ad0 con 0x7ffb30109e10 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.116+0000 7ffb35061640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffb30113950 con 0x7ffb301094c0 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.116+0000 7ffb35061640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb30113c50 con 0x7ffb30103b80 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb30103b80 0x7ffb301a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb301094c0 0x7ffb301a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb30103b80 0x7ffb301a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:60500/0 (socket says 172.21.15.47:60500) 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb301094c0 0x7ffb301a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:47996/0 (socket says 172.21.15.47:47996) 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 -- 172.21.15.47:0/1162412217 learned_addr learned my addr 172.21.15.47:0/1162412217 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2f59e640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb30109e10 0x7ffb301ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 -- 172.21.15.47:0/1162412217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb301094c0 msgr2=0x7ffb301a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:50.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb301094c0 0x7ffb301a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 -- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb30109e10 msgr2=0x7ffb301ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb30109e10 0x7ffb301ac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 -- 172.21.15.47:0/1162412217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb301acd10 con 0x7ffb30103b80 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb27fff640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb301094c0 0x7ffb301a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.117+0000 7ffb2ed9d640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb30103b80 0x7ffb301a1750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000e9f0 tx=0x7ffb2000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.118+0000 7ffb2cd99640 1 -- 172.21.15.47:0/1162412217 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000cd80 con 0x7ffb30103b80 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.118+0000 7ffb2cd99640 1 -- 172.21.15.47:0/1162412217 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb200108e0 con 0x7ffb30103b80 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.118+0000 7ffb2cd99640 1 -- 172.21.15.47:0/1162412217 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20018980 con 0x7ffb30103b80 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.118+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb301acee0 con 0x7ffb30103b80 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.118+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb301ad2e0 con 0x7ffb30103b80 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.119+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb30104e00 con 0x7ffb30103b80 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.121+0000 7ffb2cd99640 1 -- 172.21.15.47:0/1162412217 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ffb20010430 con 0x7ffb30103b80 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.121+0000 7ffb2cd99640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ffb1c0b6590 0x7ffb1c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.122+0000 7ffb2cd99640 1 -- 172.21.15.47:0/1162412217 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ffb200e79f0 con 0x7ffb30103b80 2024-09-21T01:04:50.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.122+0000 7ffb27fff640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ffb1c0b6590 0x7ffb1c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:50.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.122+0000 7ffb27fff640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ffb1c0b6590 0x7ffb1c0b8aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009230 tx=0x7ffb18031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:50.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.124+0000 7ffb2cd99640 1 -- 172.21.15.47:0/1162412217 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb200b2660 con 0x7ffb30103b80 2024-09-21T01:04:50.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.380+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb3010fe20 con 0x7ffb30103b80 2024-09-21T01:04:50.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.381+0000 7ffb2cd99640 1 -- 172.21.15.47:0/1162412217 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7ffb200b75a0 con 0x7ffb30103b80 2024-09-21T01:04:50.382 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:04:50.382 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:04:50.383 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T01:04:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ffb1c0b6590 msgr2=0x7ffb1c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ffb1c0b6590 0x7ffb1c0b8aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009230 tx=0x7ffb18031400 comp rx=0 tx=0).stop 2024-09-21T01:04:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb30103b80 msgr2=0x7ffb301a1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb30103b80 0x7ffb301a1750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000e9f0 tx=0x7ffb2000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 shutdown_connections 2024-09-21T01:04:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ffb1c0b6590 0x7ffb1c0b8aa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb30109e10 0x7ffb301ac7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb301094c0 0x7ffb301a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 --2- 172.21.15.47:0/1162412217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb30103b80 0x7ffb301a1750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:50.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 >> 172.21.15.47:0/1162412217 conn(0x7ffb300ff610 msgr2=0x7ffb30106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:50.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 shutdown_connections 2024-09-21T01:04:50.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:50.384+0000 7ffb35061640 1 -- 172.21.15.47:0/1162412217 wait complete. 2024-09-21T01:04:51.260 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:04:51.286 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:51 smithi047 ceph-mon[30960]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 34 MiB/s wr, 4.78k op/s 2024-09-21T01:04:51.286 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:51 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1162412217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:51.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:51 smithi134 ceph-mon[34785]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 34 MiB/s wr, 4.78k op/s 2024-09-21T01:04:51.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:51 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1162412217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:51 smithi114 ceph-mon[34309]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 34 MiB/s wr, 4.78k op/s 2024-09-21T01:04:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:51 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1162412217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:04:51.551 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:52.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.081+0000 7fb14c42f640 1 -- 172.21.15.47:0/1937507341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144102ad0 msgr2=0x7fb144102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.081+0000 7fb14c42f640 1 --2- 172.21.15.47:0/1937507341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144102ad0 0x7fb144102ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb140009900 tx=0x7fb14002a410 comp rx=0 tx=0).stop 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.082+0000 7fb14c42f640 1 -- 172.21.15.47:0/1937507341 shutdown_connections 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.082+0000 7fb14c42f640 1 --2- 172.21.15.47:0/1937507341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb144108d10 0x7fb14410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.082+0000 7fb14c42f640 1 --2- 172.21.15.47:0/1937507341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1441083c0 0x7fb1441087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.082+0000 7fb14c42f640 1 --2- 172.21.15.47:0/1937507341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144102ad0 0x7fb144102ee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.082+0000 7fb14c42f640 1 -- 172.21.15.47:0/1937507341 >> 172.21.15.47:0/1937507341 conn(0x7fb1440796d0 msgr2=0x7fb144079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.082+0000 7fb14c42f640 1 -- 172.21.15.47:0/1937507341 shutdown_connections 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.082+0000 7fb14c42f640 1 -- 172.21.15.47:0/1937507341 wait complete. 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14c42f640 1 Processor -- start 2024-09-21T01:04:52.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14c42f640 1 -- start start 2024-09-21T01:04:52.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14c42f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb144102ad0 0x7fb1440ff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14c42f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1441083c0 0x7fb1440ffbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14c42f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144108d10 0x7fb144100120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb1499ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1441083c0 0x7fb1440ffbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb1499ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1441083c0 0x7fb1440ffbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:41560/0 (socket says 172.21.15.47:41560) 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb1499ca640 1 -- 172.21.15.47:0/435284925 learned_addr learned my addr 172.21.15.47:0/435284925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14a1cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb144102ad0 0x7fb1440ff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb1441129d0 con 0x7fb144102ad0 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb144112850 con 0x7fb144108d10 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.083+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb144112b50 con 0x7fb1441083c0 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144108d10 0x7fb144100120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb1499ca640 1 -- 172.21.15.47:0/435284925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144108d10 msgr2=0x7fb144100120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb1499ca640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144108d10 0x7fb144100120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb1499ca640 1 -- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb144102ad0 msgr2=0x7fb1440ff6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb1499ca640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb144102ad0 0x7fb1440ff6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb1499ca640 1 -- 172.21.15.47:0/435284925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1441a8770 con 0x7fb1441083c0 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144108d10 0x7fb144100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb144102ad0 0x7fb1440ff6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.084+0000 7fb1499ca640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1441083c0 0x7fb1440ffbe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb13400e970 tx=0x7fb13400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.085+0000 7fb13b7fe640 1 -- 172.21.15.47:0/435284925 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13400cd80 con 0x7fb1441083c0 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.085+0000 7fb13b7fe640 1 -- 172.21.15.47:0/435284925 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1340035f0 con 0x7fb1441083c0 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.085+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1441a8a60 con 0x7fb1441083c0 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.085+0000 7fb13b7fe640 1 -- 172.21.15.47:0/435284925 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134010690 con 0x7fb1441083c0 2024-09-21T01:04:52.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.085+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1441a8ff0 con 0x7fb1441083c0 2024-09-21T01:04:52.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.088+0000 7fb13b7fe640 1 -- 172.21.15.47:0/435284925 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb134003aa0 con 0x7fb1441083c0 2024-09-21T01:04:52.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.088+0000 7fb1529a3740 1 Processor -- start 2024-09-21T01:04:52.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1529a3740 1 -- start start 2024-09-21T01:04:52.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970de71b0 0x5569711b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711b8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1529a3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55697112dea0 con 0x556970def390 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1529a3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55697111d2d0 con 0x556970de71b0 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1529a3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5569711210e0 con 0x556970e10070 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1499ca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb14a1cb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970de71b0 0x5569711b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1499ca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711b8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45288/0 (socket says 172.21.15.47:45288) 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb1499ca640 1 -- 172.21.15.47:0/3095753748 learned_addr learned my addr 172.21.15.47:0/3095753748 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970de71b0 0x5569711b7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:36330/0 (socket says 172.21.15.47:36330) 2024-09-21T01:04:52.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.089+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb14a1cb640 1 -- 172.21.15.47:0/3095753748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 msgr2=0x5569711b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb14a1cb640 1 -- 172.21.15.47:0/3095753748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 msgr2=0x5569711b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb14a1cb640 1 -- 172.21.15.47:0/3095753748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556970e7b650 con 0x556970de71b0 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb1499ca640 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb13b7fe640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb1300b6590 0x7fb1300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970de71b0 0x5569711b7be0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb1441010f0 tx=0x7fb140005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2da1306aac5f3063 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb1300b6590 0x7fb1300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb13b7fe640 1 -- 172.21.15.47:0/435284925 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb1340e74b0 con 0x7fb1441083c0 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.090+0000 7fb138d9a640 1 -- 172.21.15.47:0/3095753748 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140040070 con 0x556970de71b0 2024-09-21T01:04:52.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.091+0000 7fb138d9a640 1 -- 172.21.15.47:0/3095753748 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb140031720 con 0x556970de71b0 2024-09-21T01:04:52.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.091+0000 7fb138d9a640 1 -- 172.21.15.47:0/3095753748 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140035040 con 0x556970de71b0 2024-09-21T01:04:52.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 -- 172.21.15.47:0/3095753748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970de71b0 msgr2=0x5569711b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb1300b6590 0x7fb1300b8aa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009fd0 tx=0x7fb13c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:52.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970de71b0 0x5569711b7be0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb1441010f0 tx=0x7fb140005e20 comp rx=0 tx=0).stop 2024-09-21T01:04:52.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 -- 172.21.15.47:0/3095753748 shutdown_connections 2024-09-21T01:04:52.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970de71b0 0x5569711b7be0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3095753748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 -- 172.21.15.47:0/3095753748 >> 172.21.15.47:0/3095753748 conn(0x556970e04460 msgr2=0x5569711b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 -- 172.21.15.47:0/3095753748 shutdown_connections 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 -- 172.21.15.47:0/3095753748 wait complete. 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 -- start start 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.092+0000 7fb1529a3740 1 Processor -- start 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.093+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.093+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.093+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.093+0000 7fb1529a3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556970f7e700 con 0x556970de71b0 2024-09-21T01:04:52.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.093+0000 7fb1499ca640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.093+0000 7fb1499ca640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:36344/0 (socket says 172.21.15.47:36344) 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.093+0000 7fb1499ca640 1 -- 172.21.15.47:0/2371544685 learned_addr learned my addr 172.21.15.47:0/2371544685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.093+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5569710b8160 con 0x556970def390 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5569711c5e20 con 0x556970e10070 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb1529a3740 10 client.0 _ll_register_callbacks cb 0x5569710d19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb1499ca640 1 -- 172.21.15.47:0/2371544685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 msgr2=0x5569711cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb1499ca640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb1499ca640 1 -- 172.21.15.47:0/2371544685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 msgr2=0x5569711c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb1499ca640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb1499ca640 1 -- 172.21.15.47:0/2371544685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569710e5c90 con 0x556970def390 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.094+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb1499ca640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711c32b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1340ad670 tx=0x7fb134009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c36006d61d44d4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb12dffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb12dffb640 1 -- 172.21.15.47:0/2371544685 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340ad4b0 con 0x556970def390 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb12dffb640 1 -- 172.21.15.47:0/2371544685 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb1340e70d0 con 0x556970def390 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb140031720 con 0x556970def390 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb12dffb640 1 -- 172.21.15.47:0/2371544685 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb1340ace50 con 0x556970def390 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb1529a3740 10 client.25715 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5569711d1ba0 con 0x556970def390 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.095+0000 7fb12dffb640 1 -- 172.21.15.47:0/2371544685 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb140031720 con 0x556970def390 2024-09-21T01:04:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb12dffb640 1 -- 172.21.15.47:0/2371544685 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb1340b3350 con 0x556970def390 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb1529a3740 10 client.25715 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb1529a3740 10 client.25715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb1529a3740 20 client.25715 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb1529a3740 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556970dce9f0 0x5569711d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb1529a3740 4 client.25715 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55697112fdf0 con 0x556970dce9f0 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556970dce9f0 0x5569711d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb12dffb640 10 client.25715 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.096+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556970dce9f0 0x5569711d4fe0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57ac131ce586bde9 server_cookie=3db3b38a4ad28820 in_seq=0 out_seq=0 2024-09-21T01:04:52.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb12dffb640 1 -- 172.21.15.47:0/2371544685 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55697112fdf0 con 0x556970dce9f0 2024-09-21T01:04:52.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb12dffb640 10 client.25715 handle_command_reply: tid=0 2024-09-21T01:04:52.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 client.25715 shutdown 2024-09-21T01:04:52.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 msgr2=0x5569711c32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711c32b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1340ad670 tx=0x7fb134009510 comp rx=0 tx=0).stop 2024-09-21T01:04:52.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 shutdown_connections 2024-09-21T01:04:52.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556970dce9f0 0x5569711d4fe0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711c32b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb12dffb640 0 client.25715 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 --2- 172.21.15.47:0/2371544685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 >> 172.21.15.47:0/2371544685 conn(0x556970e04460 msgr2=0x5569711ba880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 shutdown_connections 2024-09-21T01:04:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.097+0000 7fb1529a3740 1 -- 172.21.15.47:0/2371544685 wait complete. 2024-09-21T01:04:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.098+0000 7fb1529a3740 20 client.25715 trim_cache size 0 max 16384 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1529a3740 1 Processor -- start 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1529a3740 1 -- start start 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1529a3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb1441af480 con 0x556970de71b0 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1529a3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1441b1d00 con 0x556970def390 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1529a3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb1441afaf0 con 0x556970e10070 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb14a1cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb14a1cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45300/0 (socket says 172.21.15.47:45300) 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb1499ca640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb14a1cb640 1 -- 172.21.15.47:0/495787571 learned_addr learned my addr 172.21.15.47:0/495787571 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.114+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb1499ca640 1 -- 172.21.15.47:0/495787571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 msgr2=0x5569711cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb1499ca640 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb1499ca640 1 -- 172.21.15.47:0/495787571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 msgr2=0x5569711c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb1499ca640 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb1499ca640 1 -- 172.21.15.47:0/495787571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569711b9990 con 0x556970def390 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb1499ca640 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711b8de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb1340a9cb0 tx=0x7fb134000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20d9deb6fc2f2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb12ffff640 1 -- 172.21.15.47:0/495787571 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340ad030 con 0x556970def390 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb12ffff640 1 -- 172.21.15.47:0/495787571 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1340ad1f0 con 0x556970def390 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.115+0000 7fb12ffff640 1 -- 172.21.15.47:0/495787571 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340e70d0 con 0x556970def390 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 -- 172.21.15.47:0/495787571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 msgr2=0x5569711b8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711b8de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb1340a9cb0 tx=0x7fb134000bc0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 -- 172.21.15.47:0/495787571 shutdown_connections 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970e10070 0x5569711cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970def390 0x5569711b8de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 --2- 172.21.15.47:0/495787571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970de71b0 0x5569711c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 -- 172.21.15.47:0/495787571 >> 172.21.15.47:0/495787571 conn(0x556970e04460 msgr2=0x5569711b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:52.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 -- 172.21.15.47:0/495787571 shutdown_connections 2024-09-21T01:04:52.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.117+0000 7fb1529a3740 1 -- 172.21.15.47:0/495787571 wait complete. 2024-09-21T01:04:52.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.118+0000 7fb1529a3740 1 -- start start 2024-09-21T01:04:52.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.118+0000 7fb1529a3740 1 Processor -- start 2024-09-21T01:04:52.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970de71b0 0x5569711cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb14a1cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970de71b0 0x5569711cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb14a1cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970de71b0 0x5569711cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:41592/0 (socket says 172.21.15.47:41592) 2024-09-21T01:04:52.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb1529a3740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970e10070 0x5569711c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb1529a3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb1441b01c0 con 0x556970def390 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb1529a3740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1441b1630 con 0x556970e10070 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb14a1cb640 1 -- 172.21.15.47:0/3227407486 learned_addr learned my addr 172.21.15.47:0/3227407486 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.119+0000 7fb1529a3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb1441b0890 con 0x556970de71b0 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970e10070 0x5569711c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb1529a3740 10 client.0 _ll_register_callbacks cb 0x7fb1340eaf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb14a9cc640 1 -- 172.21.15.47:0/3227407486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970de71b0 msgr2=0x5569711cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970de71b0 0x5569711cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb14a9cc640 1 -- 172.21.15.47:0/3227407486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 msgr2=0x5569711c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb14a9cc640 1 -- 172.21.15.47:0/3227407486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569711c7940 con 0x556970e10070 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970de71b0 0x5569711cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.120+0000 7fb14a9cc640 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970e10070 0x5569711c7200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb13c013010 tx=0x7fb13c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c76745c77caafbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.121+0000 7fb12dffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.121+0000 7fb12dffb640 1 -- 172.21.15.47:0/3227407486 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c004b20 con 0x556970e10070 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.121+0000 7fb12dffb640 1 -- 172.21.15.47:0/3227407486 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fb13c018030 con 0x556970e10070 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.121+0000 7fb1529a3740 1 -- 172.21.15.47:0/3227407486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1340ad1f0 con 0x556970e10070 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.121+0000 7fb12dffb640 1 -- 172.21.15.47:0/3227407486 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb13c004cc0 con 0x556970e10070 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.121+0000 7fb1529a3740 10 client.25721 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:52.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.121+0000 7fb1529a3740 1 -- 172.21.15.47:0/3227407486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55697123f8a0 con 0x556970e10070 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.121+0000 7fb12dffb640 1 -- 172.21.15.47:0/3227407486 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1340ad1f0 con 0x556970e10070 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.122+0000 7fb12dffb640 1 -- 172.21.15.47:0/3227407486 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb13c033020 con 0x556970e10070 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.122+0000 7fb1529a3740 10 client.25721 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.122+0000 7fb1529a3740 10 client.25721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.122+0000 7fb1529a3740 20 client.25721 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.122+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556970da3da0 0x5569712420b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.122+0000 7fb1529a3740 4 client.25721 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.122+0000 7fb1529a3740 1 -- 172.21.15.47:0/3227407486 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55697112b8a0 con 0x556970da3da0 2024-09-21T01:04:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.122+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556970da3da0 0x5569712420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.123+0000 7fb12dffb640 10 client.25721 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.123+0000 7fb14a1cb640 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556970da3da0 0x5569712420b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a68d4d04738acf server_cookie=a14cbc20647573e4 in_seq=0 out_seq=0 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.123+0000 7fb12dffb640 1 -- 172.21.15.47:0/3227407486 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55697112b8a0 con 0x556970da3da0 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.123+0000 7fb12dffb640 10 client.25721 handle_command_reply: tid=0 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.123+0000 7fb1529a3740 1 client.25721 shutdown 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.123+0000 7fb1529a3740 1 -- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970e10070 msgr2=0x5569711c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.123+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970e10070 0x5569711c7200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb13c013010 tx=0x7fb13c004a40 comp rx=0 tx=0).stop 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 1 -- 172.21.15.47:0/3227407486 shutdown_connections 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556970da3da0 0x5569712420b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556970e10070 0x5569711c7200 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb12dffb640 0 client.25721 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:52.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556970def390 0x5569711c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 1 --2- 172.21.15.47:0/3227407486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556970de71b0 0x5569711cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 1 -- 172.21.15.47:0/3227407486 >> 172.21.15.47:0/3227407486 conn(0x556970e04460 msgr2=0x5569711c4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:52.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 1 -- 172.21.15.47:0/3227407486 shutdown_connections 2024-09-21T01:04:52.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 1 -- 172.21.15.47:0/3227407486 wait complete. 2024-09-21T01:04:52.128 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-09-21T01:04:52.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.124+0000 7fb1529a3740 20 client.25721 trim_cache size 0 max 16384 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb1300b6590 msgr2=0x7fb1300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb1300b6590 0x7fb1300b8aa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009fd0 tx=0x7fb13c009500 comp rx=0 tx=0).stop 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1441083c0 msgr2=0x7fb1440ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1441083c0 0x7fb1440ffbe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb13400e970 tx=0x7fb13400ee30 comp rx=0 tx=0).stop 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 shutdown_connections 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fb1300b6590 0x7fb1300b8aa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb144108d10 0x7fb144100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1441083c0 0x7fb1440ffbe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 --2- 172.21.15.47:0/435284925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb144102ad0 0x7fb1440ff6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:52.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.125+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 >> 172.21.15.47:0/435284925 conn(0x7fb1440796d0 msgr2=0x7fb144101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:52.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.126+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 shutdown_connections 2024-09-21T01:04:52.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:52.126+0000 7fb14c42f640 1 -- 172.21.15.47:0/435284925 wait complete. 2024-09-21T01:04:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f672dffb640 1 -- 172.21.15.47:0/3417001610 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3b31210f0 con 0x55a3b2d9d1c0 2024-09-21T01:04:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f672dffb640 10 client.25643 handle_command_reply: tid=0 2024-09-21T01:04:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 client.25643 shutdown 2024-09-21T01:04:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 -- 172.21.15.47:0/3417001610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 msgr2=0x55a3b31c1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31c1350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6740000c00 tx=0x7f6740005ab0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 -- 172.21.15.47:0/3417001610 shutdown_connections 2024-09-21T01:04:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55a3b2d9d1c0 0x55a3b31c6650 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3b2e091b0 0x55a3b31c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3b2de84d0 0x55a3b31c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f672dffb640 0 client.25643 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 --2- 172.21.15.47:0/3417001610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a3b2de02f0 0x55a3b31c1350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 -- 172.21.15.47:0/3417001610 >> 172.21.15.47:0/3417001610 conn(0x55a3b2dfd300 msgr2=0x55a3b31aaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 -- 172.21.15.47:0/3417001610 shutdown_connections 2024-09-21T01:04:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 1 -- 172.21.15.47:0/3417001610 wait complete. 2024-09-21T01:04:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.159+0000 7f675382f740 20 client.25643 trim_cache size 0 max 16384 2024-09-21T01:04:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:04:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:04:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:04:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:04:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 -- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67300b6590 msgr2=0x7f67300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67300b6590 0x7f67300b8aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f673c009df0 tx=0x7f673c009500 comp rx=0 tx=0).stop 2024-09-21T01:04:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 -- 172.21.15.47:0/3673224003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67441025b0 msgr2=0x7f6744199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67441025b0 0x7f6744199fc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f674000ea60 tx=0x7f674000ee60 comp rx=0 tx=0).stop 2024-09-21T01:04:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 -- 172.21.15.47:0/3673224003 shutdown_connections 2024-09-21T01:04:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f67300b6590 0x7f67300b8aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6744103fd0 0x7f674419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744103630 0x7f674419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 --2- 172.21.15.47:0/3673224003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67441025b0 0x7f6744199fc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 -- 172.21.15.47:0/3673224003 >> 172.21.15.47:0/3673224003 conn(0x7f67440fdf30 msgr2=0x7f67440ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 -- 172.21.15.47:0/3673224003 shutdown_connections 2024-09-21T01:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:04:53.160+0000 7f674c7e6640 1 -- 172.21.15.47:0/3673224003 wait complete. 2024-09-21T01:04:53.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:53 smithi134 ceph-mon[34785]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 32 MiB/s wr, 4.67k op/s 2024-09-21T01:04:53.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:53 smithi114 ceph-mon[34309]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 32 MiB/s wr, 4.67k op/s 2024-09-21T01:04:53.417 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:53 smithi047 ceph-mon[30960]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 32 MiB/s wr, 4.67k op/s 2024-09-21T01:04:54.455 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:04:54.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:04:54.758 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:55.205 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:55 smithi047 ceph-mon[30960]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 5.43k op/s 2024-09-21T01:04:55.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:55 smithi134 ceph-mon[34785]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 5.43k op/s 2024-09-21T01:04:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:55 smithi114 ceph-mon[34309]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 MiB/s wr, 5.43k op/s 2024-09-21T01:04:55.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 -- 172.21.15.47:0/1380234363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8564107630 msgr2=0x7f8564107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 --2- 172.21.15.47:0/1380234363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8564107630 0x7f8564107a40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8554009900 tx=0x7f855402a410 comp rx=0 tx=0).stop 2024-09-21T01:04:55.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 -- 172.21.15.47:0/1380234363 shutdown_connections 2024-09-21T01:04:55.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 --2- 172.21.15.47:0/1380234363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85641038f0 0x7f856410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 --2- 172.21.15.47:0/1380234363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8564102fa0 0x7f85641033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 --2- 172.21.15.47:0/1380234363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8564107630 0x7f8564107a40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 -- 172.21.15.47:0/1380234363 >> 172.21.15.47:0/1380234363 conn(0x7f8564079e40 msgr2=0x7f856407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:55.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 -- 172.21.15.47:0/1380234363 shutdown_connections 2024-09-21T01:04:55.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.427+0000 7f856aaae640 1 -- 172.21.15.47:0/1380234363 wait complete. 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.428+0000 7f856aaae640 1 Processor -- start 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.428+0000 7f856aaae640 1 -- start start 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f856aaae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8564102fa0 0x7f856419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f856aaae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85641038f0 0x7f856419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f856aaae640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f856419fd60 0x7f85641a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f856aaae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85641129e0 con 0x7f85641038f0 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f856aaae640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8564112860 con 0x7f856419fd60 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f856aaae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8564112b60 con 0x7f8564102fa0 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85641038f0 0x7f856419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f856884a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8564102fa0 0x7f856419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85641038f0 0x7f856419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45310/0 (socket says 172.21.15.47:45310) 2024-09-21T01:04:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 -- 172.21.15.47:0/103209796 learned_addr learned my addr 172.21.15.47:0/103209796 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f856904b640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f856419fd60 0x7f85641a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 -- 172.21.15.47:0/103209796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8564102fa0 msgr2=0x7f856419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8564102fa0 0x7f856419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 -- 172.21.15.47:0/103209796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f856419fd60 msgr2=0x7f85641a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f856419fd60 0x7f85641a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 -- 172.21.15.47:0/103209796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85641a0940 con 0x7f85641038f0 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.429+0000 7f8563fff640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85641038f0 0x7f856419ab80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8558005fd0 tx=0x7f855800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.430+0000 7f8561ffb640 1 -- 172.21.15.47:0/103209796 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558017070 con 0x7f85641038f0 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.430+0000 7f856aaae640 1 -- 172.21.15.47:0/103209796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85641a6ee0 con 0x7f85641038f0 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.430+0000 7f8561ffb640 1 -- 172.21.15.47:0/103209796 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8558009c30 con 0x7f85641038f0 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.430+0000 7f8561ffb640 1 -- 172.21.15.47:0/103209796 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558003d10 con 0x7f85641038f0 2024-09-21T01:04:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.430+0000 7f856aaae640 1 -- 172.21.15.47:0/103209796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85641a72d0 con 0x7f85641038f0 2024-09-21T01:04:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.433+0000 7f8561ffb640 1 -- 172.21.15.47:0/103209796 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8558010460 con 0x7f85641038f0 2024-09-21T01:04:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.433+0000 7f8571022740 1 Processor -- start 2024-09-21T01:04:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.433+0000 7f8571022740 1 -- start start 2024-09-21T01:04:55.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8571022740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128df430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8571022740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128df970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8571022740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128dfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8571022740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564912855e60 con 0x564912517670 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8571022740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x564912845290 con 0x564912538350 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8571022740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649128490a0 con 0x56491250f490 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8563fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128dfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f856904b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128df430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8563fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128dfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45322/0 (socket says 172.21.15.47:45322) 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f856904b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128df430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:36386/0 (socket says 172.21.15.47:36386) 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8563fff640 1 -- 172.21.15.47:0/3580416012 learned_addr learned my addr 172.21.15.47:0/3580416012 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8561ffb640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f854c0b6590 0x7f854c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f856884a640 1 --2- 172.21.15.47:0/3580416012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f856904b640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f854c0b6590 0x7f854c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f856904b640 1 -- 172.21.15.47:0/3580416012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 msgr2=0x5649128df970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f856904b640 1 --2- 172.21.15.47:0/3580416012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128df970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f8561ffb640 1 -- 172.21.15.47:0/103209796 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f85580e6e50 con 0x7f85641038f0 2024-09-21T01:04:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f856904b640 1 -- 172.21.15.47:0/3580416012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 msgr2=0x5649128dfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.434+0000 7f856904b640 1 --2- 172.21.15.47:0/3580416012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128dfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.435+0000 7f856904b640 1 -- 172.21.15.47:0/3580416012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649125a3930 con 0x564912538350 2024-09-21T01:04:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.435+0000 7f856904b640 1 --2- 172.21.15.47:0/3580416012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128df430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f855c005fd0 tx=0x7f855c013e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb14a4562427158 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.435+0000 7f856904b640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f854c0b6590 0x7f854c0b8aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f855c02f000 tx=0x7f855c031000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.435+0000 7f854affd640 1 -- 172.21.15.47:0/3580416012 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c013120 con 0x564912538350 2024-09-21T01:04:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.435+0000 7f854affd640 1 -- 172.21.15.47:0/3580416012 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f855c033070 con 0x564912538350 2024-09-21T01:04:55.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.435+0000 7f854affd640 1 -- 172.21.15.47:0/3580416012 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0106b0 con 0x564912538350 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 -- 172.21.15.47:0/3580416012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 msgr2=0x5649128df430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 --2- 172.21.15.47:0/3580416012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128df430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f855c005fd0 tx=0x7f855c013e50 comp rx=0 tx=0).stop 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 -- 172.21.15.47:0/3580416012 shutdown_connections 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 --2- 172.21.15.47:0/3580416012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128dfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 --2- 172.21.15.47:0/3580416012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128df970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 --2- 172.21.15.47:0/3580416012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128df430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 -- 172.21.15.47:0/3580416012 >> 172.21.15.47:0/3580416012 conn(0x56491252c740 msgr2=0x5649128dd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 -- 172.21.15.47:0/3580416012 shutdown_connections 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.437+0000 7f8571022740 1 -- 172.21.15.47:0/3580416012 wait complete. 2024-09-21T01:04:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.438+0000 7f8571022740 1 -- start start 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.438+0000 7f8571022740 1 Processor -- start 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f8571022740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128eb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f8571022740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128ebb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f8571022740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f8571022740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5649126a6890 con 0x564912517670 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f8571022740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5649127dfd40 con 0x564912538350 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f8571022740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649128e5940 con 0x56491250f490 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f8571022740 10 client.0 _ll_register_callbacks cb 0x564912843c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f8563fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128ebb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856884a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856884a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128eb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:41640/0 (socket says 172.21.15.47:41640) 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856884a640 1 -- 172.21.15.47:0/584656906 learned_addr learned my addr 172.21.15.47:0/584656906 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:55.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856904b640 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856904b640 1 -- 172.21.15.47:0/584656906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 msgr2=0x5649128eb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856904b640 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128eb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856904b640 1 -- 172.21.15.47:0/584656906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 msgr2=0x5649128ebb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856904b640 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128ebb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.439+0000 7f856904b640 1 -- 172.21.15.47:0/584656906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649128f11d0 con 0x564912538350 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f856904b640 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128f0b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f855c00a010 tx=0x7f855c004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b93be6e9327d0731 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f8543fff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f8543fff640 1 -- 172.21.15.47:0/584656906 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c03b040 con 0x564912538350 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f8543fff640 1 -- 172.21.15.47:0/584656906 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f855c02f880 con 0x564912538350 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f8571022740 1 -- 172.21.15.47:0/584656906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c033070 con 0x564912538350 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f8543fff640 1 -- 172.21.15.47:0/584656906 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f855c02fa80 con 0x564912538350 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f8571022740 10 client.25733 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f8571022740 1 -- 172.21.15.47:0/584656906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5649128f9dc0 con 0x564912538350 2024-09-21T01:04:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.440+0000 7f8543fff640 1 -- 172.21.15.47:0/584656906 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f855c02fc20 con 0x564912538350 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f8543fff640 1 -- 172.21.15.47:0/584656906 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f855c02e070 con 0x564912538350 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f8571022740 10 client.25733 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f8571022740 10 client.25733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f8571022740 20 client.25733 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f8571022740 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5649124f6cd0 0x5649128fd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f8571022740 4 client.25733 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f8571022740 1 -- 172.21.15.47:0/584656906 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f855c033070 con 0x5649124f6cd0 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f856884a640 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5649124f6cd0 0x5649128fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f8543fff640 10 client.25733 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.441+0000 7f856884a640 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5649124f6cd0 0x5649128fd230 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf0306df039ad87 server_cookie=4825e250bdc3ed5f in_seq=0 out_seq=0 2024-09-21T01:04:55.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8543fff640 1 -- 172.21.15.47:0/584656906 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f855c033070 con 0x5649124f6cd0 2024-09-21T01:04:55.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8543fff640 10 client.25733 handle_command_reply: tid=0 2024-09-21T01:04:55.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 client.25733 shutdown 2024-09-21T01:04:55.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 -- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 msgr2=0x5649128f0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128f0b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f855c00a010 tx=0x7f855c004d30 comp rx=0 tx=0).stop 2024-09-21T01:04:55.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 -- 172.21.15.47:0/584656906 shutdown_connections 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5649124f6cd0 0x5649128fd230 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912538350 0x5649128f0b60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912517670 0x5649128ebb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8543fff640 0 client.25733 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 --2- 172.21.15.47:0/584656906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128eb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 -- 172.21.15.47:0/584656906 >> 172.21.15.47:0/584656906 conn(0x56491252c740 msgr2=0x5649128db850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 -- 172.21.15.47:0/584656906 shutdown_connections 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 1 -- 172.21.15.47:0/584656906 wait complete. 2024-09-21T01:04:55.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.442+0000 7f8571022740 20 client.25733 trim_cache size 0 max 16384 2024-09-21T01:04:55.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.461+0000 7f8571022740 1 Processor -- start 2024-09-21T01:04:55.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.461+0000 7f8571022740 1 -- start start 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.461+0000 7f8571022740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.461+0000 7f8571022740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.461+0000 7f8571022740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912538350 0x5649128e8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.461+0000 7f8571022740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85641ab680 con 0x564912538350 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.461+0000 7f8571022740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f85641adf00 con 0x564912517670 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.461+0000 7f8571022740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85641abcf0 con 0x56491250f490 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856904b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912538350 0x5649128e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f8563fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128f7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:41656/0 (socket says 172.21.15.47:41656) 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f8563fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128e0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:36398/0 (socket says 172.21.15.47:36398) 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 -- 172.21.15.47:0/163371836 learned_addr learned my addr 172.21.15.47:0/163371836 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 -- 172.21.15.47:0/163371836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 msgr2=0x5649128e0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128e0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 -- 172.21.15.47:0/163371836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912538350 msgr2=0x5649128e8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912538350 0x5649128e8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 -- 172.21.15.47:0/163371836 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649128e6d40 con 0x56491250f490 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f8563fff640 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856904b640 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912538350 0x5649128e8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:55.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.462+0000 7f856884a640 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128f7ce0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8554005940 tx=0x7f85540058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10b159b2142a563a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.463+0000 7f854a7fc640 1 -- 172.21.15.47:0/163371836 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855404a020 con 0x56491250f490 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.463+0000 7f854a7fc640 1 -- 172.21.15.47:0/163371836 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85540316a0 con 0x56491250f490 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.463+0000 7f854a7fc640 1 -- 172.21.15.47:0/163371836 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554035040 con 0x56491250f490 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 -- 172.21.15.47:0/163371836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 msgr2=0x5649128f7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128f7ce0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8554005940 tx=0x7f85540058d0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 -- 172.21.15.47:0/163371836 shutdown_connections 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564912538350 0x5649128e8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 --2- 172.21.15.47:0/163371836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56491250f490 0x5649128f7ce0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 -- 172.21.15.47:0/163371836 >> 172.21.15.47:0/163371836 conn(0x56491252c740 msgr2=0x5649128e0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 -- 172.21.15.47:0/163371836 shutdown_connections 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 -- 172.21.15.47:0/163371836 wait complete. 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 -- start start 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.464+0000 7f8571022740 1 Processor -- start 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f8571022740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491250f490 0x5649128f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f8571022740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128f5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f8571022740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564912538350 0x5649128f5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f8571022740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85641ac3c0 con 0x56491250f490 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f8571022740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f85641ad830 con 0x564912517670 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f8571022740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85641aca90 con 0x564912538350 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f856884a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491250f490 0x5649128f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f8571022740 10 client.0 _ll_register_callbacks cb 0x7f85580a9750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:55.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f8563fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f856884a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491250f490 0x5649128f7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45364/0 (socket says 172.21.15.47:45364) 2024-09-21T01:04:55.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f856884a640 1 -- 172.21.15.47:0/2576764809 learned_addr learned my addr 172.21.15.47:0/2576764809 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:55.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.465+0000 7f856904b640 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564912538350 0x5649128f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f856884a640 1 -- 172.21.15.47:0/2576764809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564912538350 msgr2=0x5649128f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:55.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f856884a640 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564912538350 0x5649128f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f856884a640 1 -- 172.21.15.47:0/2576764809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 msgr2=0x5649128f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:55.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f856884a640 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f856884a640 1 -- 172.21.15.47:0/2576764809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564912966ac0 con 0x56491250f490 2024-09-21T01:04:55.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f8563fff640 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:55.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f856884a640 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491250f490 0x5649128f7ce0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8554009a20 tx=0x7f855402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c6c4e5f839631b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f8543fff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f8543fff640 1 -- 172.21.15.47:0/2576764809 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855404a030 con 0x56491250f490 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f8543fff640 1 -- 172.21.15.47:0/2576764809 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8554003cb0 con 0x56491250f490 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.466+0000 7f8571022740 1 -- 172.21.15.47:0/2576764809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85540316a0 con 0x56491250f490 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8543fff640 1 -- 172.21.15.47:0/2576764809 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f855405f050 con 0x56491250f490 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8571022740 10 client.16068 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8571022740 1 -- 172.21.15.47:0/2576764809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564912967c90 con 0x56491250f490 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8543fff640 1 -- 172.21.15.47:0/2576764809 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85540316a0 con 0x56491250f490 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8543fff640 1 -- 172.21.15.47:0/2576764809 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f855403d830 con 0x56491250f490 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8571022740 10 client.16068 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8571022740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8571022740 20 client.16068 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:55.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8571022740 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5649124cc080 0x56491296a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:55.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8571022740 4 client.16068 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:04:55.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8571022740 1 -- 172.21.15.47:0/2576764809 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564912857db0 con 0x5649124cc080 2024-09-21T01:04:55.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.467+0000 7f8563fff640 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5649124cc080 0x56491296a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:55.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.468+0000 7f8543fff640 10 client.16068 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:55.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.468+0000 7f8563fff640 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5649124cc080 0x56491296a370 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=989f114d03d7cf5a server_cookie=8ba9b73f37d69003 in_seq=0 out_seq=0 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.470+0000 7f8543fff640 1 -- 172.21.15.47:0/2576764809 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564912857db0 con 0x5649124cc080 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.470+0000 7f8543fff640 10 client.16068 handle_command_reply: tid=0 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.470+0000 7f8571022740 1 client.16068 shutdown 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 -- 172.21.15.47:0/2576764809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491250f490 msgr2=0x5649128f7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491250f490 0x5649128f7ce0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8554009a20 tx=0x7f855402a410 comp rx=0 tx=0).stop 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 -- 172.21.15.47:0/2576764809 shutdown_connections 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5649124cc080 0x56491296a370 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564912538350 0x5649128f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564912517670 0x5649128f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 --2- 172.21.15.47:0/2576764809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56491250f490 0x5649128f7ce0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8543fff640 0 client.16068 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 -- 172.21.15.47:0/2576764809 >> 172.21.15.47:0/2576764809 conn(0x56491252c740 msgr2=0x5649128e0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 -- 172.21.15.47:0/2576764809 shutdown_connections 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 1 -- 172.21.15.47:0/2576764809 wait complete. 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.471+0000 7f8571022740 20 client.16068 trim_cache size 0 max 16384 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stdout: "return_code": 0, 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_tag": "736e4c53-6a66-4fe2-8a04-61c577d889f1", 2024-09-21T01:04:55.474 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": "asynchronous" 2024-09-21T01:04:55.475 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:04:55.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 -- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f854c0b6590 msgr2=0x7f854c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f854c0b6590 0x7f854c0b8aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f855c02f000 tx=0x7f855c031000 comp rx=0 tx=0).stop 2024-09-21T01:04:55.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 -- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85641038f0 msgr2=0x7f856419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:55.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85641038f0 0x7f856419ab80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8558005fd0 tx=0x7f855800dde0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 -- 172.21.15.47:0/103209796 shutdown_connections 2024-09-21T01:04:55.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f854c0b6590 0x7f854c0b8aa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f856419fd60 0x7f85641a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85641038f0 0x7f856419ab80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 --2- 172.21.15.47:0/103209796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8564102fa0 0x7f856419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:55.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 -- 172.21.15.47:0/103209796 >> 172.21.15.47:0/103209796 conn(0x7f8564079e40 msgr2=0x7f85641065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:55.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 -- 172.21.15.47:0/103209796 shutdown_connections 2024-09-21T01:04:55.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:55.472+0000 7f856aaae640 1 -- 172.21.15.47:0/103209796 wait complete. 2024-09-21T01:04:56.545 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:04:56.875 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:04:57.308 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:57 smithi047 ceph-mon[30960]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 4.36k op/s 2024-09-21T01:04:57.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:57 smithi047 ceph-mon[30960]: scrub queued for path: / 2024-09-21T01:04:57.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:57 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:57.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:57 smithi047 ceph-mon[30960]: scrub summary: active paths [/] 2024-09-21T01:04:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:57 smithi134 ceph-mon[34785]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 4.36k op/s 2024-09-21T01:04:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:57 smithi134 ceph-mon[34785]: scrub queued for path: / 2024-09-21T01:04:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:57 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:57.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:57 smithi134 ceph-mon[34785]: scrub summary: active paths [/] 2024-09-21T01:04:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:57 smithi114 ceph-mon[34309]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 31 MiB/s wr, 4.36k op/s 2024-09-21T01:04:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:57 smithi114 ceph-mon[34309]: scrub queued for path: / 2024-09-21T01:04:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:57 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T01:04:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:57 smithi114 ceph-mon[34309]: scrub summary: active paths [/] 2024-09-21T01:04:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 -- 172.21.15.47:0/3877690194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae8106c20 msgr2=0x7f4ae8110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/3877690194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae8106c20 0x7f4ae8110670 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009ca0 tx=0x7f4ae002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 -- 172.21.15.47:0/3877690194 shutdown_connections 2024-09-21T01:04:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/3877690194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae8106c20 0x7f4ae8110670 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/3877690194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ae81062d0 0x7f4ae81066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/3877690194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae8101ff0 0x7f4ae8102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 -- 172.21.15.47:0/3877690194 >> 172.21.15.47:0/3877690194 conn(0x7f4ae8077cc0 msgr2=0x7f4ae8078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 -- 172.21.15.47:0/3877690194 shutdown_connections 2024-09-21T01:04:57.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.414+0000 7f4aedd4d640 1 -- 172.21.15.47:0/3877690194 wait complete. 2024-09-21T01:04:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.415+0000 7f4aedd4d640 1 Processor -- start 2024-09-21T01:04:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.415+0000 7f4aedd4d640 1 -- start start 2024-09-21T01:04:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.415+0000 7f4aedd4d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ae8101ff0 0x7f4ae819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.415+0000 7f4aedd4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae81062d0 0x7f4ae819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.415+0000 7f4aedd4d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae8106c20 0x7f4ae819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.415+0000 7f4aedd4d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8113ac0 con 0x7f4ae81062d0 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.415+0000 7f4aedd4d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8113940 con 0x7f4ae8101ff0 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.415+0000 7f4aedd4d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8113c40 con 0x7f4ae8106c20 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ae8101ff0 0x7f4ae819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae81062d0 0x7f4ae819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ae8101ff0 0x7f4ae819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:36422/0 (socket says 172.21.15.47:36422) 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 -- 172.21.15.47:0/2931418959 learned_addr learned my addr 172.21.15.47:0/2931418959 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae81062d0 0x7f4ae819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45368/0 (socket says 172.21.15.47:45368) 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae8106c20 0x7f4ae819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 -- 172.21.15.47:0/2931418959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae8106c20 msgr2=0x7f4ae819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae8106c20 0x7f4ae819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 -- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae81062d0 msgr2=0x7f4ae819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae81062d0 0x7f4ae819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 -- 172.21.15.47:0/2931418959 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae81a03a0 con 0x7f4ae8101ff0 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4adeffd640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae81062d0 0x7f4ae819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae77fe640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ae8101ff0 0x7f4ae819a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800e9f0 tx=0x7f4ad800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae57fa640 1 -- 172.21.15.47:0/2931418959 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800cd80 con 0x7f4ae8101ff0 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4aedd4d640 1 -- 172.21.15.47:0/2931418959 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae81a0690 con 0x7f4ae8101ff0 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae57fa640 1 -- 172.21.15.47:0/2931418959 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad80108e0 con 0x7f4ae8101ff0 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.417+0000 7f4aedd4d640 1 -- 172.21.15.47:0/2931418959 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae81a6df0 con 0x7f4ae8101ff0 2024-09-21T01:04:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.416+0000 7f4ae57fa640 1 -- 172.21.15.47:0/2931418959 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8018980 con 0x7f4ae8101ff0 2024-09-21T01:04:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4af42c1740 1 Processor -- start 2024-09-21T01:04:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4af42c1740 1 -- start start 2024-09-21T01:04:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4ae57fa640 1 -- 172.21.15.47:0/2931418959 <== mon.2 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4ad8010430 con 0x7f4ae8101ff0 2024-09-21T01:04:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x5596972ef650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972efb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4af42c1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559697265e50 con 0x559696f1f1b0 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4af42c1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x559697255280 con 0x559696f27390 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.419+0000 7f4af42c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559697259090 con 0x559696f48070 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x5596972ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x5596972ef650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:41674/0 (socket says 172.21.15.47:41674) 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 -- 172.21.15.47:0/1655887735 learned_addr learned my addr 172.21.15.47:0/1655887735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4adeffd640 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae77fe640 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 -- 172.21.15.47:0/1655887735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 msgr2=0x5596972f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 -- 172.21.15.47:0/1655887735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 msgr2=0x5596972efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972efb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 -- 172.21.15.47:0/1655887735 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559696fb3650 con 0x559696f48070 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae77fe640 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x5596972ef650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ae002f410 tx=0x7f4ae002f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aebf0c16468f67a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4ae57fa640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4ad40b6510 0x7f4ad40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.420+0000 7f4addffb640 1 -- 172.21.15.47:0/1655887735 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0031cf0 con 0x559696f48070 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4addffb640 1 -- 172.21.15.47:0/1655887735 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae0036030 con 0x559696f48070 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4addffb640 1 -- 172.21.15.47:0/1655887735 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00042a0 con 0x559696f48070 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4ae77fe640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4ad40b6510 0x7f4ad40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4ae57fa640 1 -- 172.21.15.47:0/2931418959 <== mon.2 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f4ad80e7570 con 0x7f4ae8101ff0 2024-09-21T01:04:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4af42c1740 1 -- 172.21.15.47:0/1655887735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 msgr2=0x5596972ef650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4ae77fe640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4ad40b6510 0x7f4ad40b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80ad530 tx=0x7f4ad8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x5596972ef650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ae002f410 tx=0x7f4ae002f440 comp rx=0 tx=0).stop 2024-09-21T01:04:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4af42c1740 1 -- 172.21.15.47:0/1655887735 shutdown_connections 2024-09-21T01:04:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1655887735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x5596972ef650 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.421+0000 7f4af42c1740 1 -- 172.21.15.47:0/1655887735 >> 172.21.15.47:0/1655887735 conn(0x559696f3c460 msgr2=0x5596972ed540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.422+0000 7f4af42c1740 1 -- 172.21.15.47:0/1655887735 shutdown_connections 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.422+0000 7f4af42c1740 1 -- 172.21.15.47:0/1655887735 wait complete. 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.422+0000 7f4af42c1740 1 -- start start 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.422+0000 7f4af42c1740 1 Processor -- start 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.422+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972facb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.422+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972fb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x55969730b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4af42c1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596970b6700 con 0x559696f1f1b0 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4af42c1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5596971f0110 con 0x559696f27390 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4af42c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5596972fdc50 con 0x559696f48070 2024-09-21T01:04:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4af42c1740 10 client.0 _ll_register_callbacks cb 0x559697209990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972facb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972fb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972facb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45380/0 (socket says 172.21.15.47:45380) 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972fb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:36452/0 (socket says 172.21.15.47:36452) 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4ae7fff640 1 -- 172.21.15.47:0/26345666 learned_addr learned my addr 172.21.15.47:0/26345666 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x55969730b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4adeffd640 1 -- 172.21.15.47:0/26345666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 msgr2=0x55969730b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4adeffd640 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x55969730b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4adeffd640 1 -- 172.21.15.47:0/26345666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 msgr2=0x5596972facb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4adeffd640 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972facb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4adeffd640 1 -- 172.21.15.47:0/26345666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55969721dc40 con 0x559696f27390 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4adeffd640 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972fb1f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8075840 tx=0x7f4ad000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3607a05d8576efc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.423+0000 7f4ac6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:04:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/26345666 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0012110 con 0x559696f27390 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/26345666 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f4ad0004050 con 0x559696f27390 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4af42c1740 1 -- 172.21.15.47:0/26345666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae0036030 con 0x559696f27390 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/26345666 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4ad00122b0 con 0x559696f27390 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4af42c1740 10 client.25751 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4af42c1740 1 -- 172.21.15.47:0/26345666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55969730ddc0 con 0x559696f27390 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/26345666 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae0036030 con 0x559696f27390 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/26345666 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4ad0010430 con 0x559696f27390 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4af42c1740 10 client.25751 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4af42c1740 10 client.25751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4af42c1740 20 client.25751 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.424+0000 7f4af42c1740 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x559696f069f0 0x559697311390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.425+0000 7f4af42c1740 4 client.25751 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:04:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.425+0000 7f4af42c1740 1 -- 172.21.15.47:0/26345666 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559697267da0 con 0x559696f069f0 2024-09-21T01:04:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.425+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x559696f069f0 0x559697311390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.425+0000 7f4ac6ffd640 10 client.25751 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.425+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x559696f069f0 0x559697311390 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4451a388064929fd server_cookie=840e380972cb623f in_seq=0 out_seq=0 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.426+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/26345666 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559697267da0 con 0x559696f069f0 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.426+0000 7f4ac6ffd640 10 client.25751 handle_command_reply: tid=0 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.426+0000 7f4af42c1740 1 client.25751 shutdown 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.426+0000 7f4af42c1740 1 -- 172.21.15.47:0/26345666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 msgr2=0x5596972fb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.426+0000 7f4af42c1740 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972fb1f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8075840 tx=0x7f4ad000f790 comp rx=0 tx=0).stop 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.426+0000 7f4af42c1740 1 -- 172.21.15.47:0/26345666 shutdown_connections 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.426+0000 7f4af42c1740 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x559696f069f0 0x559697311390 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.427+0000 7f4af42c1740 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f48070 0x55969730b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.427+0000 7f4af42c1740 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596972fb1f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.427+0000 7f4af42c1740 1 --2- 172.21.15.47:0/26345666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f1f1b0 0x5596972facb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.427+0000 7f4af42c1740 1 -- 172.21.15.47:0/26345666 >> 172.21.15.47:0/26345666 conn(0x559696f3c460 msgr2=0x5596972f27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.427+0000 7f4ac6ffd640 0 client.25751 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.427+0000 7f4af42c1740 1 -- 172.21.15.47:0/26345666 shutdown_connections 2024-09-21T01:04:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.427+0000 7f4af42c1740 1 -- 172.21.15.47:0/26345666 wait complete. 2024-09-21T01:04:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.427+0000 7f4af42c1740 20 client.25751 trim_cache size 0 max 16384 2024-09-21T01:04:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4af42c1740 1 Processor -- start 2024-09-21T01:04:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4af42c1740 1 -- start start 2024-09-21T01:04:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 0x5596972f9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f27390 0x5596972fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f48070 0x5596972ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4af42c1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81aaf70 con 0x559696f27390 2024-09-21T01:04:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4af42c1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81ad7d0 con 0x559696f48070 2024-09-21T01:04:57.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4af42c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81ab5c0 con 0x559696f1f1b0 2024-09-21T01:04:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f27390 0x5596972fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f27390 0x5596972fc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45384/0 (socket says 172.21.15.47:45384) 2024-09-21T01:04:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4adeffd640 1 -- 172.21.15.47:0/1435262376 learned_addr learned my addr 172.21.15.47:0/1435262376 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:57.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f48070 0x5596972ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.447+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 0x5596972f9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4adeffd640 1 -- 172.21.15.47:0/1435262376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 msgr2=0x5596972f9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4adeffd640 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 0x5596972f9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4adeffd640 1 -- 172.21.15.47:0/1435262376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f48070 msgr2=0x5596972ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4adeffd640 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f48070 0x5596972ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4adeffd640 1 -- 172.21.15.47:0/1435262376 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596972fbbe0 con 0x559696f27390 2024-09-21T01:04:57.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f48070 0x5596972ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4adeffd640 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f27390 0x5596972fc8e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0010850 tx=0x7f4ad0010ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350a60c4a4854001 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4add7fa640 1 -- 172.21.15.47:0/1435262376 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0010ce0 con 0x559696f27390 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4add7fa640 1 -- 172.21.15.47:0/1435262376 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad00055c0 con 0x559696f27390 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.448+0000 7f4add7fa640 1 -- 172.21.15.47:0/1435262376 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00039e0 con 0x559696f27390 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 -- 172.21.15.47:0/1435262376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f27390 msgr2=0x5596972fc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f27390 0x5596972fc8e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0010850 tx=0x7f4ad0010ac0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 -- 172.21.15.47:0/1435262376 shutdown_connections 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f48070 0x5596972ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f27390 0x5596972fc8e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1435262376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 0x5596972f9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 -- 172.21.15.47:0/1435262376 >> 172.21.15.47:0/1435262376 conn(0x559696f3c460 msgr2=0x5596972fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 -- 172.21.15.47:0/1435262376 shutdown_connections 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 -- 172.21.15.47:0/1435262376 wait complete. 2024-09-21T01:04:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.449+0000 7f4af42c1740 1 -- start start 2024-09-21T01:04:57.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4af42c1740 1 Processor -- start 2024-09-21T01:04:57.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 0x559697302cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596973032a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4af42c1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f48070 0x559697307140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4af42c1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81abc90 con 0x559696f48070 2024-09-21T01:04:57.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4af42c1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81ad100 con 0x559696f27390 2024-09-21T01:04:57.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4af42c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81ac360 con 0x559696f1f1b0 2024-09-21T01:04:57.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4af42c1740 10 client.0 _ll_register_callbacks cb 0x7f4ad0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f48070 0x559697307140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4ae7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f48070 0x559697307140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45386/0 (socket says 172.21.15.47:45386) 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4ae7fff640 1 -- 172.21.15.47:0/1493518432 learned_addr learned my addr 172.21.15.47:0/1493518432 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4adeffd640 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596973032a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.450+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 0x559697302cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ae7fff640 1 -- 172.21.15.47:0/1493518432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 msgr2=0x559697302cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 0x559697302cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ae7fff640 1 -- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 msgr2=0x5596973032a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596973032a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ae7fff640 1 -- 172.21.15.47:0/1493518432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596973077b0 con 0x559696f48070 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4adeffd640 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596973032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ae7fff640 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f48070 0x559697307140 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0003d20 tx=0x7f4ad00128a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc7986014abdcfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:04:57.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ac6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/1493518432 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0031af0 con 0x559696f48070 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4af42c1740 1 -- 172.21.15.47:0/1493518432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad00055c0 con 0x559696f48070 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.451+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/1493518432 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f4ae004a040 con 0x559696f48070 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/1493518432 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4ae0031450 con 0x559696f48070 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4af42c1740 10 client.16086 fetch_fsmap learned FSMap version 19 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4af42c1740 1 -- 172.21.15.47:0/1493518432 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55969737b7e0 con 0x559696f48070 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/1493518432 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad00055c0 con 0x559696f48070 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/1493518432 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4ae0066070 con 0x559696f48070 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4af42c1740 10 client.16086 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4af42c1740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4af42c1740 20 client.16086 populate_metadata read hostname 'smithi047' 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x559696edbda0 0x55969737dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4af42c1740 4 client.16086 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:04:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4af42c1740 1 -- 172.21.15.47:0/1493518432 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559697263850 con 0x559696edbda0 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.452+0000 7f4adeffd640 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x559696edbda0 0x55969737dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.453+0000 7f4ac6ffd640 10 client.16086 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.453+0000 7f4adeffd640 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x559696edbda0 0x55969737dcd0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0c1e594d08b652a server_cookie=12c967b5fe4a7188 in_seq=0 out_seq=0 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.453+0000 7f4ac6ffd640 1 -- 172.21.15.47:0/1493518432 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2282 (crc 0 0 0) 0x559697263850 con 0x559696edbda0 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.453+0000 7f4ac6ffd640 10 client.16086 handle_command_reply: tid=0 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.453+0000 7f4af42c1740 1 client.16086 shutdown 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 -- 172.21.15.47:0/1493518432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f48070 msgr2=0x559697307140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f48070 0x559697307140 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0003d20 tx=0x7f4ad00128a0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 -- 172.21.15.47:0/1493518432 shutdown_connections 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x559696edbda0 0x55969737dcd0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559696f48070 0x559697307140 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559696f27390 0x5596973032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 --2- 172.21.15.47:0/1493518432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559696f1f1b0 0x559697302cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 -- 172.21.15.47:0/1493518432 >> 172.21.15.47:0/1493518432 conn(0x559696f3c460 msgr2=0x5596972fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:57.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4ac6ffd640 0 client.16086 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:04:57.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 -- 172.21.15.47:0/1493518432 shutdown_connections 2024-09-21T01:04:57.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 1 -- 172.21.15.47:0/1493518432 wait complete. 2024-09-21T01:04:57.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.454+0000 7f4af42c1740 20 client.16086 trim_cache size 0 max 16384 2024-09-21T01:04:57.459 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:04:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (201 inodes in the stack)", 2024-09-21T01:04:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:04:57.459 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "736e4c53-6a66-4fe2-8a04-61c577d889f1", 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:55.468495+0000", 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:57.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87": { 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:13.847440+0000", 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:57.461 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:57.462 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:04:57.463 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:04:57.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 -- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4ad40b6510 msgr2=0x7f4ad40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4ad40b6510 0x7f4ad40b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80ad530 tx=0x7f4ad8000bc0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 -- 172.21.15.47:0/2931418959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ae8101ff0 msgr2=0x7f4ae819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ae8101ff0 0x7f4ae819a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800e9f0 tx=0x7f4ad800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 -- 172.21.15.47:0/2931418959 shutdown_connections 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f4ad40b6510 0x7f4ad40b8a20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae8106c20 0x7f4ae819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae81062d0 0x7f4ae819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 --2- 172.21.15.47:0/2931418959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ae8101ff0 0x7f4ae819a430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 -- 172.21.15.47:0/2931418959 >> 172.21.15.47:0/2931418959 conn(0x7f4ae8077cc0 msgr2=0x7f4ae8107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 -- 172.21.15.47:0/2931418959 shutdown_connections 2024-09-21T01:04:57.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:04:57.455+0000 7f4aedd4d640 1 -- 172.21.15.47:0/2931418959 wait complete. 2024-09-21T01:04:58.274 INFO:tasks.cephfs.filesystem:scrub status for tag:736e4c53-6a66-4fe2-8a04-61c577d889f1 - {'path': '/', 'tag': '736e4c53-6a66-4fe2-8a04-61c577d889f1', 'options': 'recursive,force'} 2024-09-21T01:04:59.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:04:59 smithi134 ceph-mon[34785]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 5.36k op/s 2024-09-21T01:04:59.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:04:59 smithi114 ceph-mon[34309]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 5.36k op/s 2024-09-21T01:04:59.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:04:59 smithi047 ceph-mon[30960]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 5.36k op/s 2024-09-21T01:05:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:00.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:00.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:05:00.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:00.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:00.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:05:00.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:05:01.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:01 smithi134 ceph-mon[34785]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 33 MiB/s wr, 4.80k op/s 2024-09-21T01:05:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:01 smithi114 ceph-mon[34309]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 33 MiB/s wr, 4.80k op/s 2024-09-21T01:05:01.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:01 smithi047 ceph-mon[30960]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 33 MiB/s wr, 4.80k op/s 2024-09-21T01:05:03.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:03 smithi134 ceph-mon[34785]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-09-21T01:05:03.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:03 smithi114 ceph-mon[34309]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-09-21T01:05:03.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:03 smithi047 ceph-mon[30960]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 32 MiB/s wr, 4.60k op/s 2024-09-21T01:05:05.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:05 smithi134 ceph-mon[34785]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 37 MiB/s wr, 5.41k op/s 2024-09-21T01:05:05.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:05 smithi114 ceph-mon[34309]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 37 MiB/s wr, 5.41k op/s 2024-09-21T01:05:05.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:05 smithi047 ceph-mon[30960]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 37 MiB/s wr, 5.41k op/s 2024-09-21T01:05:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.282+0000 7fa82319d640 1 -- 172.21.15.47:0/2548936457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c102a30 msgr2=0x7fa81c104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.282+0000 7fa82319d640 1 --2- 172.21.15.47:0/2548936457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c102a30 0x7fa81c104eb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa818009900 tx=0x7fa81802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 -- 172.21.15.47:0/2548936457 shutdown_connections 2024-09-21T01:05:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 --2- 172.21.15.47:0/2548936457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa81c108110 0x7fa81c10a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 --2- 172.21.15.47:0/2548936457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c1054f0 0x7fa81c1079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 --2- 172.21.15.47:0/2548936457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c102a30 0x7fa81c104eb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 -- 172.21.15.47:0/2548936457 >> 172.21.15.47:0/2548936457 conn(0x7fa81c0fd4c0 msgr2=0x7fa81c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 -- 172.21.15.47:0/2548936457 shutdown_connections 2024-09-21T01:05:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 -- 172.21.15.47:0/2548936457 wait complete. 2024-09-21T01:05:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 Processor -- start 2024-09-21T01:05:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.283+0000 7fa82319d640 1 -- start start 2024-09-21T01:05:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82319d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa81c102a30 0x7fa81c199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82319d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c1054f0 0x7fa81c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82319d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c108110 0x7fa81c19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82319d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c10f140 con 0x7fa81c102a30 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82319d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c10efc0 con 0x7fa81c108110 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82319d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c10f2c0 con 0x7fa81c1054f0 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82219b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa81c102a30 0x7fa81c199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82199a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c1054f0 0x7fa81c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82199a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c1054f0 0x7fa81c19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:39156/0 (socket says 172.21.15.47:39156) 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82219b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa81c102a30 0x7fa81c199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49168/0 (socket says 172.21.15.47:49168) 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82199a640 1 -- 172.21.15.47:0/1147814792 learned_addr learned my addr 172.21.15.47:0/1147814792 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82299c640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c108110 0x7fa81c19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82199a640 1 -- 172.21.15.47:0/1147814792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c108110 msgr2=0x7fa81c19af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82199a640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c108110 0x7fa81c19af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82199a640 1 -- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa81c102a30 msgr2=0x7fa81c199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82199a640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa81c102a30 0x7fa81c199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82199a640 1 -- 172.21.15.47:0/1147814792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c19b7a0 con 0x7fa81c1054f0 2024-09-21T01:05:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.284+0000 7fa82299c640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c108110 0x7fa81c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.285+0000 7fa82199a640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c1054f0 0x7fa81c19a3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00ea60 tx=0x7fa80c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.285+0000 7fa8137fe640 1 -- 172.21.15.47:0/1147814792 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00cde0 con 0x7fa81c1054f0 2024-09-21T01:05:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.285+0000 7fa82319d640 1 -- 172.21.15.47:0/1147814792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81c19ba90 con 0x7fa81c1054f0 2024-09-21T01:05:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.285+0000 7fa8137fe640 1 -- 172.21.15.47:0/1147814792 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa80c0035f0 con 0x7fa81c1054f0 2024-09-21T01:05:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.285+0000 7fa8137fe640 1 -- 172.21.15.47:0/1147814792 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c010690 con 0x7fa81c1054f0 2024-09-21T01:05:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.285+0000 7fa82319d640 1 -- 172.21.15.47:0/1147814792 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81c1a2180 con 0x7fa81c1054f0 2024-09-21T01:05:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.288+0000 7fa82b443740 1 Processor -- start 2024-09-21T01:05:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.288+0000 7fa82b443740 1 -- start start 2024-09-21T01:05:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82b443740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056769b1b0 0x560567a43040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82b443740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82b443740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 0x560567a44200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82b443740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605679b56f0 con 0x56056769b1b0 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82b443740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5605679a4b20 con 0x5605676722f0 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82b443740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5605679a8930 con 0x56056767a4d0 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82219b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82299c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056769b1b0 0x560567a43040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82219b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:50286/0 (socket says 172.21.15.47:50286) 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa82219b640 1 -- 172.21.15.47:0/402816787 learned_addr learned my addr 172.21.15.47:0/402816787 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.289+0000 7fa8137fe640 1 -- 172.21.15.47:0/1147814792 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa80c010830 con 0x7fa81c1054f0 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa82219b640 1 -- 172.21.15.47:0/402816787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 msgr2=0x560567a44200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa82219b640 1 --2- 172.21.15.47:0/402816787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 0x560567a44200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa82219b640 1 -- 172.21.15.47:0/402816787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056769b1b0 msgr2=0x560567a43040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa82219b640 1 --2- 172.21.15.47:0/402816787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056769b1b0 0x560567a43040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.292 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa82219b640 1 -- 172.21.15.47:0/402816787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56056796a530 con 0x5605676722f0 2024-09-21T01:05:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa82219b640 1 --2- 172.21.15.47:0/402816787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a436b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa81802a910 tx=0x7fa818009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5850c92cde4d8f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa810bfe640 1 -- 172.21.15.47:0/402816787 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818035030 con 0x5605676722f0 2024-09-21T01:05:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa810bfe640 1 -- 172.21.15.47:0/402816787 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa818040070 con 0x5605676722f0 2024-09-21T01:05:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.290+0000 7fa810bfe640 1 -- 172.21.15.47:0/402816787 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8180039b0 con 0x5605676722f0 2024-09-21T01:05:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.291+0000 7fa8137fe640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8080b6510 0x7fa8080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.291+0000 7fa82299c640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8080b6510 0x7fa8080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.291+0000 7fa8137fe640 1 -- 172.21.15.47:0/1147814792 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa80c0e7540 con 0x7fa81c1054f0 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 -- 172.21.15.47:0/402816787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 msgr2=0x560567a436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82299c640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8080b6510 0x7fa8080b8a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa814009fd0 tx=0x7fa814009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 --2- 172.21.15.47:0/402816787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a436b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa81802a910 tx=0x7fa818009620 comp rx=0 tx=0).stop 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 -- 172.21.15.47:0/402816787 shutdown_connections 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 --2- 172.21.15.47:0/402816787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 0x560567a44200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 --2- 172.21.15.47:0/402816787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a436b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 --2- 172.21.15.47:0/402816787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056769b1b0 0x560567a43040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 -- 172.21.15.47:0/402816787 >> 172.21.15.47:0/402816787 conn(0x56056768f300 msgr2=0x560567a3ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 -- 172.21.15.47:0/402816787 shutdown_connections 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 -- 172.21.15.47:0/402816787 wait complete. 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.292+0000 7fa82b443740 1 -- start start 2024-09-21T01:05:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82b443740 1 Processor -- start 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82b443740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a50c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82b443740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82b443740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056769b1b0 0x560567a51e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82b443740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605678dcab0 con 0x56056767a4d0 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82b443740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56056794a730 con 0x5605676722f0 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82b443740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560567a44cc0 con 0x56056769b1b0 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82219b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a50c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82219b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a50c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:50294/0 (socket says 172.21.15.47:50294) 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82219b640 1 -- 172.21.15.47:0/1562727561 learned_addr learned my addr 172.21.15.47:0/1562727561 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.293+0000 7fa82b443740 10 client.0 _ll_register_callbacks cb 0x56056799e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa82219b640 1 -- 172.21.15.47:0/1562727561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056769b1b0 msgr2=0x560567a51e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa82219b640 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056769b1b0 0x560567a51e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa82219b640 1 -- 172.21.15.47:0/1562727561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 msgr2=0x560567a512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa82219b640 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa82219b640 1 -- 172.21.15.47:0/1562727561 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560567706790 con 0x5605676722f0 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa82219b640 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a50c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa818000c00 tx=0x7fa818004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38df9975dc2a7bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa805ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa805ffb640 1 -- 172.21.15.47:0/1562727561 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818053060 con 0x5605676722f0 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa805ffb640 1 -- 172.21.15.47:0/1562727561 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa8180036f0 con 0x5605676722f0 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.294+0000 7fa82b443740 1 -- 172.21.15.47:0/1562727561 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa818040070 con 0x5605676722f0 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.295+0000 7fa805ffb640 1 -- 172.21.15.47:0/1562727561 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa818035070 con 0x5605676722f0 2024-09-21T01:05:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.295+0000 7fa82b443740 10 client.25769 fetch_fsmap learned FSMap version 19 2024-09-21T01:05:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.295+0000 7fa82b443740 1 -- 172.21.15.47:0/1562727561 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56056777f620 con 0x5605676722f0 2024-09-21T01:05:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.295+0000 7fa805ffb640 1 -- 172.21.15.47:0/1562727561 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa818040070 con 0x5605676722f0 2024-09-21T01:05:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.296+0000 7fa805ffb640 1 -- 172.21.15.47:0/1562727561 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa81804d030 con 0x5605676722f0 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.296+0000 7fa82b443740 10 client.25769 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.296+0000 7fa82b443740 10 client.25769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.296+0000 7fa82b443740 20 client.25769 populate_metadata read hostname 'smithi047' 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.296+0000 7fa82b443740 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x560567659d80 0x560567a5df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.296+0000 7fa82b443740 4 client.25769 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.296+0000 7fa82b443740 1 -- 172.21.15.47:0/1562727561 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605679b7640 con 0x560567659d80 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.297+0000 7fa82199a640 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x560567659d80 0x560567a5df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.297+0000 7fa82199a640 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x560567659d80 0x560567a5df10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d4729daa0fef30e server_cookie=e00f0ac576dfa3e8 in_seq=0 out_seq=0 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.297+0000 7fa805ffb640 10 client.25769 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa805ffb640 1 -- 172.21.15.47:0/1562727561 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605679b7640 con 0x560567659d80 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa805ffb640 10 client.25769 handle_command_reply: tid=0 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 client.25769 shutdown 2024-09-21T01:05:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 -- 172.21.15.47:0/1562727561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 msgr2=0x560567a50c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a50c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa818000c00 tx=0x7fa818004270 comp rx=0 tx=0).stop 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 -- 172.21.15.47:0/1562727561 shutdown_connections 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x560567659d80 0x560567a5df10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056769b1b0 0x560567a51e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 --2- 172.21.15.47:0/1562727561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a50c20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa805ffb640 0 client.25769 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 -- 172.21.15.47:0/1562727561 >> 172.21.15.47:0/1562727561 conn(0x56056768f300 msgr2=0x560567a3d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 -- 172.21.15.47:0/1562727561 shutdown_connections 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 1 -- 172.21.15.47:0/1562727561 wait complete. 2024-09-21T01:05:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.298+0000 7fa82b443740 20 client.25769 trim_cache size 0 max 16384 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82b443740 1 Processor -- start 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82b443740 1 -- start start 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82b443740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560567659d80 0x560567a39870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82b443740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a58d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82b443740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a3ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82b443740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c1a6960 con 0x56056767a4d0 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82b443740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c1a9170 con 0x5605676722f0 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82b443740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c1a6fb0 con 0x560567659d80 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82299c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a3ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82219b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560567659d80 0x560567a39870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82199a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a58d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82199a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a58d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:50296/0 (socket says 172.21.15.47:50296) 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82219b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560567659d80 0x560567a39870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:39202/0 (socket says 172.21.15.47:39202) 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82199a640 1 -- 172.21.15.47:0/3648212886 learned_addr learned my addr 172.21.15.47:0/3648212886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.316+0000 7fa82299c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a3ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49186/0 (socket says 172.21.15.47:49186) 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa82299c640 1 -- 172.21.15.47:0/3648212886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560567659d80 msgr2=0x560567a39870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa82299c640 1 --2- 172.21.15.47:0/3648212886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560567659d80 0x560567a39870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa82299c640 1 -- 172.21.15.47:0/3648212886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 msgr2=0x560567a58d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa82299c640 1 --2- 172.21.15.47:0/3648212886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a58d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa82299c640 1 -- 172.21.15.47:0/3648212886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560567a3eaf0 con 0x56056767a4d0 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa82199a640 1 --2- 172.21.15.47:0/3648212886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a58d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa82299c640 1 --2- 172.21.15.47:0/3648212886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a3ef10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa814012470 tx=0x7fa814017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2961ebb811edf8ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa807fff640 1 -- 172.21.15.47:0/3648212886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81400fd90 con 0x56056767a4d0 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa807fff640 1 -- 172.21.15.47:0/3648212886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa814004500 con 0x56056767a4d0 2024-09-21T01:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.317+0000 7fa807fff640 1 -- 172.21.15.47:0/3648212886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814011840 con 0x56056767a4d0 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 -- 172.21.15.47:0/3648212886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 msgr2=0x560567a3ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 --2- 172.21.15.47:0/3648212886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a3ef10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa814012470 tx=0x7fa814017000 comp rx=0 tx=0).stop 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 -- 172.21.15.47:0/3648212886 shutdown_connections 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 --2- 172.21.15.47:0/3648212886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56056767a4d0 0x560567a3ef10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 --2- 172.21.15.47:0/3648212886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a58d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 --2- 172.21.15.47:0/3648212886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560567659d80 0x560567a39870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 -- 172.21.15.47:0/3648212886 >> 172.21.15.47:0/3648212886 conn(0x56056768f300 msgr2=0x560567a47a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 -- 172.21.15.47:0/3648212886 shutdown_connections 2024-09-21T01:05:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 -- 172.21.15.47:0/3648212886 wait complete. 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.318+0000 7fa82b443740 1 -- start start 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82b443740 1 Processor -- start 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82b443740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560567659d80 0x560567a55ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82b443740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82b443740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 0x560567a56f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82b443740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c1a7630 con 0x560567659d80 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82b443740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c1a8aa0 con 0x5605676722f0 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82b443740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c1a7d00 con 0x56056767a4d0 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82b443740 10 client.0 _ll_register_callbacks cb 0x7fa814009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82219b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560567659d80 0x560567a55ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82299c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 0x560567a56f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82219b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560567659d80 0x560567a55ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49194/0 (socket says 172.21.15.47:49194) 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82219b640 1 -- 172.21.15.47:0/1922612171 learned_addr learned my addr 172.21.15.47:0/1922612171 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82199a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.319+0000 7fa82199a640 1 -- 172.21.15.47:0/1922612171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 msgr2=0x560567a56f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa82199a640 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 0x560567a56f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa82199a640 1 -- 172.21.15.47:0/1922612171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560567659d80 msgr2=0x560567a55ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa82199a640 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560567659d80 0x560567a55ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa82199a640 1 -- 172.21.15.47:0/1922612171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560567a57670 con 0x5605676722f0 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa82219b640 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560567659d80 0x560567a55ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa82199a640 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a563a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c760 tx=0x7fa80c0e7910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d86dfea2d91c729c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa805ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa805ffb640 1 -- 172.21.15.47:0/1922612171 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0ad280 con 0x5605676722f0 2024-09-21T01:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa805ffb640 1 -- 172.21.15.47:0/1922612171 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa80c0a99e0 con 0x5605676722f0 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa82b443740 1 -- 172.21.15.47:0/1922612171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa814004500 con 0x5605676722f0 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.320+0000 7fa805ffb640 1 -- 172.21.15.47:0/1922612171 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa80c0ade70 con 0x5605676722f0 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82b443740 10 client.25775 fetch_fsmap learned FSMap version 19 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82b443740 1 -- 172.21.15.47:0/1922612171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560567a58a30 con 0x5605676722f0 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa805ffb640 1 -- 172.21.15.47:0/1922612171 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa814004500 con 0x5605676722f0 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa805ffb640 1 -- 172.21.15.47:0/1922612171 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa80c004190 con 0x5605676722f0 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82b443740 10 client.25775 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82b443740 10 client.25775 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82b443740 20 client.25775 populate_metadata read hostname 'smithi047' 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82b443740 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56056769b1b0 0x560567acaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82b443740 4 client.25775 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82b443740 1 -- 172.21.15.47:0/1922612171 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5605679b30f0 con 0x56056769b1b0 2024-09-21T01:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.321+0000 7fa82219b640 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56056769b1b0 0x560567acaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.322+0000 7fa805ffb640 10 client.25775 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:06.327 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:06.322+0000 7fa82219b640 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56056769b1b0 0x560567acaa30 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4eb699c831b07a1 server_cookie=980e7fcc5f98fe21 in_seq=0 out_seq=0 2024-09-21T01:05:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:07 smithi134 ceph-mon[34785]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 4.37k op/s 2024-09-21T01:05:07.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:07 smithi114 ceph-mon[34309]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 4.37k op/s 2024-09-21T01:05:07.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:07 smithi047 ceph-mon[30960]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 MiB/s wr, 4.37k op/s 2024-09-21T01:05:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:09 smithi134 ceph-mon[34785]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 36 MiB/s wr, 5.32k op/s 2024-09-21T01:05:09.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:09 smithi114 ceph-mon[34309]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 36 MiB/s wr, 5.32k op/s 2024-09-21T01:05:09.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:09 smithi047 ceph-mon[30960]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 36 MiB/s wr, 5.32k op/s 2024-09-21T01:05:11.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:11 smithi134 ceph-mon[34785]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 4.65k op/s 2024-09-21T01:05:11.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:11 smithi114 ceph-mon[34309]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 4.65k op/s 2024-09-21T01:05:11.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:11 smithi047 ceph-mon[30960]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 4.65k op/s 2024-09-21T01:05:13.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:13 smithi047 ceph-mon[30960]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 4.45k op/s 2024-09-21T01:05:13.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:13 smithi134 ceph-mon[34785]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 4.45k op/s 2024-09-21T01:05:13.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:13 smithi114 ceph-mon[34309]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 MiB/s wr, 4.45k op/s 2024-09-21T01:05:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:15 smithi134 ceph-mon[34785]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 37 MiB/s wr, 5.61k op/s 2024-09-21T01:05:15.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:15 smithi114 ceph-mon[34309]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 37 MiB/s wr, 5.61k op/s 2024-09-21T01:05:15.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:15 smithi047 ceph-mon[30960]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 37 MiB/s wr, 5.61k op/s 2024-09-21T01:05:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:17 smithi134 ceph-mon[34785]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 30 MiB/s wr, 4.50k op/s 2024-09-21T01:05:17.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:17 smithi114 ceph-mon[34309]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 30 MiB/s wr, 4.50k op/s 2024-09-21T01:05:17.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:17 smithi047 ceph-mon[30960]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 30 MiB/s wr, 4.50k op/s 2024-09-21T01:05:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:19 smithi134 ceph-mon[34785]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 36 MiB/s wr, 5.24k op/s 2024-09-21T01:05:19.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:19 smithi114 ceph-mon[34309]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 36 MiB/s wr, 5.24k op/s 2024-09-21T01:05:19.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:19 smithi047 ceph-mon[30960]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 36 MiB/s wr, 5.24k op/s 2024-09-21T01:05:21.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:21 smithi134 ceph-mon[34785]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 31 MiB/s wr, 4.47k op/s 2024-09-21T01:05:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:21 smithi114 ceph-mon[34309]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 31 MiB/s wr, 4.47k op/s 2024-09-21T01:05:21.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:21 smithi047 ceph-mon[30960]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 31 MiB/s wr, 4.47k op/s 2024-09-21T01:05:23.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:23 smithi134 ceph-mon[34785]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 31 MiB/s wr, 4.48k op/s 2024-09-21T01:05:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:23 smithi114 ceph-mon[34309]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 31 MiB/s wr, 4.48k op/s 2024-09-21T01:05:23.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:23 smithi047 ceph-mon[30960]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 31 MiB/s wr, 4.48k op/s 2024-09-21T01:05:25.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:25 smithi134 ceph-mon[34785]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 38 MiB/s wr, 5.46k op/s 2024-09-21T01:05:25.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:25 smithi114 ceph-mon[34309]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 38 MiB/s wr, 5.46k op/s 2024-09-21T01:05:25.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:25 smithi047 ceph-mon[30960]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 38 MiB/s wr, 5.46k op/s 2024-09-21T01:05:27.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:27 smithi134 ceph-mon[34785]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 29 MiB/s wr, 4.21k op/s 2024-09-21T01:05:27.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:27 smithi114 ceph-mon[34309]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 29 MiB/s wr, 4.21k op/s 2024-09-21T01:05:27.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:27 smithi047 ceph-mon[30960]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 29 MiB/s wr, 4.21k op/s 2024-09-21T01:05:28.275 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:05:28.565 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:05:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.102+0000 7fbbe3d37640 1 -- 172.21.15.47:0/2133302041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc108cf0 msgr2=0x7fbbdc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.102+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/2133302041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc108cf0 0x7fbbdc10f520 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009900 tx=0x7fbbd402a410 comp rx=0 tx=0).stop 2024-09-21T01:05:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.102+0000 7fbbe3d37640 1 -- 172.21.15.47:0/2133302041 shutdown_connections 2024-09-21T01:05:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.102+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/2133302041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc108cf0 0x7fbbdc10f520 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.102+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/2133302041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbdc1083a0 0x7fbbdc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.102+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/2133302041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbdc102a60 0x7fbbdc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.102+0000 7fbbe3d37640 1 -- 172.21.15.47:0/2133302041 >> 172.21.15.47:0/2133302041 conn(0x7fbbdc079730 msgr2=0x7fbbdc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.103+0000 7fbbe3d37640 1 -- 172.21.15.47:0/2133302041 shutdown_connections 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.103+0000 7fbbe3d37640 1 -- 172.21.15.47:0/2133302041 wait complete. 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.103+0000 7fbbe3d37640 1 Processor -- start 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.103+0000 7fbbe3d37640 1 -- start start 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe3d37640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc102a60 0x7fbbdc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe3d37640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbdc1083a0 0x7fbbdc19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe3d37640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbdc108cf0 0x7fbbdc19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe3d37640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc112960 con 0x7fbbdc102a60 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe3d37640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc1127e0 con 0x7fbbdc1083a0 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe3d37640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc112ae0 con 0x7fbbdc108cf0 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe1ad3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc102a60 0x7fbbdc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe1ad3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc102a60 0x7fbbdc19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42204/0 (socket says 172.21.15.47:42204) 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe1ad3640 1 -- 172.21.15.47:0/1588901106 learned_addr learned my addr 172.21.15.47:0/1588901106 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe12d2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbdc1083a0 0x7fbbdc19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbdc108cf0 0x7fbbdc19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe1ad3640 1 -- 172.21.15.47:0/1588901106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbdc108cf0 msgr2=0x7fbbdc19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe1ad3640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbdc108cf0 0x7fbbdc19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe1ad3640 1 -- 172.21.15.47:0/1588901106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbdc1083a0 msgr2=0x7fbbdc19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe1ad3640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbdc1083a0 0x7fbbdc19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.104+0000 7fbbe1ad3640 1 -- 172.21.15.47:0/1588901106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc1a0350 con 0x7fbbdc102a60 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.105+0000 7fbbe1ad3640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc102a60 0x7fbbdc19a3e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00eb90 tx=0x7fbbcc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.105+0000 7fbbdaffd640 1 -- 172.21.15.47:0/1588901106 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc004d20 con 0x7fbbdc102a60 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.105+0000 7fbbe3d37640 1 -- 172.21.15.47:0/1588901106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbdc1a0640 con 0x7fbbdc102a60 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.105+0000 7fbbdaffd640 1 -- 172.21.15.47:0/1588901106 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbcc00ee90 con 0x7fbbdc102a60 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.105+0000 7fbbdaffd640 1 -- 172.21.15.47:0/1588901106 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc010670 con 0x7fbbdc102a60 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.105+0000 7fbbe3d37640 1 -- 172.21.15.47:0/1588901106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbdc1a6da0 con 0x7fbbdc102a60 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.107+0000 7fbbea2ab740 1 Processor -- start 2024-09-21T01:05:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbea2ab740 1 -- start start 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbdaffd640 1 -- 172.21.15.47:0/1588901106 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fbbcc005020 con 0x7fbbdc102a60 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f76070 0x55641631d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f4d1b0 0x55641631db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 0x55641631e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556416293e50 con 0x556415f76070 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x556416283280 con 0x556415f55390 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556416287090 con 0x556415f4d1b0 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe22d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f76070 0x55641631d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe1ad3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f4d1b0 0x55641631db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe22d4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f76070 0x55641631d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42214/0 (socket says 172.21.15.47:42214) 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe22d4640 1 -- 172.21.15.47:0/3789036570 learned_addr learned my addr 172.21.15.47:0/3789036570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/3789036570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 0x55641631e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe22d4640 1 -- 172.21.15.47:0/3789036570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f4d1b0 msgr2=0x55641631db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/3789036570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f4d1b0 0x55641631db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe22d4640 1 -- 172.21.15.47:0/3789036570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 msgr2=0x55641631e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/3789036570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 0x55641631e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.108+0000 7fbbe22d4640 1 -- 172.21.15.47:0/3789036570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556415fe1650 con 0x556415f76070 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.109+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/3789036570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f76070 0x55641631d650 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009900 tx=0x7fbbd4032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b52a830320a512 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.109+0000 7fbbc3fff640 1 -- 172.21.15.47:0/3789036570 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4040070 con 0x556415f76070 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.109+0000 7fbbdaffd640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbc40b6510 0x7fbbc40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.109+0000 7fbbc3fff640 1 -- 172.21.15.47:0/3789036570 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbd4004030 con 0x556415f76070 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.109+0000 7fbbc3fff640 1 -- 172.21.15.47:0/3789036570 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4035040 con 0x556415f76070 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.109+0000 7fbbdaffd640 1 -- 172.21.15.47:0/1588901106 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbbcc0e7860 con 0x7fbbdc102a60 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.109+0000 7fbbe1ad3640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbc40b6510 0x7fbbc40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 -- 172.21.15.47:0/3789036570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f76070 msgr2=0x55641631d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbe1ad3640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbc40b6510 0x7fbbc40b8a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0aa060 tx=0x7fbbcc0ed530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/3789036570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f76070 0x55641631d650 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009900 tx=0x7fbbd4032b20 comp rx=0 tx=0).stop 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 -- 172.21.15.47:0/3789036570 shutdown_connections 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/3789036570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 0x55641631e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/3789036570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f4d1b0 0x55641631db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/3789036570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f76070 0x55641631d650 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 -- 172.21.15.47:0/3789036570 >> 172.21.15.47:0/3789036570 conn(0x556415f6a460 msgr2=0x55641631b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 -- 172.21.15.47:0/3789036570 shutdown_connections 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.110+0000 7fbbea2ab740 1 -- 172.21.15.47:0/3789036570 wait complete. 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 1 -- start start 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 1 Processor -- start 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f4d1b0 0x55641632d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f55390 0x55641632d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f76070 0x55641632db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5564160e4700 con 0x556415f55390 2024-09-21T01:05:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55641621e110 con 0x556415f4d1b0 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556416330130 con 0x556415f76070 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.111+0000 7fbbea2ab740 10 client.0 _ll_register_callbacks cb 0x556416237990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f55390 0x55641632d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f55390 0x55641632d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42222/0 (socket says 172.21.15.47:42222) 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 -- 172.21.15.47:0/2852514438 learned_addr learned my addr 172.21.15.47:0/2852514438 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 -- 172.21.15.47:0/2852514438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f76070 msgr2=0x55641632db10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f76070 0x55641632db10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 -- 172.21.15.47:0/2852514438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f4d1b0 msgr2=0x55641632d090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f4d1b0 0x55641632d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 -- 172.21.15.47:0/2852514438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55641624bc40 con 0x556415f55390 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f55390 0x55641632d5d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0012720 tx=0x7fbbd0012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3524e60d4222f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:05:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.112+0000 7fbbc17fa640 1 -- 172.21.15.47:0/2852514438 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000f920 con 0x556415f55390 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.113+0000 7fbbc17fa640 1 -- 172.21.15.47:0/2852514438 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbbd000fac0 con 0x556415f55390 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.113+0000 7fbbea2ab740 1 -- 172.21.15.47:0/2852514438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbd4004030 con 0x556415f55390 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.113+0000 7fbbc17fa640 1 -- 172.21.15.47:0/2852514438 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbbd000fd00 con 0x556415f55390 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.113+0000 7fbbea2ab740 10 client.16113 fetch_fsmap learned FSMap version 19 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.113+0000 7fbbea2ab740 1 -- 172.21.15.47:0/2852514438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55641633bed0 con 0x556415f55390 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.113+0000 7fbbc17fa640 1 -- 172.21.15.47:0/2852514438 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbd4004030 con 0x556415f55390 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbc17fa640 1 -- 172.21.15.47:0/2852514438 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fbbd0010470 con 0x556415f55390 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbea2ab740 10 client.16113 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbea2ab740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbea2ab740 20 client.16113 populate_metadata read hostname 'smithi047' 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556415f349f0 0x55641633f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbea2ab740 4 client.16113 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbea2ab740 1 -- 172.21.15.47:0/2852514438 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556416295da0 con 0x556415f349f0 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556415f349f0 0x55641633f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbc17fa640 10 client.16113 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.114+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556415f349f0 0x55641633f4f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fe70b291380efe1 server_cookie=4010ad230d6c3d6e in_seq=0 out_seq=0 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbc17fa640 1 -- 172.21.15.47:0/2852514438 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556416295da0 con 0x556415f349f0 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbc17fa640 10 client.16113 handle_command_reply: tid=0 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 client.16113 shutdown 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 -- 172.21.15.47:0/2852514438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f55390 msgr2=0x55641632d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f55390 0x55641632d5d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0012720 tx=0x7fbbd0012be0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 -- 172.21.15.47:0/2852514438 shutdown_connections 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556415f349f0 0x55641633f4f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f76070 0x55641632db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f55390 0x55641632d5d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbc17fa640 0 client.16113 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:29.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/2852514438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f4d1b0 0x55641632d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 -- 172.21.15.47:0/2852514438 >> 172.21.15.47:0/2852514438 conn(0x556415f6a460 msgr2=0x55641631f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 -- 172.21.15.47:0/2852514438 shutdown_connections 2024-09-21T01:05:29.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.115+0000 7fbbea2ab740 1 -- 172.21.15.47:0/2852514438 wait complete. 2024-09-21T01:05:29.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.116+0000 7fbbea2ab740 20 client.16113 trim_cache size 0 max 16384 2024-09-21T01:05:29.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.134+0000 7fbbea2ab740 1 Processor -- start 2024-09-21T01:05:29.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.134+0000 7fbbea2ab740 1 -- start start 2024-09-21T01:05:29.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.134+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f349f0 0x556416339da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.134+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x55641631ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.134+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f55390 0x55641631b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.134+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc1aae90 con 0x556415f4d1b0 2024-09-21T01:05:29.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.134+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc1ad6f0 con 0x556415f349f0 2024-09-21T01:05:29.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.134+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc1ab4e0 con 0x556415f55390 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x55641631ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x55641631ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42230/0 (socket says 172.21.15.47:42230) 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 -- 172.21.15.47:0/933985548 learned_addr learned my addr 172.21.15.47:0/933985548 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f349f0 0x556416339da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f55390 0x55641631b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 -- 172.21.15.47:0/933985548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f55390 msgr2=0x55641631b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f55390 0x55641631b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 -- 172.21.15.47:0/933985548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f349f0 msgr2=0x556416339da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f349f0 0x556416339da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 -- 172.21.15.47:0/933985548 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55641632bff0 con 0x556415f4d1b0 2024-09-21T01:05:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.135+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x55641631ae60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000f890 tx=0x7fbbd000fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8946d3cced09528 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.136+0000 7fbbc37fe640 1 -- 172.21.15.47:0/933985548 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000f920 con 0x556415f4d1b0 2024-09-21T01:05:29.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.136+0000 7fbbc37fe640 1 -- 172.21.15.47:0/933985548 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbd000fac0 con 0x556415f4d1b0 2024-09-21T01:05:29.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.136+0000 7fbbc37fe640 1 -- 172.21.15.47:0/933985548 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0003830 con 0x556415f4d1b0 2024-09-21T01:05:29.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 -- 172.21.15.47:0/933985548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 msgr2=0x55641631ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x55641631ae60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000f890 tx=0x7fbbd000fea0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 -- 172.21.15.47:0/933985548 shutdown_connections 2024-09-21T01:05:29.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f55390 0x55641631b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x55641631ae60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/933985548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f349f0 0x556416339da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 -- 172.21.15.47:0/933985548 >> 172.21.15.47:0/933985548 conn(0x556415f6a460 msgr2=0x556416339690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 -- 172.21.15.47:0/933985548 shutdown_connections 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 -- 172.21.15.47:0/933985548 wait complete. 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 -- start start 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.137+0000 7fbbea2ab740 1 Processor -- start 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f349f0 0x556416335d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x556416331260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbea2ab740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 0x556416331900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc1abbb0 con 0x556415f4d1b0 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc1ad020 con 0x556415f55390 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbea2ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc1ac280 con 0x556415f349f0 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbea2ab740 10 client.0 _ll_register_callbacks cb 0x7fbbd0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:29.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f349f0 0x556416335d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe12d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x556416331260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f349f0 0x556416335d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:33018/0 (socket says 172.21.15.47:33018) 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 -- 172.21.15.47:0/309276444 learned_addr learned my addr 172.21.15.47:0/309276444 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 0x556416331900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 -- 172.21.15.47:0/309276444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 msgr2=0x556416331900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 0x556416331900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 -- 172.21.15.47:0/309276444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 msgr2=0x556416331260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x556416331260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe22d4640 1 -- 172.21.15.47:0/309276444 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556416332090 con 0x556415f349f0 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.138+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x556416331260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.139+0000 7fbbe22d4640 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f349f0 0x556416335d60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4005150 tx=0x7fbbd4047040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4050d9f676e92bad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.139+0000 7fbbc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.139+0000 7fbbc17fa640 1 -- 172.21.15.47:0/309276444 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4040040 con 0x556415f349f0 2024-09-21T01:05:29.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.139+0000 7fbbea2ab740 1 -- 172.21.15.47:0/309276444 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbd000fac0 con 0x556415f349f0 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.139+0000 7fbbc17fa640 1 -- 172.21.15.47:0/309276444 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fbbd40046c0 con 0x556415f349f0 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.139+0000 7fbbc17fa640 1 -- 172.21.15.47:0/309276444 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbbd4035040 con 0x556415f349f0 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.139+0000 7fbbea2ab740 10 client.25801 fetch_fsmap learned FSMap version 19 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.139+0000 7fbbea2ab740 1 -- 172.21.15.47:0/309276444 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5564163a9fb0 con 0x556415f349f0 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbc17fa640 1 -- 172.21.15.47:0/309276444 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbd000fac0 con 0x556415f349f0 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbc17fa640 1 -- 172.21.15.47:0/309276444 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fbbd4032160 con 0x556415f349f0 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbea2ab740 10 client.25801 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbea2ab740 10 client.25801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbea2ab740 20 client.25801 populate_metadata read hostname 'smithi047' 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556415f76070 0x5564163ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbea2ab740 4 client.25801 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbea2ab740 1 -- 172.21.15.47:0/309276444 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556416291850 con 0x556415f76070 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556415f76070 0x5564163ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.140+0000 7fbbc17fa640 10 client.25801 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:29.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbe12d2640 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556415f76070 0x5564163ac2a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acef0f1b51d82f07 server_cookie=d853108d097e5e24 in_seq=0 out_seq=0 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbc17fa640 1 -- 172.21.15.47:0/309276444 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2281 (crc 0 0 0) 0x556416291850 con 0x556415f76070 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbc17fa640 10 client.25801 handle_command_reply: tid=0 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 client.25801 shutdown 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 -- 172.21.15.47:0/309276444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f349f0 msgr2=0x556416335d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f349f0 0x556416335d60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4005150 tx=0x7fbbd4047040 comp rx=0 tx=0).stop 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 -- 172.21.15.47:0/309276444 shutdown_connections 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x556415f76070 0x5564163ac2a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556415f55390 0x556416331900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556415f4d1b0 0x556416331260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 --2- 172.21.15.47:0/309276444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556415f349f0 0x556416335d60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 -- 172.21.15.47:0/309276444 >> 172.21.15.47:0/309276444 conn(0x556415f6a460 msgr2=0x55641631e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbc17fa640 0 client.25801 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 -- 172.21.15.47:0/309276444 shutdown_connections 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.141+0000 7fbbea2ab740 1 -- 172.21.15.47:0/309276444 wait complete. 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbea2ab740 20 client.25801 trim_cache size 0 max 16384 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "scrub active (31 inodes in the stack)", 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "736e4c53-6a66-4fe2-8a04-61c577d889f1", 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:05:29.147 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:55.468495+0000", 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87": { 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:13.847440+0000", 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:05:29.148 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:05:29.149 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:05:29.150 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:05:29.151 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:05:29.152 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:05:29.152 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:05:29.152 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:05:29.152 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:05:29.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 -- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbc40b6510 msgr2=0x7fbbc40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbc40b6510 0x7fbbc40b8a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0aa060 tx=0x7fbbcc0ed530 comp rx=0 tx=0).stop 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 -- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc102a60 msgr2=0x7fbbdc19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc102a60 0x7fbbdc19a3e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00eb90 tx=0x7fbbcc00c6a0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 -- 172.21.15.47:0/1588901106 shutdown_connections 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fbbc40b6510 0x7fbbc40b8a20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbdc108cf0 0x7fbbdc19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbdc1083a0 0x7fbbdc19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.142+0000 7fbbe3d37640 1 --2- 172.21.15.47:0/1588901106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbdc102a60 0x7fbbdc19a3e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.143+0000 7fbbe3d37640 1 -- 172.21.15.47:0/1588901106 >> 172.21.15.47:0/1588901106 conn(0x7fbbdc079730 msgr2=0x7fbbdc06b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.143+0000 7fbbe3d37640 1 -- 172.21.15.47:0/1588901106 shutdown_connections 2024-09-21T01:05:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:05:29.143+0000 7fbbe3d37640 1 -- 172.21.15.47:0/1588901106 wait complete. 2024-09-21T01:05:29.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:29 smithi134 ceph-mon[34785]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 35 MiB/s wr, 5.03k op/s 2024-09-21T01:05:29.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:29 smithi114 ceph-mon[34309]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 35 MiB/s wr, 5.03k op/s 2024-09-21T01:05:29.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:29 smithi047 ceph-mon[30960]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 35 MiB/s wr, 5.03k op/s 2024-09-21T01:05:30.055 INFO:tasks.cephfs.filesystem:scrub status for tag:736e4c53-6a66-4fe2-8a04-61c577d889f1 - {'path': '/', 'tag': '736e4c53-6a66-4fe2-8a04-61c577d889f1', 'options': 'recursive,force'} 2024-09-21T01:05:31.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:31 smithi114 ceph-mon[34309]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 4.49k op/s 2024-09-21T01:05:31.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:31 smithi047 ceph-mon[30960]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 4.49k op/s 2024-09-21T01:05:31.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:31 smithi134 ceph-mon[34785]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 4.49k op/s 2024-09-21T01:05:33.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:33 smithi114 ceph-mon[34309]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 32 MiB/s wr, 4.58k op/s 2024-09-21T01:05:33.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:33 smithi047 ceph-mon[30960]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 32 MiB/s wr, 4.58k op/s 2024-09-21T01:05:33.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:33 smithi134 ceph-mon[34785]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 32 MiB/s wr, 4.58k op/s 2024-09-21T01:05:35.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:35 smithi114 ceph-mon[34309]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 36 MiB/s wr, 5.32k op/s 2024-09-21T01:05:35.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:35 smithi047 ceph-mon[30960]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 36 MiB/s wr, 5.32k op/s 2024-09-21T01:05:35.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:35 smithi134 ceph-mon[34785]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 36 MiB/s wr, 5.32k op/s 2024-09-21T01:05:37.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:37 smithi114 ceph-mon[34309]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 4.35k op/s 2024-09-21T01:05:37.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:37 smithi047 ceph-mon[30960]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 4.35k op/s 2024-09-21T01:05:37.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:37 smithi134 ceph-mon[34785]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 30 MiB/s wr, 4.35k op/s 2024-09-21T01:05:39.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:39 smithi114 ceph-mon[34309]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 35 MiB/s wr, 5.08k op/s 2024-09-21T01:05:39.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:39 smithi047 ceph-mon[30960]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 35 MiB/s wr, 5.08k op/s 2024-09-21T01:05:39.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:39 smithi134 ceph-mon[34785]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 35 MiB/s wr, 5.08k op/s 2024-09-21T01:05:41.396 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:41 smithi134 ceph-mon[34785]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 4.41k op/s 2024-09-21T01:05:41.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:41 smithi114 ceph-mon[34309]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 4.41k op/s 2024-09-21T01:05:41.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:41 smithi047 ceph-mon[30960]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 4.41k op/s 2024-09-21T01:05:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa805ffb640 1 -- 172.21.15.47:0/1922612171 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5605679b30f0 con 0x56056769b1b0 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa805ffb640 10 client.25775 handle_command_reply: tid=0 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 client.25775 shutdown 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 -- 172.21.15.47:0/1922612171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 msgr2=0x560567a563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a563a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c760 tx=0x7fa80c0e7910 comp rx=0 tx=0).stop 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 -- 172.21.15.47:0/1922612171 shutdown_connections 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x56056769b1b0 0x560567acaa30 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56056767a4d0 0x560567a56f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605676722f0 0x560567a563a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa805ffb640 0 client.25775 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 --2- 172.21.15.47:0/1922612171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560567659d80 0x560567a55ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 -- 172.21.15.47:0/1922612171 >> 172.21.15.47:0/1922612171 conn(0x56056768f300 msgr2=0x560567a47a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 -- 172.21.15.47:0/1922612171 shutdown_connections 2024-09-21T01:05:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 1 -- 172.21.15.47:0/1922612171 wait complete. 2024-09-21T01:05:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.713+0000 7fa82b443740 20 client.25775 trim_cache size 0 max 16384 2024-09-21T01:05:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:05:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:05:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:05:41.716 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:05:41.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 -- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8080b6510 msgr2=0x7fa8080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:41.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8080b6510 0x7fa8080b8a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa814009fd0 tx=0x7fa814009500 comp rx=0 tx=0).stop 2024-09-21T01:05:41.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 -- 172.21.15.47:0/1147814792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c1054f0 msgr2=0x7fa81c19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:41.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c1054f0 0x7fa81c19a3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00ea60 tx=0x7fa80c00ef20 comp rx=0 tx=0).stop 2024-09-21T01:05:41.717 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 -- 172.21.15.47:0/1147814792 shutdown_connections 2024-09-21T01:05:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa8080b6510 0x7fa8080b8a20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa81c108110 0x7fa81c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa81c1054f0 0x7fa81c19a3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 --2- 172.21.15.47:0/1147814792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa81c102a30 0x7fa81c199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 -- 172.21.15.47:0/1147814792 >> 172.21.15.47:0/1147814792 conn(0x7fa81c0fd4c0 msgr2=0x7fa81c1038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 -- 172.21.15.47:0/1147814792 shutdown_connections 2024-09-21T01:05:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:41.714+0000 7fa82319d640 1 -- 172.21.15.47:0/1147814792 wait complete. 2024-09-21T01:05:42.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:42 smithi114 ceph-mon[34309]: scrub summary: idle+waiting paths [/] 2024-09-21T01:05:42.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:42 smithi047 ceph-mon[30960]: scrub summary: idle+waiting paths [/] 2024-09-21T01:05:42.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:42 smithi134 ceph-mon[34785]: scrub summary: idle+waiting paths [/] 2024-09-21T01:05:43.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:43 smithi114 ceph-mon[34309]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 4.68k op/s 2024-09-21T01:05:43.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:43 smithi047 ceph-mon[30960]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 4.68k op/s 2024-09-21T01:05:43.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:43 smithi134 ceph-mon[34785]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 4.68k op/s 2024-09-21T01:05:45.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:45 smithi114 ceph-mon[34309]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 37 MiB/s wr, 5.30k op/s 2024-09-21T01:05:45.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:45 smithi047 ceph-mon[30960]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 37 MiB/s wr, 5.30k op/s 2024-09-21T01:05:45.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:45 smithi134 ceph-mon[34785]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 37 MiB/s wr, 5.30k op/s 2024-09-21T01:05:47.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:47 smithi114 ceph-mon[34309]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 4.31k op/s 2024-09-21T01:05:47.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:47 smithi047 ceph-mon[30960]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 4.31k op/s 2024-09-21T01:05:47.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:47 smithi134 ceph-mon[34785]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 4.31k op/s 2024-09-21T01:05:49.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:49 smithi114 ceph-mon[34309]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 4.96k op/s 2024-09-21T01:05:49.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:49 smithi047 ceph-mon[30960]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 4.96k op/s 2024-09-21T01:05:49.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:49 smithi134 ceph-mon[34785]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 4.96k op/s 2024-09-21T01:05:51.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:51 smithi114 ceph-mon[34309]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 31 MiB/s wr, 4.39k op/s 2024-09-21T01:05:51.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:51 smithi047 ceph-mon[30960]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 31 MiB/s wr, 4.39k op/s 2024-09-21T01:05:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:51 smithi134 ceph-mon[34785]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 31 MiB/s wr, 4.39k op/s 2024-09-21T01:05:53.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:53 smithi114 ceph-mon[34309]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 30 MiB/s wr, 4.31k op/s 2024-09-21T01:05:53.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:53 smithi047 ceph-mon[30960]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 30 MiB/s wr, 4.31k op/s 2024-09-21T01:05:53.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:53 smithi134 ceph-mon[34785]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 30 MiB/s wr, 4.31k op/s 2024-09-21T01:05:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 -- 172.21.15.47:0/448992642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc103770 msgr2=0x7ff2bc10a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.837 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 --2- 172.21.15.47:0/448992642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc103770 0x7ff2bc10a110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009ca0 tx=0x7ff2b402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 -- 172.21.15.47:0/448992642 shutdown_connections 2024-09-21T01:05:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 --2- 172.21.15.47:0/448992642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc103770 0x7ff2bc10a110 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 --2- 172.21.15.47:0/448992642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc102dd0 0x7ff2bc1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 --2- 172.21.15.47:0/448992642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc101d50 0x7ff2bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 -- 172.21.15.47:0/448992642 >> 172.21.15.47:0/448992642 conn(0x7ff2bc0fd690 msgr2=0x7ff2bc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 -- 172.21.15.47:0/448992642 shutdown_connections 2024-09-21T01:05:54.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.836+0000 7ff2c367e640 1 -- 172.21.15.47:0/448992642 wait complete. 2024-09-21T01:05:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.837+0000 7ff2c367e640 1 Processor -- start 2024-09-21T01:05:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.837+0000 7ff2c367e640 1 -- start start 2024-09-21T01:05:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c367e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc101d50 0x7ff2bc199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c367e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102dd0 0x7ff2bc19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c367e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc103770 0x7ff2bc19b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c367e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc10d0f0 con 0x7ff2bc101d50 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c367e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc10cf70 con 0x7ff2bc103770 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c367e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc10d270 con 0x7ff2bc102dd0 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc101d50 0x7ff2bc199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc101d50 0x7ff2bc199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50626/0 (socket says 172.21.15.47:50626) 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 -- 172.21.15.47:0/3028807862 learned_addr learned my addr 172.21.15.47:0/3028807862 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc103770 0x7ff2bc19b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102dd0 0x7ff2bc19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 -- 172.21.15.47:0/3028807862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102dd0 msgr2=0x7ff2bc19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102dd0 0x7ff2bc19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 -- 172.21.15.47:0/3028807862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc103770 msgr2=0x7ff2bc19b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc103770 0x7ff2bc19b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 -- 172.21.15.47:0/3028807862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc19b920 con 0x7ff2bc101d50 2024-09-21T01:05:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc103770 0x7ff2bc19b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2c141a640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc101d50 0x7ff2bc199ee0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800e9f0 tx=0x7ff2b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.838+0000 7ff2b27fc640 1 -- 172.21.15.47:0/3028807862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800cd80 con 0x7ff2bc101d50 2024-09-21T01:05:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.839+0000 7ff2c367e640 1 -- 172.21.15.47:0/3028807862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc19bc10 con 0x7ff2bc101d50 2024-09-21T01:05:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.839+0000 7ff2b27fc640 1 -- 172.21.15.47:0/3028807862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b80108e0 con 0x7ff2bc101d50 2024-09-21T01:05:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.839+0000 7ff2b27fc640 1 -- 172.21.15.47:0/3028807862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8018980 con 0x7ff2bc101d50 2024-09-21T01:05:54.842 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.839+0000 7ff2c367e640 1 -- 172.21.15.47:0/3028807862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc1a2300 con 0x7ff2bc101d50 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.841+0000 7ff2ca5ec740 1 Processor -- start 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2ca5ec740 1 -- start start 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2b27fc640 1 -- 172.21.15.47:0/3028807862 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff2b8018b20 con 0x7ff2bc101d50 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f99571b0 0x55b9f9d03260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f992e2f0 0x55b9f9d038d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d04420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b9f9c716f0 con 0x55b9f992e2f0 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55b9f9c60b20 con 0x55b9f99571b0 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b9f9c64930 con 0x55b9f99364d0 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c141a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f992e2f0 0x55b9f9d038d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c1c1b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f99571b0 0x55b9f9d03260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c0c19640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d04420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c1c1b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f99571b0 0x55b9f9d03260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:60400/0 (socket says 172.21.15.47:60400) 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/2430238854 learned_addr learned my addr 172.21.15.47:0/2430238854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/2430238854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 msgr2=0x55b9f9d04420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/2430238854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d04420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/2430238854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f992e2f0 msgr2=0x55b9f9d038d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/2430238854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f992e2f0 0x55b9f9d038d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/2430238854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9f9c26530 con 0x55b9f99571b0 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.842+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/2430238854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d04420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.843+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/2430238854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f99571b0 0x55b9f9d03260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4035000 tx=0x7ff2b402f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ebf7d18e05f5c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.843+0000 7ff2b27fc640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2a80b6510 0x7ff2a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.843+0000 7ff2a77fe640 1 -- 172.21.15.47:0/2430238854 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4031650 con 0x55b9f99571b0 2024-09-21T01:05:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.843+0000 7ff2a77fe640 1 -- 172.21.15.47:0/2430238854 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4036040 con 0x55b9f99571b0 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.843+0000 7ff2a77fe640 1 -- 172.21.15.47:0/2430238854 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4004610 con 0x55b9f99571b0 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.843+0000 7ff2c141a640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2a80b6510 0x7ff2a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.843+0000 7ff2b27fc640 1 -- 172.21.15.47:0/3028807862 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff2b80e7570 con 0x7ff2bc101d50 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2430238854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f99571b0 msgr2=0x55b9f9d03260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2430238854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f99571b0 0x55b9f9d03260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4035000 tx=0x7ff2b402f410 comp rx=0 tx=0).stop 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2c141a640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2a80b6510 0x7ff2a80b8a20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8000c00 tx=0x7ff2b80ed110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2430238854 shutdown_connections 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2430238854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d04420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2430238854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f992e2f0 0x55b9f9d038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2430238854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f99571b0 0x55b9f9d03260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2430238854 >> 172.21.15.47:0/2430238854 conn(0x55b9f994b300 msgr2=0x55b9f9cfa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2430238854 shutdown_connections 2024-09-21T01:05:54.847 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2430238854 wait complete. 2024-09-21T01:05:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 -- start start 2024-09-21T01:05:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.844+0000 7ff2ca5ec740 1 Processor -- start 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d0c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99571b0 0x55b9f9d0da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b9f9b98ab0 con 0x55b9f99571b0 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55b9f9c06730 con 0x55b9f992e2f0 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b9f9d04d60 con 0x55b9f99364d0 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c1c1b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d0c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c1c1b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d0c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:60406/0 (socket says 172.21.15.47:60406) 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/2265227463 learned_addr learned my addr 172.21.15.47:0/2265227463 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99571b0 0x55b9f9d0da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2ca5ec740 10 client.0 _ll_register_callbacks cb 0x55b9f9c5a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c0c19640 1 -- 172.21.15.47:0/2265227463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 msgr2=0x55b9f9d0c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d0c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c0c19640 1 -- 172.21.15.47:0/2265227463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99571b0 msgr2=0x55b9f9d0da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99571b0 0x55b9f9d0da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c0c19640 1 -- 172.21.15.47:0/2265227463 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9f99c2790 con 0x55b9f99364d0 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.845+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d0c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.846+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0cf10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e6b0 tx=0x7ff2ac00eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a6778be74b3b57c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.846+0000 7ff2a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.846+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/2265227463 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac01e060 con 0x55b9f99364d0 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.846+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/2265227463 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff2ac004260 con 0x55b9f99364d0 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.846+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2265227463 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b4036040 con 0x55b9f99364d0 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.846+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/2265227463 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff2ac004460 con 0x55b9f99364d0 2024-09-21T01:05:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.846+0000 7ff2ca5ec740 10 client.25813 fetch_fsmap learned FSMap version 19 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.846+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2265227463 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b9f9a3b620 con 0x55b9f99364d0 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/2265227463 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4036040 con 0x55b9f99364d0 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/2265227463 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff2ac023070 con 0x55b9f99364d0 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2ca5ec740 10 client.25813 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2ca5ec740 10 client.25813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2ca5ec740 20 client.25813 populate_metadata read hostname 'smithi047' 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55b9f9915d80 0x55b9f9d1a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2ca5ec740 4 client.25813 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2265227463 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9f9c73640 con 0x55b9f9915d80 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.847+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55b9f9915d80 0x55b9f9d1a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.848+0000 7ff2a4ff9640 10 client.25813 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.848+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55b9f9915d80 0x55b9f9d1a000 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a257c99fd9c220 server_cookie=b2bf29377d5c1515 in_seq=0 out_seq=0 2024-09-21T01:05:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/2265227463 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9f9c73640 con 0x55b9f9915d80 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2a4ff9640 10 client.25813 handle_command_reply: tid=0 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 client.25813 shutdown 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2265227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 msgr2=0x55b9f9d0cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0cf10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e6b0 tx=0x7ff2ac00eb70 comp rx=0 tx=0).stop 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2265227463 shutdown_connections 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55b9f9915d80 0x55b9f9d1a000 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99571b0 0x55b9f9d0da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0cf10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/2265227463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d0c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2265227463 >> 172.21.15.47:0/2265227463 conn(0x55b9f994b300 msgr2=0x55b9f9cf8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2a4ff9640 0 client.25813 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2265227463 shutdown_connections 2024-09-21T01:05:54.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/2265227463 wait complete. 2024-09-21T01:05:54.856 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.849+0000 7ff2ca5ec740 20 client.25813 trim_cache size 0 max 16384 2024-09-21T01:05:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2ca5ec740 1 Processor -- start 2024-09-21T01:05:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2ca5ec740 1 -- start start 2024-09-21T01:05:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f994b300 0x55b9f9cfa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d07a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1a6c30 con 0x55b9f994b300 2024-09-21T01:05:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1a9490 con 0x55b9f992e2f0 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1a7280 con 0x55b9f99364d0 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2c1c1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f994b300 0x55b9f9cfa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.868+0000 7ff2c1c1b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f994b300 0x55b9f9cfa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50638/0 (socket says 172.21.15.47:50638) 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/1007383489 learned_addr learned my addr 172.21.15.47:0/1007383489 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d07a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/1007383489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 msgr2=0x55b9f9d0ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/1007383489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 msgr2=0x55b9f9d07a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d07a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c1c1b640 1 -- 172.21.15.47:0/1007383489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9f9d0aa60 con 0x55b9f994b300 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f994b300 0x55b9f9cfa220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4033040 tx=0x7ff2b402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7652c81e1056f449 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2a6ffd640 1 -- 172.21.15.47:0/1007383489 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4060070 con 0x55b9f994b300 2024-09-21T01:05:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2a6ffd640 1 -- 172.21.15.47:0/1007383489 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4036050 con 0x55b9f994b300 2024-09-21T01:05:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.869+0000 7ff2a6ffd640 1 -- 172.21.15.47:0/1007383489 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b402f880 con 0x55b9f994b300 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/1007383489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f994b300 msgr2=0x55b9f9cfa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f994b300 0x55b9f9cfa220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4033040 tx=0x7ff2b402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/1007383489 shutdown_connections 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f99364d0 0x55b9f9d0ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d07a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/1007383489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f994b300 0x55b9f9cfa220 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/1007383489 >> 172.21.15.47:0/1007383489 conn(0x55b9f9d045d0 msgr2=0x55b9f9d07370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/1007383489 shutdown_connections 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.870+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/1007383489 wait complete. 2024-09-21T01:05:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 1 -- start start 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 1 Processor -- start 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d14380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99364d0 0x55b9f9d13040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f994b300 0x55b9f9d13580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1a7950 con 0x55b9f99364d0 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1a8dc0 con 0x55b9f992e2f0 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1a8020 con 0x55b9f994b300 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2ca5ec740 10 client.0 _ll_register_callbacks cb 0x7ff2ac00aea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2c0c19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99364d0 0x55b9f9d13040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2c0c19640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99364d0 0x55b9f9d13040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50648/0 (socket says 172.21.15.47:50648) 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2c0c19640 1 -- 172.21.15.47:0/4202480598 learned_addr learned my addr 172.21.15.47:0/4202480598 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f994b300 0x55b9f9d13580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.871+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d14380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2c0c19640 1 -- 172.21.15.47:0/4202480598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f994b300 msgr2=0x55b9f9d13580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f994b300 0x55b9f9d13580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2c0c19640 1 -- 172.21.15.47:0/4202480598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 msgr2=0x55b9f9d14380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d14380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2c0c19640 1 -- 172.21.15.47:0/4202480598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9f9d13c20 con 0x55b9f99364d0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2c0c19640 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99364d0 0x55b9f9d13040 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac005fd0 tx=0x7ff2ac003ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579dbb8b0a91b7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/4202480598 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac029040 con 0x55b9f99364d0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/4202480598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b4036050 con 0x55b9f99364d0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/4202480598 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff2ac00d7b0 con 0x55b9f99364d0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/4202480598 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff2ac01e020 con 0x55b9f99364d0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2ca5ec740 10 client.16137 fetch_fsmap learned FSMap version 19 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.872+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/4202480598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b9f9d849c0 con 0x55b9f99364d0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/4202480598 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4036050 con 0x55b9f99364d0 2024-09-21T01:05:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/4202480598 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff2ac023040 con 0x55b9f99364d0 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2ca5ec740 10 client.16137 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2ca5ec740 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2ca5ec740 20 client.16137 populate_metadata read hostname 'smithi047' 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55b9f99571b0 0x55b9f9d87290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2ca5ec740 4 client.16137 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/4202480598 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9f9d14d20 con 0x55b9f99571b0 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55b9f99571b0 0x55b9f9d87290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2a4ff9640 10 client.16137 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:05:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:05:54.873+0000 7ff2c1c1b640 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55b9f99571b0 0x55b9f9d87290 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca2434d4f598285 server_cookie=84564b05e957d360 in_seq=0 out_seq=0 2024-09-21T01:05:55.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:55 smithi114 ceph-mon[34309]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 35 MiB/s wr, 4.98k op/s 2024-09-21T01:05:55.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:55 smithi047 ceph-mon[30960]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 35 MiB/s wr, 4.98k op/s 2024-09-21T01:05:55.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:55 smithi134 ceph-mon[34785]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 35 MiB/s wr, 4.98k op/s 2024-09-21T01:05:57.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:57 smithi114 ceph-mon[34309]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 29 MiB/s wr, 4.18k op/s 2024-09-21T01:05:57.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:57 smithi047 ceph-mon[30960]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 29 MiB/s wr, 4.18k op/s 2024-09-21T01:05:57.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:57 smithi134 ceph-mon[34785]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 29 MiB/s wr, 4.18k op/s 2024-09-21T01:05:59.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:05:59 smithi114 ceph-mon[34309]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 36 MiB/s wr, 5.11k op/s 2024-09-21T01:05:59.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:05:59 smithi047 ceph-mon[30960]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 36 MiB/s wr, 5.11k op/s 2024-09-21T01:05:59.599 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:05:59 smithi134 ceph-mon[34785]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 36 MiB/s wr, 5.11k op/s 2024-09-21T01:06:00.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:06:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:00.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:00.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:00.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.874+0000 7ff3336ed640 1 -- 172.21.15.47:0/681850898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 msgr2=0x7ff32c1034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.874+0000 7ff3336ed640 1 --2- 172.21.15.47:0/681850898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 0x7ff32c1034c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff328009900 tx=0x7ff32802a410 comp rx=0 tx=0).stop 2024-09-21T01:06:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.874+0000 7ff3336ed640 1 -- 172.21.15.47:0/681850898 shutdown_connections 2024-09-21T01:06:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.874+0000 7ff3336ed640 1 --2- 172.21.15.47:0/681850898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c105af0 0x7ff32c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.874+0000 7ff3336ed640 1 --2- 172.21.15.47:0/681850898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff32c1051a0 0x7ff32c1055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.874+0000 7ff3336ed640 1 --2- 172.21.15.47:0/681850898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 0x7ff32c1034c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.874+0000 7ff3336ed640 1 -- 172.21.15.47:0/681850898 >> 172.21.15.47:0/681850898 conn(0x7ff32c077ca0 msgr2=0x7ff32c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.875+0000 7ff3336ed640 1 -- 172.21.15.47:0/681850898 shutdown_connections 2024-09-21T01:06:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.875+0000 7ff3336ed640 1 -- 172.21.15.47:0/681850898 wait complete. 2024-09-21T01:06:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.875+0000 7ff3336ed640 1 Processor -- start 2024-09-21T01:06:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.875+0000 7ff3336ed640 1 -- start start 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff3336ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 0x7ff32c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff3336ed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c1051a0 0x7ff32c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff3336ed640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff32c105af0 0x7ff32c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff3336ed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c113ab0 con 0x7ff32c1030b0 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff3336ed640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c113930 con 0x7ff32c105af0 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff3336ed640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c113c30 con 0x7ff32c1051a0 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff330c88640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c1051a0 0x7ff32c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff330c88640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c1051a0 0x7ff32c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:53280/0 (socket says 172.21.15.47:53280) 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff331489640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 0x7ff32c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff331c8a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff32c105af0 0x7ff32c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff331489640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 0x7ff32c19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50668/0 (socket says 172.21.15.47:50668) 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff331c8a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff32c105af0 0x7ff32c19fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:60462/0 (socket says 172.21.15.47:60462) 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.876+0000 7ff331489640 1 -- 172.21.15.47:0/3542045681 learned_addr learned my addr 172.21.15.47:0/3542045681 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:00.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff330c88640 1 -- 172.21.15.47:0/3542045681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff32c105af0 msgr2=0x7ff32c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff330c88640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff32c105af0 0x7ff32c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff330c88640 1 -- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 msgr2=0x7ff32c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff330c88640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 0x7ff32c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff330c88640 1 -- 172.21.15.47:0/3542045681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c1a03b0 con 0x7ff32c1051a0 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff331c8a640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff32c105af0 0x7ff32c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff330c88640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c1051a0 0x7ff32c19a9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00e9c0 tx=0x7ff31c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff3227fc640 1 -- 172.21.15.47:0/3542045681 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c00ccc0 con 0x7ff32c1051a0 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff3336ed640 1 -- 172.21.15.47:0/3542045681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c1a06a0 con 0x7ff32c1051a0 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff3227fc640 1 -- 172.21.15.47:0/3542045681 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff31c0108e0 con 0x7ff32c1051a0 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff3227fc640 1 -- 172.21.15.47:0/3542045681 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0187a0 con 0x7ff32c1051a0 2024-09-21T01:06:00.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.877+0000 7ff3336ed640 1 -- 172.21.15.47:0/3542045681 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c1a6e00 con 0x7ff32c1051a0 2024-09-21T01:06:00.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.880+0000 7ff339c61740 1 Processor -- start 2024-09-21T01:06:00.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff339c61740 1 -- start start 2024-09-21T01:06:00.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff339c61740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc04d070 0x55d3fc3f4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff339c61740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff339c61740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc3f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff339c61740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d3fc36ae50 con 0x55d3fc04d070 2024-09-21T01:06:00.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff339c61740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55d3fc35a280 con 0x55d3fc02c390 2024-09-21T01:06:00.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff339c61740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d3fc35e090 con 0x55d3fc0241b0 2024-09-21T01:06:00.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff3227fc640 1 -- 172.21.15.47:0/3542045681 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff31c010430 con 0x7ff32c1051a0 2024-09-21T01:06:00.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff331c8a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc04d070 0x55d3fc3f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff331489640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff330c88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc3f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff331489640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:53294/0 (socket says 172.21.15.47:53294) 2024-09-21T01:06:00.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff331489640 1 -- 172.21.15.47:0/1819643678 learned_addr learned my addr 172.21.15.47:0/1819643678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:00.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.881+0000 7ff331c8a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc04d070 0x55d3fc3f4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50678/0 (socket says 172.21.15.47:50678) 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.882+0000 7ff331c8a640 1 -- 172.21.15.47:0/1819643678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 msgr2=0x55d3fc3f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.882+0000 7ff331c8a640 1 --2- 172.21.15.47:0/1819643678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.882+0000 7ff331c8a640 1 -- 172.21.15.47:0/1819643678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 msgr2=0x55d3fc3f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.882+0000 7ff331c8a640 1 --2- 172.21.15.47:0/1819643678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc3f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.882+0000 7ff331c8a640 1 -- 172.21.15.47:0/1819643678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fc0b8650 con 0x55d3fc04d070 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.882+0000 7ff331c8a640 1 --2- 172.21.15.47:0/1819643678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc04d070 0x55d3fc3f4270 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff324005fd0 tx=0x7ff324011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39fb2ee24bd4ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.882+0000 7ff3177fe640 1 -- 172.21.15.47:0/1819643678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324004d20 con 0x55d3fc04d070 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.883+0000 7ff3177fe640 1 -- 172.21.15.47:0/1819643678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff32400f9a0 con 0x55d3fc04d070 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.883+0000 7ff3177fe640 1 -- 172.21.15.47:0/1819643678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3240043d0 con 0x55d3fc04d070 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.883+0000 7ff3227fc640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff3180b6510 0x7ff3180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.883+0000 7ff3227fc640 1 -- 172.21.15.47:0/3542045681 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff31c0e7560 con 0x7ff32c1051a0 2024-09-21T01:06:00.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.883+0000 7ff331489640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff3180b6510 0x7ff3180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.883+0000 7ff339c61740 1 -- 172.21.15.47:0/1819643678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc04d070 msgr2=0x55d3fc3f4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.883+0000 7ff339c61740 1 --2- 172.21.15.47:0/1819643678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc04d070 0x55d3fc3f4270 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff324005fd0 tx=0x7ff324011bf0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 -- 172.21.15.47:0/1819643678 shutdown_connections 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 --2- 172.21.15.47:0/1819643678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc3f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 --2- 172.21.15.47:0/1819643678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 --2- 172.21.15.47:0/1819643678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc04d070 0x55d3fc3f4270 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 -- 172.21.15.47:0/1819643678 >> 172.21.15.47:0/1819643678 conn(0x55d3fc041460 msgr2=0x55d3fc3f2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff331489640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff3180b6510 0x7ff3180b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff3280096c0 tx=0x7ff3280058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 -- 172.21.15.47:0/1819643678 shutdown_connections 2024-09-21T01:06:00.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 -- 172.21.15.47:0/1819643678 wait complete. 2024-09-21T01:06:00.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 -- start start 2024-09-21T01:06:00.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.884+0000 7ff339c61740 1 Processor -- start 2024-09-21T01:06:00.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff339c61740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3fb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff339c61740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc3fbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff339c61740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc04d070 0x55d3fc3fc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff339c61740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d3fc1bb700 con 0x55d3fc02c390 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff339c61740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55d3fc2f5110 con 0x55d3fc04d070 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff339c61740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d3fc40b1e0 con 0x55d3fc0241b0 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff331489640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3fb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff339c61740 10 client.0 _ll_register_callbacks cb 0x55d3fc30e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff331489640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3fb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:53304/0 (socket says 172.21.15.47:53304) 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff331489640 1 -- 172.21.15.47:0/2708546960 learned_addr learned my addr 172.21.15.47:0/2708546960 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff330c88640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc3fbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.885+0000 7ff331c8a640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc04d070 0x55d3fc3fc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff331489640 1 -- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc04d070 msgr2=0x55d3fc3fc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff331489640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc04d070 0x55d3fc3fc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff331489640 1 -- 172.21.15.47:0/2708546960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 msgr2=0x55d3fc3fbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:00.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff331489640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc3fbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff331489640 1 -- 172.21.15.47:0/2708546960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3fc322c40 con 0x55d3fc0241b0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff330c88640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc3fbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff331c8a640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc04d070 0x55d3fc3fc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff331489640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3fb8e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff328009230 tx=0x7ff328009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5ca1fa79aa3384a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff314ff9640 1 -- 172.21.15.47:0/2708546960 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32804d030 con 0x55d3fc0241b0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff314ff9640 1 -- 172.21.15.47:0/2708546960 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff3280043d0 con 0x55d3fc0241b0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.886+0000 7ff339c61740 1 -- 172.21.15.47:0/2708546960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff32400f9a0 con 0x55d3fc0241b0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff314ff9640 1 -- 172.21.15.47:0/2708546960 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff328035040 con 0x55d3fc0241b0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff339c61740 10 client.25831 fetch_fsmap learned FSMap version 19 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff339c61740 1 -- 172.21.15.47:0/2708546960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d3fc416e50 con 0x55d3fc0241b0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff314ff9640 1 -- 172.21.15.47:0/2708546960 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff32400f9a0 con 0x55d3fc0241b0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff314ff9640 1 -- 172.21.15.47:0/2708546960 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff32803d650 con 0x55d3fc0241b0 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff339c61740 10 client.25831 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:06:00.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff339c61740 10 client.25831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:06:00.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff339c61740 20 client.25831 populate_metadata read hostname 'smithi047' 2024-09-21T01:06:00.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff339c61740 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d3fc00b9f0 0x55d3fc41a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff339c61740 4 client.25831 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:06:00.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.887+0000 7ff339c61740 1 -- 172.21.15.47:0/2708546960 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3fc36cda0 con 0x55d3fc00b9f0 2024-09-21T01:06:00.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.888+0000 7ff330c88640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d3fc00b9f0 0x55d3fc41a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.888+0000 7ff314ff9640 10 client.25831 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:00.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.888+0000 7ff330c88640 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d3fc00b9f0 0x55d3fc41a390 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=208bed2f82d282ea server_cookie=695ddb0d7c3aeeba in_seq=0 out_seq=0 2024-09-21T01:06:00.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff314ff9640 1 -- 172.21.15.47:0/2708546960 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3fc36cda0 con 0x55d3fc00b9f0 2024-09-21T01:06:00.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff314ff9640 10 client.25831 handle_command_reply: tid=0 2024-09-21T01:06:00.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 client.25831 shutdown 2024-09-21T01:06:00.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 -- 172.21.15.47:0/2708546960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 msgr2=0x55d3fc3fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3fb8e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff328009230 tx=0x7ff328009260 comp rx=0 tx=0).stop 2024-09-21T01:06:00.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 -- 172.21.15.47:0/2708546960 shutdown_connections 2024-09-21T01:06:00.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d3fc00b9f0 0x55d3fc41a390 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc04d070 0x55d3fc3fc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff314ff9640 0 client.25831 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:00.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc3fbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 --2- 172.21.15.47:0/2708546960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3fb8e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 -- 172.21.15.47:0/2708546960 >> 172.21.15.47:0/2708546960 conn(0x55d3fc041460 msgr2=0x55d3fc3f0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:00.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.889+0000 7ff339c61740 1 -- 172.21.15.47:0/2708546960 shutdown_connections 2024-09-21T01:06:00.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.890+0000 7ff339c61740 1 -- 172.21.15.47:0/2708546960 wait complete. 2024-09-21T01:06:00.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.890+0000 7ff339c61740 20 client.25831 trim_cache size 0 max 16384 2024-09-21T01:06:00.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.908+0000 7ff339c61740 1 Processor -- start 2024-09-21T01:06:00.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.908+0000 7ff339c61740 1 -- start start 2024-09-21T01:06:00.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.908+0000 7ff339c61740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc00b9f0 0x55d3fc3f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.908+0000 7ff339c61740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.908+0000 7ff339c61740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc41fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.908+0000 7ff339c61740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ab070 con 0x55d3fc00b9f0 2024-09-21T01:06:00.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.908+0000 7ff339c61740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ad8d0 con 0x55d3fc02c390 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.908+0000 7ff339c61740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ab6c0 con 0x55d3fc0241b0 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331489640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc00b9f0 0x55d3fc3f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331489640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc00b9f0 0x55d3fc3f8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50698/0 (socket says 172.21.15.47:50698) 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331489640 1 -- 172.21.15.47:0/3989049334 learned_addr learned my addr 172.21.15.47:0/3989049334 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331c8a640 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc41fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff330c88640 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331c8a640 1 -- 172.21.15.47:0/3989049334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 msgr2=0x55d3fc3f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331c8a640 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331c8a640 1 -- 172.21.15.47:0/3989049334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc00b9f0 msgr2=0x55d3fc3f8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331c8a640 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc00b9f0 0x55d3fc3f8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331c8a640 1 -- 172.21.15.47:0/3989049334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3fc4091d0 con 0x55d3fc02c390 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331489640 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc00b9f0 0x55d3fc3f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:00.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.909+0000 7ff331c8a640 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc41fb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55d3fc3fe660 tx=0x7ff324009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15d1e1b1352969d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.910+0000 7ff316ffd640 1 -- 172.21.15.47:0/3989049334 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324029070 con 0x55d3fc02c390 2024-09-21T01:06:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.910+0000 7ff316ffd640 1 -- 172.21.15.47:0/3989049334 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff32401f040 con 0x55d3fc02c390 2024-09-21T01:06:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.910+0000 7ff316ffd640 1 -- 172.21.15.47:0/3989049334 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32401e040 con 0x55d3fc02c390 2024-09-21T01:06:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.910+0000 7ff339c61740 1 -- 172.21.15.47:0/3989049334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 msgr2=0x55d3fc41fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.910+0000 7ff339c61740 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc41fb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55d3fc3fe660 tx=0x7ff324009f20 comp rx=0 tx=0).stop 2024-09-21T01:06:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 -- 172.21.15.47:0/3989049334 shutdown_connections 2024-09-21T01:06:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc02c390 0x55d3fc41fb50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc3f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 --2- 172.21.15.47:0/3989049334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc00b9f0 0x55d3fc3f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 -- 172.21.15.47:0/3989049334 >> 172.21.15.47:0/3989049334 conn(0x55d3fc041460 msgr2=0x55d3fc3fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 -- 172.21.15.47:0/3989049334 shutdown_connections 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 -- 172.21.15.47:0/3989049334 wait complete. 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 -- start start 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.911+0000 7ff339c61740 1 Processor -- start 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff339c61740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc00b9f0 0x55d3fc410af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff339c61740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc40dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff339c61740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc40e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff339c61740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1abd90 con 0x55d3fc02c390 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff339c61740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ad200 con 0x55d3fc00b9f0 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff339c61740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ac460 con 0x55d3fc0241b0 2024-09-21T01:06:00.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff339c61740 10 client.0 _ll_register_callbacks cb 0x7ff328009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff331489640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc00b9f0 0x55d3fc410af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff330c88640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc40dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff331489640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc00b9f0 0x55d3fc410af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:60490/0 (socket says 172.21.15.47:60490) 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff331489640 1 -- 172.21.15.47:0/111148851 learned_addr learned my addr 172.21.15.47:0/111148851 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.912+0000 7ff331c8a640 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc40e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff330c88640 1 -- 172.21.15.47:0/111148851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc00b9f0 msgr2=0x55d3fc410af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff330c88640 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc00b9f0 0x55d3fc410af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff330c88640 1 -- 172.21.15.47:0/111148851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 msgr2=0x55d3fc40e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff330c88640 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc40e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff330c88640 1 -- 172.21.15.47:0/111148851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3fc40eb40 con 0x55d3fc0241b0 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff331489640 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc00b9f0 0x55d3fc410af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff330c88640 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc40dfc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0e5150 tx=0x7ff31c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b5054354050781b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:06:00.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff314ff9640 1 -- 172.21.15.47:0/111148851 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c010720 con 0x55d3fc0241b0 2024-09-21T01:06:00.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff314ff9640 1 -- 172.21.15.47:0/111148851 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff31c0acaa0 con 0x55d3fc0241b0 2024-09-21T01:06:00.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.913+0000 7ff339c61740 1 -- 172.21.15.47:0/111148851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff32401f040 con 0x55d3fc0241b0 2024-09-21T01:06:00.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff314ff9640 1 -- 172.21.15.47:0/111148851 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff31c0ad350 con 0x55d3fc0241b0 2024-09-21T01:06:00.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff339c61740 10 client.25837 fetch_fsmap learned FSMap version 19 2024-09-21T01:06:00.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff339c61740 1 -- 172.21.15.47:0/111148851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d3fc484b40 con 0x55d3fc0241b0 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff314ff9640 1 -- 172.21.15.47:0/111148851 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff32401f040 con 0x55d3fc0241b0 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff314ff9640 1 -- 172.21.15.47:0/111148851 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff31c0ac510 con 0x55d3fc0241b0 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff339c61740 10 client.25837 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff339c61740 10 client.25837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff339c61740 20 client.25837 populate_metadata read hostname 'smithi047' 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff339c61740 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d3fc04d070 0x55d3fc487230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff339c61740 4 client.25837 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.914+0000 7ff339c61740 1 -- 172.21.15.47:0/111148851 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d3fc368850 con 0x55d3fc04d070 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff331489640 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d3fc04d070 0x55d3fc487230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff314ff9640 10 client.25837 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff331489640 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d3fc04d070 0x55d3fc487230 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bfe851115ac32fe server_cookie=87cb0750257063f5 in_seq=0 out_seq=0 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff314ff9640 1 -- 172.21.15.47:0/111148851 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x55d3fc368850 con 0x55d3fc04d070 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff314ff9640 10 client.25837 handle_command_reply: tid=0 2024-09-21T01:06:00.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff339c61740 1 client.25837 shutdown 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff339c61740 1 -- 172.21.15.47:0/111148851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 msgr2=0x55d3fc40dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff339c61740 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc40dfc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0e5150 tx=0x7ff31c01f000 comp rx=0 tx=0).stop 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff339c61740 1 -- 172.21.15.47:0/111148851 shutdown_connections 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff339c61740 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55d3fc04d070 0x55d3fc487230 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff339c61740 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d3fc02c390 0x55d3fc40e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff339c61740 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3fc0241b0 0x55d3fc40dfc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.915+0000 7ff339c61740 1 --2- 172.21.15.47:0/111148851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d3fc00b9f0 0x55d3fc410af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.916+0000 7ff314ff9640 0 client.25837 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.916+0000 7ff339c61740 1 -- 172.21.15.47:0/111148851 >> 172.21.15.47:0/111148851 conn(0x55d3fc041460 msgr2=0x55d3fc3f52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.916+0000 7ff339c61740 1 -- 172.21.15.47:0/111148851 shutdown_connections 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.916+0000 7ff339c61740 1 -- 172.21.15.47:0/111148851 wait complete. 2024-09-21T01:06:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.916+0000 7ff339c61740 20 client.25837 trim_cache size 0 max 16384 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "736e4c53-6a66-4fe2-8a04-61c577d889f1", 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:06:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:55.468495+0000", 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87": { 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:13.847440+0000", 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:00.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:00.924 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:00.925 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:06:00.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:06:00.927 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:06:00.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 -- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff3180b6510 msgr2=0x7ff3180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff3180b6510 0x7ff3180b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff3280096c0 tx=0x7ff3280058d0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 -- 172.21.15.47:0/3542045681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c1051a0 msgr2=0x7ff32c19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:00.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c1051a0 0x7ff32c19a9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00e9c0 tx=0x7ff31c00ee80 comp rx=0 tx=0).stop 2024-09-21T01:06:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 -- 172.21.15.47:0/3542045681 shutdown_connections 2024-09-21T01:06:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff3180b6510 0x7ff3180b8a20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff32c105af0 0x7ff32c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff32c1051a0 0x7ff32c19a9e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 --2- 172.21.15.47:0/3542045681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32c1030b0 0x7ff32c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 -- 172.21.15.47:0/3542045681 >> 172.21.15.47:0/3542045681 conn(0x7ff32c077ca0 msgr2=0x7ff32c100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 -- 172.21.15.47:0/3542045681 shutdown_connections 2024-09-21T01:06:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:00.917+0000 7ff3336ed640 1 -- 172.21.15.47:0/3542045681 wait complete. 2024-09-21T01:06:01.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 29 MiB/s wr, 4.18k op/s 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi114 to 176.0M 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: Adjusting osd_memory_target on smithi047 to 177.0M 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: Unable to set osd_memory_target on smithi134 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: Unable to set osd_memory_target on smithi114 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: Unable to set osd_memory_target on smithi047 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:01.411 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:06:01.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 29 MiB/s wr, 4.18k op/s 2024-09-21T01:06:01.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi114 to 176.0M 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: Adjusting osd_memory_target on smithi047 to 177.0M 2024-09-21T01:06:01.457 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: Unable to set osd_memory_target on smithi134 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-21T01:06:01.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: Unable to set osd_memory_target on smithi114 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T01:06:01.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: Unable to set osd_memory_target on smithi047 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T01:06:01.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:01.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:01.458 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:06:01.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 29 MiB/s wr, 4.18k op/s 2024-09-21T01:06:01.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi114 to 176.0M 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: Adjusting osd_memory_target on smithi047 to 177.0M 2024-09-21T01:06:01.595 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: Unable to set osd_memory_target on smithi134 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-21T01:06:01.596 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: Unable to set osd_memory_target on smithi114 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T01:06:01.596 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: Unable to set osd_memory_target on smithi047 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T01:06:01.596 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:01.596 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:01.596 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:06:02.102 INFO:tasks.cephfs.filesystem:scrub status for tag:736e4c53-6a66-4fe2-8a04-61c577d889f1 - {'path': '/', 'tag': '736e4c53-6a66-4fe2-8a04-61c577d889f1', 'options': 'recursive,force'} 2024-09-21T01:06:02.424 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:02 smithi047 ceph-mon[30960]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 29 MiB/s wr, 4.23k op/s 2024-09-21T01:06:02.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:02 smithi134 ceph-mon[34785]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 29 MiB/s wr, 4.23k op/s 2024-09-21T01:06:02.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:02 smithi114 ceph-mon[34309]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 29 MiB/s wr, 4.23k op/s 2024-09-21T01:06:04.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:04 smithi134 ceph-mon[34785]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 33 MiB/s wr, 4.86k op/s 2024-09-21T01:06:04.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:04 smithi114 ceph-mon[34309]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 33 MiB/s wr, 4.86k op/s 2024-09-21T01:06:04.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:04 smithi047 ceph-mon[30960]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 33 MiB/s wr, 4.86k op/s 2024-09-21T01:06:06.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:06 smithi134 ceph-mon[34785]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 27 MiB/s wr, 3.81k op/s 2024-09-21T01:06:06.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:06 smithi114 ceph-mon[34309]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 27 MiB/s wr, 3.81k op/s 2024-09-21T01:06:06.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:06 smithi047 ceph-mon[30960]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 27 MiB/s wr, 3.81k op/s 2024-09-21T01:06:08.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:08 smithi134 ceph-mon[34785]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 35 MiB/s wr, 4.78k op/s 2024-09-21T01:06:08.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:08 smithi114 ceph-mon[34309]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 35 MiB/s wr, 4.78k op/s 2024-09-21T01:06:08.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:08 smithi047 ceph-mon[30960]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 35 MiB/s wr, 4.78k op/s 2024-09-21T01:06:10.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:10 smithi134 ceph-mon[34785]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 28 MiB/s wr, 3.79k op/s 2024-09-21T01:06:10.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:10 smithi114 ceph-mon[34309]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 28 MiB/s wr, 3.79k op/s 2024-09-21T01:06:10.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:10 smithi047 ceph-mon[30960]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 28 MiB/s wr, 3.79k op/s 2024-09-21T01:06:12.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:12 smithi134 ceph-mon[34785]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 33 MiB/s wr, 4.38k op/s 2024-09-21T01:06:12.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:12 smithi114 ceph-mon[34309]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 33 MiB/s wr, 4.38k op/s 2024-09-21T01:06:12.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:12 smithi047 ceph-mon[30960]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 33 MiB/s wr, 4.38k op/s 2024-09-21T01:06:14.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:14 smithi134 ceph-mon[34785]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 34 MiB/s wr, 4.67k op/s 2024-09-21T01:06:14.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:14 smithi114 ceph-mon[34309]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 34 MiB/s wr, 4.67k op/s 2024-09-21T01:06:14.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:14 smithi047 ceph-mon[30960]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 34 MiB/s wr, 4.67k op/s 2024-09-21T01:06:16.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:16 smithi134 ceph-mon[34785]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 30 MiB/s wr, 4.10k op/s 2024-09-21T01:06:16.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:16 smithi114 ceph-mon[34309]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 30 MiB/s wr, 4.10k op/s 2024-09-21T01:06:16.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:16 smithi047 ceph-mon[30960]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 30 MiB/s wr, 4.10k op/s 2024-09-21T01:06:18.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:18 smithi134 ceph-mon[34785]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 38 MiB/s wr, 5.23k op/s 2024-09-21T01:06:18.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:18 smithi114 ceph-mon[34309]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 38 MiB/s wr, 5.23k op/s 2024-09-21T01:06:18.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:18 smithi047 ceph-mon[30960]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 38 MiB/s wr, 5.23k op/s 2024-09-21T01:06:20.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:20 smithi134 ceph-mon[34785]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 28 MiB/s wr, 4.02k op/s 2024-09-21T01:06:20.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:20 smithi114 ceph-mon[34309]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 28 MiB/s wr, 4.02k op/s 2024-09-21T01:06:20.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:20 smithi047 ceph-mon[30960]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 28 MiB/s wr, 4.02k op/s 2024-09-21T01:06:22.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:22 smithi134 ceph-mon[34785]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 30 MiB/s wr, 4.29k op/s 2024-09-21T01:06:22.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:22 smithi114 ceph-mon[34309]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 30 MiB/s wr, 4.29k op/s 2024-09-21T01:06:22.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:22 smithi047 ceph-mon[30960]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 30 MiB/s wr, 4.29k op/s 2024-09-21T01:06:24.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:24 smithi134 ceph-mon[34785]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 27 MiB/s wr, 3.92k op/s 2024-09-21T01:06:24.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:24 smithi114 ceph-mon[34309]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 27 MiB/s wr, 3.92k op/s 2024-09-21T01:06:24.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:24 smithi047 ceph-mon[30960]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 27 MiB/s wr, 3.92k op/s 2024-09-21T01:06:26.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:26 smithi134 ceph-mon[34785]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 24 MiB/s wr, 3.42k op/s 2024-09-21T01:06:26.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:26 smithi114 ceph-mon[34309]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 24 MiB/s wr, 3.42k op/s 2024-09-21T01:06:26.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:26 smithi047 ceph-mon[30960]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 24 MiB/s wr, 3.42k op/s 2024-09-21T01:06:28.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:28 smithi134 ceph-mon[34785]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 3.98k op/s 2024-09-21T01:06:28.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:28 smithi114 ceph-mon[34309]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 3.98k op/s 2024-09-21T01:06:28.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:28 smithi047 ceph-mon[30960]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 28 MiB/s wr, 3.98k op/s 2024-09-21T01:06:30.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:30 smithi134 ceph-mon[34785]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 25 MiB/s wr, 3.63k op/s 2024-09-21T01:06:30.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:30 smithi114 ceph-mon[34309]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 25 MiB/s wr, 3.63k op/s 2024-09-21T01:06:30.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:30 smithi047 ceph-mon[30960]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 25 MiB/s wr, 3.63k op/s 2024-09-21T01:06:32.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:06:32.389 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.729+0000 7ff2a4ff9640 1 -- 172.21.15.47:0/4202480598 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9f9d14d20 con 0x55b9f99571b0 2024-09-21T01:06:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.729+0000 7ff2a4ff9640 10 client.16137 handle_command_reply: tid=0 2024-09-21T01:06:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 client.16137 shutdown 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/4202480598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99364d0 msgr2=0x55b9f9d13040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99364d0 0x55b9f9d13040 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac005fd0 tx=0x7ff2ac003ac0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/4202480598 shutdown_connections 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55b9f99571b0 0x55b9f9d87290 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b9f994b300 0x55b9f9d13580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9f99364d0 0x55b9f9d13040 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2a4ff9640 0 client.16137 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 --2- 172.21.15.47:0/4202480598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b9f992e2f0 0x55b9f9d14380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/4202480598 >> 172.21.15.47:0/4202480598 conn(0x55b9f9d045d0 msgr2=0x55b9f9d0ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/4202480598 shutdown_connections 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 1 -- 172.21.15.47:0/4202480598 wait complete. 2024-09-21T01:06:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.730+0000 7ff2ca5ec740 20 client.16137 trim_cache size 0 max 16384 2024-09-21T01:06:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:{ 2024-09-21T01:06:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "message": "", 2024-09-21T01:06:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout: "return_code": 0 2024-09-21T01:06:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stdout:} 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 -- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2a80b6510 msgr2=0x7ff2a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2a80b6510 0x7ff2a80b8a20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8000c00 tx=0x7ff2b80ed110 comp rx=0 tx=0).stop 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 -- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc101d50 msgr2=0x7ff2bc199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc101d50 0x7ff2bc199ee0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800e9f0 tx=0x7ff2b800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 -- 172.21.15.47:0/3028807862 shutdown_connections 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2a80b6510 0x7ff2a80b8a20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc103770 0x7ff2bc19b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2bc102dd0 0x7ff2bc19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 --2- 172.21.15.47:0/3028807862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2bc101d50 0x7ff2bc199ee0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 -- 172.21.15.47:0/3028807862 >> 172.21.15.47:0/3028807862 conn(0x7ff2bc0fd690 msgr2=0x7ff2bc1082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 -- 172.21.15.47:0/3028807862 shutdown_connections 2024-09-21T01:06:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:32.731+0000 7ff2c367e640 1 -- 172.21.15.47:0/3028807862 wait complete. 2024-09-21T01:06:32.772 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:32 smithi047 ceph-mon[30960]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 27 MiB/s wr, 3.98k op/s 2024-09-21T01:06:32.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:32 smithi134 ceph-mon[34785]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 27 MiB/s wr, 3.98k op/s 2024-09-21T01:06:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 -- 172.21.15.47:0/2982001738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee8102a80 msgr2=0x7f8ee8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 --2- 172.21.15.47:0/2982001738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee8102a80 0x7f8ee8102e90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009900 tx=0x7f8ed802a410 comp rx=0 tx=0).stop 2024-09-21T01:06:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 -- 172.21.15.47:0/2982001738 shutdown_connections 2024-09-21T01:06:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 --2- 172.21.15.47:0/2982001738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8108d10 0x7f8ee810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 --2- 172.21.15.47:0/2982001738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee81083c0 0x7f8ee81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 --2- 172.21.15.47:0/2982001738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee8102a80 0x7f8ee8102e90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 -- 172.21.15.47:0/2982001738 >> 172.21.15.47:0/2982001738 conn(0x7f8ee8079740 msgr2=0x7f8ee8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 -- 172.21.15.47:0/2982001738 shutdown_connections 2024-09-21T01:06:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.875+0000 7f8eee190640 1 -- 172.21.15.47:0/2982001738 wait complete. 2024-09-21T01:06:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.876+0000 7f8eee190640 1 Processor -- start 2024-09-21T01:06:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.876+0000 7f8eee190640 1 -- start start 2024-09-21T01:06:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8eee190640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8102a80 0x7f8ee819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8eee190640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee81083c0 0x7f8ee819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8eee190640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee8108d10 0x7f8ee819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8eee190640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8112980 con 0x7f8ee81083c0 2024-09-21T01:06:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8eee190640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8112800 con 0x7f8ee8102a80 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8eee190640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8112b00 con 0x7f8ee8108d10 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee81083c0 0x7f8ee819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee8108d10 0x7f8ee819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee81083c0 0x7f8ee819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39130/0 (socket says 172.21.15.47:39130) 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee8108d10 0x7f8ee819fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:48686/0 (socket says 172.21.15.47:48686) 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee6ffd640 1 -- 172.21.15.47:0/4258023033 learned_addr learned my addr 172.21.15.47:0/4258023033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8102a80 0x7f8ee819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee7fff640 1 -- 172.21.15.47:0/4258023033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8102a80 msgr2=0x7f8ee819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8102a80 0x7f8ee819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee7fff640 1 -- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee81083c0 msgr2=0x7f8ee819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee81083c0 0x7f8ee819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee7fff640 1 -- 172.21.15.47:0/4258023033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee81a0410 con 0x7f8ee8108d10 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee81083c0 0x7f8ee819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.877+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee8108d10 0x7f8ee819fce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009fd0 tx=0x7f8ee000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.878+0000 7f8ee4ff9640 1 -- 172.21.15.47:0/4258023033 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000ce20 con 0x7f8ee8108d10 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.878+0000 7f8eee190640 1 -- 172.21.15.47:0/4258023033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee81a0700 con 0x7f8ee8108d10 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.878+0000 7f8ee4ff9640 1 -- 172.21.15.47:0/4258023033 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ee0005020 con 0x7f8ee8108d10 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.878+0000 7f8eee190640 1 -- 172.21.15.47:0/4258023033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee81a6e60 con 0x7f8ee8108d10 2024-09-21T01:06:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.878+0000 7f8ee4ff9640 1 -- 172.21.15.47:0/4258023033 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0010690 con 0x7f8ee8108d10 2024-09-21T01:06:32.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.880+0000 7f8ef4704740 1 Processor -- start 2024-09-21T01:06:32.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.880+0000 7f8ee4ff9640 1 -- 172.21.15.47:0/4258023033 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8ee0010830 con 0x7f8ee8108d10 2024-09-21T01:06:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ef4704740 1 -- start start 2024-09-21T01:06:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee77ac070 0x562ee7b53650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77831b0 0x562ee7b53b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee778b390 0x562ee7b540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ef4704740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562ee7ac9e50 con 0x562ee77831b0 2024-09-21T01:06:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ef4704740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562ee7ab9280 con 0x562ee778b390 2024-09-21T01:06:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ef4704740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562ee7abd090 con 0x562ee77ac070 2024-09-21T01:06:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77831b0 0x562ee7b53b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77831b0 0x562ee7b53b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39144/0 (socket says 172.21.15.47:39144) 2024-09-21T01:06:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee77fe640 1 -- 172.21.15.47:0/2699631375 learned_addr learned my addr 172.21.15.47:0/2699631375 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee77ac070 0x562ee7b53650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee778b390 0x562ee7b540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee77fe640 1 -- 172.21.15.47:0/2699631375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee77ac070 msgr2=0x562ee7b53650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:32.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee77ac070 0x562ee7b53650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee77fe640 1 -- 172.21.15.47:0/2699631375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee778b390 msgr2=0x562ee7b540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:32.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee778b390 0x562ee7b540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee77fe640 1 -- 172.21.15.47:0/2699631375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee7817650 con 0x562ee77831b0 2024-09-21T01:06:32.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee778b390 0x562ee7b540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:06:32.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.881+0000 7f8ee4ff9640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8ed00b6510 0x7f8ed00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.882+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77831b0 0x562ee7b53b90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8033000 tx=0x7f8ed8032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c509b9bceee1d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:32.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.882+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8ed00b6510 0x7f8ed00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.882+0000 7f8ee4ff9640 1 -- 172.21.15.47:0/4258023033 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8ee00e7920 con 0x7f8ee8108d10 2024-09-21T01:06:32.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.882+0000 7f8ecdffb640 1 -- 172.21.15.47:0/2699631375 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8035040 con 0x562ee77831b0 2024-09-21T01:06:32.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.882+0000 7f8ecdffb640 1 -- 172.21.15.47:0/2699631375 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed8004030 con 0x562ee77831b0 2024-09-21T01:06:32.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.882+0000 7f8ecdffb640 1 -- 172.21.15.47:0/2699631375 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8005580 con 0x562ee77831b0 2024-09-21T01:06:32.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 -- 172.21.15.47:0/2699631375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77831b0 msgr2=0x562ee7b53b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77831b0 0x562ee7b53b90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8033000 tx=0x7f8ed8032b90 comp rx=0 tx=0).stop 2024-09-21T01:06:32.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8ed00b6510 0x7f8ed00b8a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009600 tx=0x7f8edc013040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:32.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 -- 172.21.15.47:0/2699631375 shutdown_connections 2024-09-21T01:06:32.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee778b390 0x562ee7b540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77831b0 0x562ee7b53b90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2699631375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee77ac070 0x562ee7b53650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 -- 172.21.15.47:0/2699631375 >> 172.21.15.47:0/2699631375 conn(0x562ee77a0460 msgr2=0x562ee7b51540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:32.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 -- 172.21.15.47:0/2699631375 shutdown_connections 2024-09-21T01:06:32.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 -- 172.21.15.47:0/2699631375 wait complete. 2024-09-21T01:06:32.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.883+0000 7f8ef4704740 1 -- start start 2024-09-21T01:06:32.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ef4704740 1 Processor -- start 2024-09-21T01:06:32.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b63050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b63590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77ac070 0x562ee7b63ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ef4704740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562ee791a700 con 0x562ee77ac070 2024-09-21T01:06:32.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ef4704740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x562ee7a54110 con 0x562ee77831b0 2024-09-21T01:06:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ef4704740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562ee7b66100 con 0x562ee778b390 2024-09-21T01:06:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ef4704740 10 client.0 _ll_register_callbacks cb 0x562ee7a6d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:06:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ee7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77ac070 0x562ee7b63ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ee7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77ac070 0x562ee7b63ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39160/0 (socket says 172.21.15.47:39160) 2024-09-21T01:06:32.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ee7fff640 1 -- 172.21.15.47:0/2965811576 learned_addr learned my addr 172.21.15.47:0/2965811576 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b63590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.884+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b63050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ee6ffd640 1 -- 172.21.15.47:0/2965811576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 msgr2=0x562ee7b63050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b63050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ee6ffd640 1 -- 172.21.15.47:0/2965811576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77ac070 msgr2=0x562ee7b63ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77ac070 0x562ee7b63ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ee6ffd640 1 -- 172.21.15.47:0/2965811576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee7a81c40 con 0x562ee778b390 2024-09-21T01:06:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77ac070 0x562ee7b63ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b63590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ee807a170 tx=0x7f8edc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb420fe60f3eab77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ec6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:06:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2965811576 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc020e60 con 0x562ee778b390 2024-09-21T01:06:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2965811576 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8edc01a070 con 0x562ee778b390 2024-09-21T01:06:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ef4704740 1 -- 172.21.15.47:0/2965811576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed8004030 con 0x562ee778b390 2024-09-21T01:06:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2965811576 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8edc004030 con 0x562ee778b390 2024-09-21T01:06:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ef4704740 10 client.25849 fetch_fsmap learned FSMap version 19 2024-09-21T01:06:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.885+0000 7f8ef4704740 1 -- 172.21.15.47:0/2965811576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562ee7b71e50 con 0x562ee778b390 2024-09-21T01:06:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2965811576 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed8004030 con 0x562ee778b390 2024-09-21T01:06:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2965811576 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8edc02c430 con 0x562ee778b390 2024-09-21T01:06:32.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ef4704740 10 client.25849 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:06:32.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ef4704740 10 client.25849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:06:32.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ef4704740 20 client.25849 populate_metadata read hostname 'smithi047' 2024-09-21T01:06:32.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ee776a9f0 0x562ee7b753d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ef4704740 4 client.25849 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:06:32.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ef4704740 1 -- 172.21.15.47:0/2965811576 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ee7acbda0 con 0x562ee776a9f0 2024-09-21T01:06:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ee776a9f0 0x562ee7b753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ee776a9f0 0x562ee7b753d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bcd977dbdf4a930 server_cookie=6aafc82eca415e9e in_seq=0 out_seq=0 2024-09-21T01:06:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.886+0000 7f8ec6ffd640 10 client.25849 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.887+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2965811576 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ee7acbda0 con 0x562ee776a9f0 2024-09-21T01:06:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.887+0000 7f8ec6ffd640 10 client.25849 handle_command_reply: tid=0 2024-09-21T01:06:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.887+0000 7f8ef4704740 1 client.25849 shutdown 2024-09-21T01:06:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.887+0000 7f8ef4704740 1 -- 172.21.15.47:0/2965811576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 msgr2=0x562ee7b63590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.887+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b63590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ee807a170 tx=0x7f8edc0046c0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 1 -- 172.21.15.47:0/2965811576 shutdown_connections 2024-09-21T01:06:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ee776a9f0 0x562ee7b753d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee77ac070 0x562ee7b63ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b63590 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ec6ffd640 0 client.25849 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2965811576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b63050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 1 -- 172.21.15.47:0/2965811576 >> 172.21.15.47:0/2965811576 conn(0x562ee77a0460 msgr2=0x562ee7b567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 1 -- 172.21.15.47:0/2965811576 shutdown_connections 2024-09-21T01:06:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 1 -- 172.21.15.47:0/2965811576 wait complete. 2024-09-21T01:06:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.888+0000 7f8ef4704740 20 client.25849 trim_cache size 0 max 16384 2024-09-21T01:06:32.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:32 smithi114 ceph-mon[34309]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 27 MiB/s wr, 3.98k op/s 2024-09-21T01:06:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.908+0000 7f8ef4704740 1 Processor -- start 2024-09-21T01:06:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.908+0000 7f8ef4704740 1 -- start start 2024-09-21T01:06:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b64f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b6f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b54d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ef4704740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee81ab0b0 con 0x562ee776a9f0 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ef4704740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee81ad910 con 0x562ee77831b0 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ef4704740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee81ab700 con 0x562ee778b390 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b64f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b64f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39172/0 (socket says 172.21.15.47:39172) 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b54d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee77fe640 1 -- 172.21.15.47:0/4170474733 learned_addr learned my addr 172.21.15.47:0/4170474733 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/4170474733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b6f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee7fff640 1 -- 172.21.15.47:0/4170474733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 msgr2=0x562ee7b6f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/4170474733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b6f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee7fff640 1 -- 172.21.15.47:0/4170474733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 msgr2=0x562ee7b64f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/4170474733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b64f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.909+0000 7f8ee7fff640 1 -- 172.21.15.47:0/4170474733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee7b56450 con 0x562ee778b390 2024-09-21T01:06:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.910+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/4170474733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b54d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00adae0 tx=0x7f8ee0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c77d5688cda95bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.910+0000 7f8ecd7fa640 1 -- 172.21.15.47:0/4170474733 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00b2070 con 0x562ee778b390 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.910+0000 7f8ecd7fa640 1 -- 172.21.15.47:0/4170474733 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ee00b2630 con 0x562ee778b390 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.910+0000 7f8ecd7fa640 1 -- 172.21.15.47:0/4170474733 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00b2210 con 0x562ee778b390 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 -- 172.21.15.47:0/4170474733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 msgr2=0x562ee7b54d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 --2- 172.21.15.47:0/4170474733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b54d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00adae0 tx=0x7f8ee0014000 comp rx=0 tx=0).stop 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 -- 172.21.15.47:0/4170474733 shutdown_connections 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 --2- 172.21.15.47:0/4170474733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b54d90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 --2- 172.21.15.47:0/4170474733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b6f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 --2- 172.21.15.47:0/4170474733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b64f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 -- 172.21.15.47:0/4170474733 >> 172.21.15.47:0/4170474733 conn(0x562ee77a0460 msgr2=0x562ee7b54680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 -- 172.21.15.47:0/4170474733 shutdown_connections 2024-09-21T01:06:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 -- 172.21.15.47:0/4170474733 wait complete. 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 -- start start 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.911+0000 7f8ef4704740 1 Processor -- start 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b6bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ef4704740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b67640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ef4704740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee81abdd0 con 0x562ee776a9f0 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ef4704740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee81ad240 con 0x562ee77831b0 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ef4704740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee81ac4a0 con 0x562ee778b390 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ef4704740 10 client.0 _ll_register_callbacks cb 0x7f8edc0115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b6bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b670c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:52498/0 (socket says 172.21.15.47:52498) 2024-09-21T01:06:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b6bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39186/0 (socket says 172.21.15.47:39186) 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee6ffd640 1 -- 172.21.15.47:0/2245136003 learned_addr learned my addr 172.21.15.47:0/2245136003 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b67640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee77fe640 1 -- 172.21.15.47:0/2245136003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 msgr2=0x562ee7b67640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b67640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee77fe640 1 -- 172.21.15.47:0/2245136003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 msgr2=0x562ee7b670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee77fe640 1 -- 172.21.15.47:0/2245136003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee7b67dd0 con 0x562ee776a9f0 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.912+0000 7f8ee7fff640 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b67640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ee77fe640 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b6bc10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x562ee7b71e20 tx=0x7f8ed8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527bb27b2417e3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ec6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2245136003 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8035040 con 0x562ee776a9f0 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ef4704740 1 -- 172.21.15.47:0/2245136003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ee00b2630 con 0x562ee776a9f0 2024-09-21T01:06:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2245136003 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f8ed80055e0 con 0x562ee776a9f0 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2245136003 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8ed80046c0 con 0x562ee776a9f0 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ef4704740 10 client.16173 fetch_fsmap learned FSMap version 19 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ef4704740 1 -- 172.21.15.47:0/2245136003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562ee7bdfd20 con 0x562ee776a9f0 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2245136003 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ee00b2630 con 0x562ee776a9f0 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2245136003 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8ed80324c0 con 0x562ee776a9f0 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ef4704740 10 client.16173 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ef4704740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.913+0000 7f8ef4704740 20 client.16173 populate_metadata read hostname 'smithi047' 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.914+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ee77ac070 0x562ee7be2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.914+0000 7f8ef4704740 4 client.16173 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.914+0000 7f8ef4704740 1 -- 172.21.15.47:0/2245136003 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562ee7ac7850 con 0x562ee77ac070 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.914+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ee77ac070 0x562ee7be2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.914+0000 7f8ec6ffd640 10 client.16173 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.914+0000 7f8ee6ffd640 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ee77ac070 0x562ee7be2090 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d2de3944ab9da8b server_cookie=63968277ce468b70 in_seq=0 out_seq=0 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ec6ffd640 1 -- 172.21.15.47:0/2245136003 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x562ee7ac7850 con 0x562ee77ac070 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ec6ffd640 10 client.16173 handle_command_reply: tid=0 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 client.16173 shutdown 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 -- 172.21.15.47:0/2245136003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 msgr2=0x562ee7b6bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b6bc10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x562ee7b71e20 tx=0x7f8ed8031400 comp rx=0 tx=0).stop 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 -- 172.21.15.47:0/2245136003 shutdown_connections 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x562ee77ac070 0x562ee7be2090 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562ee778b390 0x562ee7b67640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562ee77831b0 0x562ee7b670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 --2- 172.21.15.47:0/2245136003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562ee776a9f0 0x562ee7b6bc10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 -- 172.21.15.47:0/2245136003 >> 172.21.15.47:0/2245136003 conn(0x562ee77a0460 msgr2=0x562ee7b570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ec6ffd640 0 client.16173 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 -- 172.21.15.47:0/2245136003 shutdown_connections 2024-09-21T01:06:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 1 -- 172.21.15.47:0/2245136003 wait complete. 2024-09-21T01:06:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.915+0000 7f8ef4704740 20 client.16173 trim_cache size 0 max 16384 2024-09-21T01:06:32.924 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:06:32.924 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:06:32.924 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": { 2024-09-21T01:06:32.924 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:06:32.924 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:32.924 INFO:teuthology.orchestra.run.smithi047.stdout: "tag": "736e4c53-6a66-4fe2-8a04-61c577d889f1", 2024-09-21T01:06:32.924 INFO:teuthology.orchestra.run.smithi047.stdout: "options": "recursive,force" 2024-09-21T01:06:32.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:06:32.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:32.925 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:06:32.925 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:06:32.925 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:55.468495+0000", 2024-09-21T01:06:32.925 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:32.925 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:32.925 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:32.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:32.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:32.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:32.926 INFO:teuthology.orchestra.run.smithi047.stdout: "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87": { 2024-09-21T01:06:32.926 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:13.847440+0000", 2024-09-21T01:06:32.926 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:32.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:32.926 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:32.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:32.928 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:06:32.928 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:06:32.928 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:32.928 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:32.928 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:32.928 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:32.928 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:32.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:32.929 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:06:32.929 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:06:32.929 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:32.929 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:32.929 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:32.929 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:32.929 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:06:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:06:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:32.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:06:32.931 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:06:32.931 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:06:32.931 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:06:32.931 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:06:32.931 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:06:32.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:06:32.932 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:06:32.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:06:32.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:06:32.932 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:06:32.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 -- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8ed00b6510 msgr2=0x7f8ed00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8ed00b6510 0x7f8ed00b8a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009600 tx=0x7f8edc013040 comp rx=0 tx=0).stop 2024-09-21T01:06:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 -- 172.21.15.47:0/4258023033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee8108d10 msgr2=0x7f8ee819fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee8108d10 0x7f8ee819fce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009fd0 tx=0x7f8ee000ef10 comp rx=0 tx=0).stop 2024-09-21T01:06:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 -- 172.21.15.47:0/4258023033 shutdown_connections 2024-09-21T01:06:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f8ed00b6510 0x7f8ed00b8a20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ee8108d10 0x7f8ee819fce0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ee81083c0 0x7f8ee819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 --2- 172.21.15.47:0/4258023033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8102a80 0x7f8ee819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 -- 172.21.15.47:0/4258023033 >> 172.21.15.47:0/4258023033 conn(0x7f8ee8079740 msgr2=0x7f8ee806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 -- 172.21.15.47:0/4258023033 shutdown_connections 2024-09-21T01:06:32.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:06:32.916+0000 7f8eee190640 1 -- 172.21.15.47:0/4258023033 wait complete. 2024-09-21T01:06:33.868 INFO:tasks.cephfs.filesystem:scrub status for tag:736e4c53-6a66-4fe2-8a04-61c577d889f1 - {'path': '/', 'tag': '736e4c53-6a66-4fe2-8a04-61c577d889f1', 'options': 'recursive,force'} 2024-09-21T01:06:34.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:34 smithi047 ceph-mon[30960]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 MiB/s wr, 4.41k op/s 2024-09-21T01:06:34.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:34 smithi134 ceph-mon[34785]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 MiB/s wr, 4.41k op/s 2024-09-21T01:06:34.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:34 smithi114 ceph-mon[34309]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 27 MiB/s wr, 4.41k op/s 2024-09-21T01:06:36.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:36 smithi134 ceph-mon[34785]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 31 MiB/s wr, 5.04k op/s 2024-09-21T01:06:36.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:36 smithi114 ceph-mon[34309]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 31 MiB/s wr, 5.04k op/s 2024-09-21T01:06:36.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:36 smithi047 ceph-mon[30960]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 31 MiB/s wr, 5.04k op/s 2024-09-21T01:06:38.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:38 smithi134 ceph-mon[34785]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 34 MiB/s wr, 5.76k op/s 2024-09-21T01:06:38.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:38 smithi114 ceph-mon[34309]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 34 MiB/s wr, 5.76k op/s 2024-09-21T01:06:38.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:38 smithi047 ceph-mon[30960]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 34 MiB/s wr, 5.76k op/s 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout:Syncing()...8 sec 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout:FFSB benchmark finished at: Sat Sep 21 01:06:39 2024 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout:Results: 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout:Benchmark took 387.78 sec 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout:Total Results 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout:=============== 2024-09-21T01:06:39.319 INFO:tasks.workunit.client.0.smithi047.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-21T01:06:39.320 INFO:tasks.workunit.client.0.smithi047.stdout: ======= ============ ========= ======= =========== ========== 2024-09-21T01:06:39.320 INFO:tasks.workunit.client.0.smithi047.stdout: write : 5497600 14177.07 100.000% 100.000% 55.4MB/sec 2024-09-21T01:06:39.320 INFO:tasks.workunit.client.0.smithi047.stdout:- 2024-09-21T01:06:39.320 INFO:tasks.workunit.client.0.smithi047.stdout:14177.07 Transactions per Second 2024-09-21T01:06:39.320 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.320 INFO:tasks.workunit.client.0.smithi047.stdout:Throughput Results 2024-09-21T01:06:39.320 INFO:tasks.workunit.client.0.smithi047.stdout:=================== 2024-09-21T01:06:39.320 INFO:tasks.workunit.client.0.smithi047.stdout:Write Throughput: 55.4MB/sec 2024-09-21T01:06:39.342 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.342 INFO:tasks.workunit.client.0.smithi047.stdout:System Call Latency statistics in millisecs 2024-09-21T01:06:39.342 INFO:tasks.workunit.client.0.smithi047.stdout:===== 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Min Avg Max Total Calls 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: ======== ======== ======== ============ 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout:[ open] 0.004000 0.621519 625.041016 4295 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[3] 500.000000 - 1000.000000 : 3 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[5] 100.000000 - 200.000000 : 1 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[7] 20.000000 - 50.000000 : 5 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[8] 10.000000 - 20.000000 : 16 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[9] 5.000000 - 10.000000 : 14 2024-09-21T01:06:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[10] 2.000000 - 5.000000 : 19 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[11] 1.000000 - 2.000000 : 33 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[12] 0.500000 - 1.000000 : 155 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[13] 0.200000 - 0.500000 : 24 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[14] 0.100000 - 0.200000 : 13 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[15] 0.050000 - 0.100000 : 87 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[16] 0.020000 - 0.050000 : 818 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[17] 0.010000 - 0.020000 : 2484 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[18] 0.000000 - 0.010000 : 623 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout:[ write] 0.001000 1.868817 112956.273438 5497600 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[0] 5000.000000 - 10000.000000 : 98 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[1] 2000.000000 - 5000.000000 : 215 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[2] 1000.000000 - 2000.000000 : 131 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[3] 500.000000 - 1000.000000 : 121 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[4] 200.000000 - 500.000000 : 3267 2024-09-21T01:06:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[5] 100.000000 - 200.000000 : 1100 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[6] 50.000000 - 100.000000 : 9018 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[7] 20.000000 - 50.000000 : 1596 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[8] 10.000000 - 20.000000 : 639 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[9] 5.000000 - 10.000000 : 488 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[10] 2.000000 - 5.000000 : 634 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[11] 1.000000 - 2.000000 : 456 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[12] 0.500000 - 1.000000 : 382 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[13] 0.200000 - 0.500000 : 512 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[14] 0.100000 - 0.200000 : 496 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[15] 0.050000 - 0.100000 : 2063 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[16] 0.020000 - 0.050000 : 9850 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[17] 0.010000 - 0.020000 : 48054 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[18] 0.000000 - 0.010000 : 5418289 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.345 INFO:tasks.workunit.client.0.smithi047.stdout:[ lseek] 0.000000 0.001144 67.177002 5497600 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[6] 50.000000 - 100.000000 : 3 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[7] 20.000000 - 50.000000 : 46 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[8] 10.000000 - 20.000000 : 54 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[9] 5.000000 - 10.000000 : 40 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[10] 2.000000 - 5.000000 : 65 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[11] 1.000000 - 2.000000 : 52 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[12] 0.500000 - 1.000000 : 45 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[13] 0.200000 - 0.500000 : 48 2024-09-21T01:06:39.346 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[14] 0.100000 - 0.200000 : 35 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[15] 0.050000 - 0.100000 : 92 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[16] 0.020000 - 0.050000 : 667 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[17] 0.010000 - 0.020000 : 1867 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[18] 0.000000 - 0.010000 : 5494586 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout:[ close] 0.001000 0.013841 19.719999 4295 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-21T01:06:39.347 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[8] 10.000000 - 20.000000 : 2 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[15] 0.050000 - 0.100000 : 1 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[16] 0.020000 - 0.050000 : 6 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[17] 0.010000 - 0.020000 : 13 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: msec_range[18] 0.000000 - 0.010000 : 4272 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.348 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-09-21T01:06:39.349 INFO:tasks.workunit.client.0.smithi047.stdout:1.3% User Time 2024-09-21T01:06:39.349 INFO:tasks.workunit.client.0.smithi047.stdout:4.2% System Time 2024-09-21T01:06:39.349 INFO:tasks.workunit.client.0.smithi047.stdout:5.5% CPU Utilization 2024-09-21T01:06:39.349 INFO:tasks.workunit.client.0.smithi047.stderr:+ cd .. 2024-09-21T01:06:39.349 INFO:tasks.workunit.client.0.smithi047.stderr:+ rm -r tmp ffsb 2024-09-21T01:06:39.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:39 smithi134 ceph-mon[34785]: scrub summary: idle 2024-09-21T01:06:39.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:39 smithi114 ceph-mon[34309]: scrub summary: idle 2024-09-21T01:06:39.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:39 smithi047 ceph-mon[30960]: scrub summary: idle 2024-09-21T01:06:40.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:40 smithi134 ceph-mon[34785]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 32 MiB/s wr, 5.76k op/s 2024-09-21T01:06:40.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:40 smithi114 ceph-mon[34309]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 32 MiB/s wr, 5.76k op/s 2024-09-21T01:06:40.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:40 smithi047 ceph-mon[30960]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 32 MiB/s wr, 5.76k op/s 2024-09-21T01:06:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:42 smithi114 ceph-mon[34309]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 24 MiB/s wr, 4.62k op/s 2024-09-21T01:06:42.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:42 smithi047 ceph-mon[30960]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 24 MiB/s wr, 4.62k op/s 2024-09-21T01:06:43.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:42 smithi134 ceph-mon[34785]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 24 MiB/s wr, 4.62k op/s 2024-09-21T01:06:44.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:44 smithi047 ceph-mon[30960]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 21 MiB/s wr, 4.12k op/s 2024-09-21T01:06:45.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:44 smithi134 ceph-mon[34785]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 21 MiB/s wr, 4.12k op/s 2024-09-21T01:06:45.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:44 smithi114 ceph-mon[34309]: pgmap v586: 97 pgs: 97 active+clean; 12 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 21 MiB/s wr, 4.12k op/s 2024-09-21T01:06:45.590 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:06:45.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:06:45.631 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-21T01:06:45.632 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T01:06:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 -- 172.21.15.47:0/219173139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2681025b0 msgr2=0x7ff268102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 --2- 172.21.15.47:0/219173139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2681025b0 0x7ff268102a20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff258009900 tx=0x7ff25802a410 comp rx=0 tx=0).stop 2024-09-21T01:06:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 -- 172.21.15.47:0/219173139 shutdown_connections 2024-09-21T01:06:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 --2- 172.21.15.47:0/219173139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff268103fd0 0x7ff26810a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 --2- 172.21.15.47:0/219173139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff268103630 0x7ff268103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 --2- 172.21.15.47:0/219173139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2681025b0 0x7ff268102a20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 -- 172.21.15.47:0/219173139 >> 172.21.15.47:0/219173139 conn(0x7ff2680fdf30 msgr2=0x7ff2681003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 -- 172.21.15.47:0/219173139 shutdown_connections 2024-09-21T01:06:45.836 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.834+0000 7ff26cc4d640 1 -- 172.21.15.47:0/219173139 wait complete. 2024-09-21T01:06:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.835+0000 7ff26cc4d640 1 Processor -- start 2024-09-21T01:06:45.838 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.835+0000 7ff26cc4d640 1 -- start start 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.835+0000 7ff26cc4d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2681025b0 0x7ff268198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.835+0000 7ff26cc4d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff268103630 0x7ff268199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.835+0000 7ff26cc4d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff268103fd0 0x7ff26819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.835+0000 7ff26cc4d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff26810e200 con 0x7ff268103630 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.835+0000 7ff26cc4d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff26810e080 con 0x7ff2681025b0 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.835+0000 7ff26cc4d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff26810e380 con 0x7ff268103fd0 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff268103630 0x7ff268199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff26659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2681025b0 0x7ff268198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.839 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff268103630 0x7ff268199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37442/0 (socket says 172.21.15.47:37442) 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 -- 172.21.15.47:0/3719693562 learned_addr learned my addr 172.21.15.47:0/3719693562 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff266d9d640 1 --2- 172.21.15.47:0/3719693562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff268103fd0 0x7ff26819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 -- 172.21.15.47:0/3719693562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff268103fd0 msgr2=0x7ff26819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 --2- 172.21.15.47:0/3719693562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff268103fd0 0x7ff26819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 -- 172.21.15.47:0/3719693562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2681025b0 msgr2=0x7ff268198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 --2- 172.21.15.47:0/3719693562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2681025b0 0x7ff268198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 -- 172.21.15.47:0/3719693562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26819a8f0 con 0x7ff268103630 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff26659c640 1 --2- 172.21.15.47:0/3719693562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2681025b0 0x7ff268198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25ffff640 1 --2- 172.21.15.47:0/3719693562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff268103630 0x7ff268199520 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff25000d950 tx=0x7ff25000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25f7fe640 1 -- 172.21.15.47:0/3719693562 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250017030 con 0x7ff268103630 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25f7fe640 1 -- 172.21.15.47:0/3719693562 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff250004020 con 0x7ff268103630 2024-09-21T01:06:45.840 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff26cc4d640 1 -- 172.21.15.47:0/3719693562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26819abe0 con 0x7ff268103630 2024-09-21T01:06:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.836+0000 7ff25f7fe640 1 -- 172.21.15.47:0/3719693562 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2500047a0 con 0x7ff268103630 2024-09-21T01:06:45.841 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.837+0000 7ff26cc4d640 1 -- 172.21.15.47:0/3719693562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2681a12d0 con 0x7ff268103630 2024-09-21T01:06:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.839+0000 7ff273bba740 1 Processor -- start 2024-09-21T01:06:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.839+0000 7ff273bba740 1 -- start start 2024-09-21T01:06:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff25f7fe640 1 -- 172.21.15.47:0/3719693562 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ff250009a30 con 0x7ff268103630 2024-09-21T01:06:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff273bba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e72141b0 0x5605e75bd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff273bba740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff273bba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71f34d0 0x5605e75bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff273bba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605e752e6f0 con 0x5605e71f34d0 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff273bba740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5605e751db20 con 0x5605e71eb2f0 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff273bba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5605e7521930 con 0x5605e72141b0 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71f34d0 0x5605e75bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff266d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e72141b0 0x5605e75bd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71f34d0 0x5605e75bc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37458/0 (socket says 172.21.15.47:37458) 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff266d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e72141b0 0x5605e75bd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:41222/0 (socket says 172.21.15.47:41222) 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff25ffff640 1 -- 172.21.15.47:0/1337413127 learned_addr learned my addr 172.21.15.47:0/1337413127 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff26659c640 1 --2- 172.21.15.47:0/1337413127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff266d9d640 1 -- 172.21.15.47:0/1337413127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 msgr2=0x5605e75bbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff266d9d640 1 --2- 172.21.15.47:0/1337413127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75bbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff266d9d640 1 -- 172.21.15.47:0/1337413127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71f34d0 msgr2=0x5605e75bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff266d9d640 1 --2- 172.21.15.47:0/1337413127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71f34d0 0x5605e75bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.840+0000 7ff266d9d640 1 -- 172.21.15.47:0/1337413127 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e74e3530 con 0x5605e72141b0 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.841+0000 7ff266d9d640 1 --2- 172.21.15.47:0/1337413127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e72141b0 0x5605e75bd1f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff260009f00 tx=0x7ff260011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b0dd45045b961b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.841+0000 7ff25f7fe640 1 --2- 172.21.15.47:0/3719693562 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2540b6510 0x7ff2540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.841+0000 7ff25cff9640 1 -- 172.21.15.47:0/1337413127 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260004d20 con 0x5605e72141b0 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.841+0000 7ff26659c640 1 --2- 172.21.15.47:0/3719693562 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2540b6510 0x7ff2540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.841+0000 7ff25cff9640 1 -- 172.21.15.47:0/1337413127 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff260004050 con 0x5605e72141b0 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.841+0000 7ff25cff9640 1 -- 172.21.15.47:0/1337413127 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260005280 con 0x5605e72141b0 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.841+0000 7ff25f7fe640 1 -- 172.21.15.47:0/3719693562 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff2500e6d40 con 0x7ff268103630 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 -- 172.21.15.47:0/1337413127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e72141b0 msgr2=0x5605e75bd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 --2- 172.21.15.47:0/1337413127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e72141b0 0x5605e75bd1f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff260009f00 tx=0x7ff260011810 comp rx=0 tx=0).stop 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff26659c640 1 --2- 172.21.15.47:0/3719693562 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7ff2540b6510 0x7ff2540b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff258000c00 tx=0x7ff2580046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 -- 172.21.15.47:0/1337413127 shutdown_connections 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 --2- 172.21.15.47:0/1337413127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71f34d0 0x5605e75bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 --2- 172.21.15.47:0/1337413127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 --2- 172.21.15.47:0/1337413127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e72141b0 0x5605e75bd1f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 -- 172.21.15.47:0/1337413127 >> 172.21.15.47:0/1337413127 conn(0x5605e7208300 msgr2=0x5605e75b78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 -- 172.21.15.47:0/1337413127 shutdown_connections 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 -- 172.21.15.47:0/1337413127 wait complete. 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 -- start start 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.842+0000 7ff273bba740 1 Processor -- start 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff273bba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff273bba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff273bba740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e72141b0 0x5605e75cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff273bba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605e7455ab0 con 0x5605e71eb2f0 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff273bba740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5605e74c3730 con 0x5605e72141b0 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff273bba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5605e75c80b0 con 0x5605e71f34d0 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff273bba740 10 client.0 _ll_register_callbacks cb 0x5605e75176b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37468/0 (socket says 172.21.15.47:37468) 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 -- 172.21.15.47:0/956628036 learned_addr learned my addr 172.21.15.47:0/956628036 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff266d9d640 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e72141b0 0x5605e75cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 -- 172.21.15.47:0/956628036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 msgr2=0x5605e75ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 -- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e72141b0 msgr2=0x5605e75cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e72141b0 0x5605e75cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 -- 172.21.15.47:0/956628036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605e727f790 con 0x5605e71eb2f0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff25ffff640 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff266d9d640 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e72141b0 0x5605e75cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff26659c640 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75c9a20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff258033000 tx=0x7ff258009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bb0ab99c8ec39c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.843+0000 7ff24dffb640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff24dffb640 1 -- 172.21.15.47:0/956628036 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258035040 con 0x5605e71eb2f0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff24dffb640 1 -- 172.21.15.47:0/956628036 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff2580037f0 con 0x5605e71eb2f0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 1 -- 172.21.15.47:0/956628036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff260004050 con 0x5605e71eb2f0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff24dffb640 1 -- 172.21.15.47:0/956628036 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff2580044b0 con 0x5605e71eb2f0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 10 client.16185 fetch_fsmap learned FSMap version 19 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 1 -- 172.21.15.47:0/956628036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5605e72f8620 con 0x5605e71eb2f0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff24dffb640 1 -- 172.21.15.47:0/956628036 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff260004050 con 0x5605e71eb2f0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff24dffb640 1 -- 172.21.15.47:0/956628036 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff258044070 con 0x5605e71eb2f0 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 10 client.16185 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:06:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 10 client.16185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 20 client.16185 populate_metadata read hostname 'smithi047' 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605e71d2d80 0x5605e75d7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 4 client.16185 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.844+0000 7ff273bba740 1 -- 172.21.15.47:0/956628036 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605e7530640 con 0x5605e71d2d80 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.845+0000 7ff25ffff640 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605e71d2d80 0x5605e75d7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.845+0000 7ff24dffb640 10 client.16185 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.845+0000 7ff25ffff640 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605e71d2d80 0x5605e75d7140 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dc8bf43d5e87c74 server_cookie=5ab45aed02aaf325 in_seq=0 out_seq=0 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff24dffb640 1 -- 172.21.15.47:0/956628036 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605e7530640 con 0x5605e71d2d80 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff24dffb640 10 client.16185 handle_command_reply: tid=0 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 client.16185 shutdown 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 -- 172.21.15.47:0/956628036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 msgr2=0x5605e75c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75c9a20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff258033000 tx=0x7ff258009260 comp rx=0 tx=0).stop 2024-09-21T01:06:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 -- 172.21.15.47:0/956628036 shutdown_connections 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605e71d2d80 0x5605e75d7140 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e72141b0 0x5605e75cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff24dffb640 0 client.16185 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 --2- 172.21.15.47:0/956628036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75c9a20 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 -- 172.21.15.47:0/956628036 >> 172.21.15.47:0/956628036 conn(0x5605e7208300 msgr2=0x5605e75b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 -- 172.21.15.47:0/956628036 shutdown_connections 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 1 -- 172.21.15.47:0/956628036 wait complete. 2024-09-21T01:06:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.846+0000 7ff273bba740 20 client.16185 trim_cache size 0 max 16384 2024-09-21T01:06:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff273bba740 1 Processor -- start 2024-09-21T01:06:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff273bba740 1 -- start start 2024-09-21T01:06:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff273bba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71d2d80 0x5605e75b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff273bba740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff273bba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff273bba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681a6c20 con 0x5605e71d2d80 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff273bba740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681a94a0 con 0x5605e71eb2f0 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff273bba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681a7290 con 0x5605e71f34d0 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff26659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71d2d80 0x5605e75b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff266d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff266d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.47:41244/0 (socket says 172.21.15.47:41244) 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff26659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71d2d80 0x5605e75b7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37478/0 (socket says 172.21.15.47:37478) 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff266d9d640 1 -- 172.21.15.47:0/3306507761 learned_addr learned my addr 172.21.15.47:0/3306507761 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff25ffff640 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff266d9d640 1 -- 172.21.15.47:0/3306507761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 msgr2=0x5605e75b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff266d9d640 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff266d9d640 1 -- 172.21.15.47:0/3306507761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71d2d80 msgr2=0x5605e75b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff266d9d640 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71d2d80 0x5605e75b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff266d9d640 1 -- 172.21.15.47:0/3306507761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e75bd750 con 0x5605e71f34d0 2024-09-21T01:06:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff25ffff640 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.861+0000 7ff26659c640 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71d2d80 0x5605e75b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:06:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.862+0000 7ff266d9d640 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75c67c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff26001a000 tx=0x7ff260003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d31ef22fdce3faec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.862+0000 7ff24ffff640 1 -- 172.21.15.47:0/3306507761 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260004b00 con 0x5605e71f34d0 2024-09-21T01:06:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.862+0000 7ff24ffff640 1 -- 172.21.15.47:0/3306507761 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff260003e50 con 0x5605e71f34d0 2024-09-21T01:06:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.862+0000 7ff24ffff640 1 -- 172.21.15.47:0/3306507761 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600055d0 con 0x5605e71f34d0 2024-09-21T01:06:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 -- 172.21.15.47:0/3306507761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 msgr2=0x5605e75c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:06:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75c67c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff26001a000 tx=0x7ff260003c30 comp rx=0 tx=0).stop 2024-09-21T01:06:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 -- 172.21.15.47:0/3306507761 shutdown_connections 2024-09-21T01:06:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75c67c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71eb2f0 0x5605e75b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 --2- 172.21.15.47:0/3306507761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71d2d80 0x5605e75b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 -- 172.21.15.47:0/3306507761 >> 172.21.15.47:0/3306507761 conn(0x5605e7208300 msgr2=0x5605e75bba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 -- 172.21.15.47:0/3306507761 shutdown_connections 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 -- 172.21.15.47:0/3306507761 wait complete. 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.863+0000 7ff273bba740 1 -- start start 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff273bba740 1 Processor -- start 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff273bba740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71d2d80 0x5605e75ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff273bba740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff273bba740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff273bba740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681a7960 con 0x5605e71eb2f0 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff273bba740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681a8dd0 con 0x5605e71d2d80 2024-09-21T01:06:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff273bba740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681a8030 con 0x5605e71f34d0 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff273bba740 10 client.0 _ll_register_callbacks cb 0x7ff258009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37486/0 (socket says 172.21.15.47:37486) 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff26659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71d2d80 0x5605e75ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff25ffff640 1 -- 172.21.15.47:0/1148323296 learned_addr learned my addr 172.21.15.47:0/1148323296 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff266d9d640 1 --2- 172.21.15.47:0/1148323296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff26659c640 1 -- 172.21.15.47:0/1148323296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 msgr2=0x5605e75cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff26659c640 1 --2- 172.21.15.47:0/1148323296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e71f34d0 0x5605e75cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff26659c640 1 -- 172.21.15.47:0/1148323296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 msgr2=0x5605e75cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:06:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff26659c640 1 --2- 172.21.15.47:0/1148323296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605e71eb2f0 0x5605e75cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.864+0000 7ff26659c640 1 -- 172.21.15.47:0/1148323296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605e75ce4b0 con 0x5605e71d2d80 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff26659c640 1 --2- 172.21.15.47:0/1148323296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605e71d2d80 0x5605e75ccb70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff258004650 tx=0x7ff2580314c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aef9ffb2823b78c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff24dffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff24dffb640 1 -- 172.21.15.47:0/1148323296 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25805e070 con 0x5605e71d2d80 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff24dffb640 1 -- 172.21.15.47:0/1148323296 <== mon.2 v2:172.21.15.114:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7ff2580037f0 con 0x5605e71d2d80 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 1 -- 172.21.15.47:0/1148323296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff260003e50 con 0x5605e71d2d80 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff24dffb640 1 -- 172.21.15.47:0/1148323296 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff25806a050 con 0x5605e71d2d80 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 10 client.25862 fetch_fsmap learned FSMap version 19 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 1 -- 172.21.15.47:0/1148323296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5605e75d1820 con 0x5605e71d2d80 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff24dffb640 1 -- 172.21.15.47:0/1148323296 <== mon.2 v2:172.21.15.114:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff260003e50 con 0x5605e71d2d80 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff24dffb640 1 -- 172.21.15.47:0/1148323296 <== mon.2 v2:172.21.15.114:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff258044040 con 0x5605e71d2d80 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 10 client.25862 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:06:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 10 client.25862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:06:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 20 client.25862 populate_metadata read hostname 'smithi047' 2024-09-21T01:06:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 1 --2- 172.21.15.47:0/1148323296 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605e72141b0 0x5605e7643d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:06:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 4 client.25862 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:06:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.865+0000 7ff273bba740 1 -- 172.21.15.47:0/1148323296 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5605e752c0f0 con 0x5605e72141b0 2024-09-21T01:06:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.866+0000 7ff25ffff640 1 --2- 172.21.15.47:0/1148323296 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605e72141b0 0x5605e7643d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:06:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.866+0000 7ff24dffb640 10 client.25862 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:06:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi047.front.sepia.ceph.com.smithi047.stderr:2024-09-21T01:06:45.866+0000 7ff25ffff640 1 --2- 172.21.15.47:0/1148323296 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x5605e72141b0 0x5605e7643d00 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1abe8916bb3ac2bc server_cookie=355c151f8b6df3a3 in_seq=0 out_seq=0 2024-09-21T01:06:45.992 DEBUG:teuthology.parallel:result is None 2024-09-21T01:06:45.992 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:06:46.022 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:06:46.022 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T01:06:46.033 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi047.front.sepia.ceph.com 2024-09-21T01:06:46.071 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T01:06:46.082 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T01:06:46.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:46 smithi047 ceph-mon[30960]: pgmap v587: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 17 MiB/s wr, 3.02k op/s 2024-09-21T01:06:47.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:46 smithi134 ceph-mon[34785]: pgmap v587: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 17 MiB/s wr, 3.02k op/s 2024-09-21T01:06:47.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:46 smithi114 ceph-mon[34309]: pgmap v587: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 17 MiB/s wr, 3.02k op/s 2024-09-21T01:06:48.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:48 smithi047 ceph-mon[30960]: pgmap v588: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 2.02k op/s 2024-09-21T01:06:49.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:48 smithi134 ceph-mon[34785]: pgmap v588: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 2.02k op/s 2024-09-21T01:06:49.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:48 smithi114 ceph-mon[34309]: pgmap v588: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 2.02k op/s 2024-09-21T01:06:50.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:50 smithi047 ceph-mon[30960]: pgmap v589: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 5.7 MiB/s wr, 987 op/s 2024-09-21T01:06:51.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:50 smithi134 ceph-mon[34785]: pgmap v589: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 5.7 MiB/s wr, 987 op/s 2024-09-21T01:06:51.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:50 smithi114 ceph-mon[34309]: pgmap v589: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 5.7 MiB/s wr, 987 op/s 2024-09-21T01:06:52.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:52 smithi047 ceph-mon[30960]: pgmap v590: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 193 KiB/s wr, 28 op/s 2024-09-21T01:06:53.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:52 smithi134 ceph-mon[34785]: pgmap v590: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 193 KiB/s wr, 28 op/s 2024-09-21T01:06:53.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:52 smithi114 ceph-mon[34309]: pgmap v590: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 193 KiB/s wr, 28 op/s 2024-09-21T01:06:54.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:54 smithi047 ceph-mon[30960]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 194 KiB/s wr, 33 op/s 2024-09-21T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:54 smithi134 ceph-mon[34785]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 194 KiB/s wr, 33 op/s 2024-09-21T01:06:55.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:54 smithi114 ceph-mon[34309]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 194 KiB/s wr, 33 op/s 2024-09-21T01:06:56.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:56 smithi047 ceph-mon[30960]: pgmap v592: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-09-21T01:06:57.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:56 smithi134 ceph-mon[34785]: pgmap v592: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-09-21T01:06:57.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:56 smithi114 ceph-mon[34309]: pgmap v592: 97 pgs: 97 active+clean; 12 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-09-21T01:06:58.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:06:58 smithi047 ceph-mon[30960]: pgmap v593: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 26 op/s 2024-09-21T01:06:59.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:06:58 smithi134 ceph-mon[34785]: pgmap v593: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 26 op/s 2024-09-21T01:06:59.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:06:58 smithi114 ceph-mon[34309]: pgmap v593: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 26 op/s 2024-09-21T01:07:00.955 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:00 smithi047 ceph-mon[30960]: pgmap v594: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-09-21T01:07:00.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:00 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:00 smithi134 ceph-mon[34785]: pgmap v594: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-09-21T01:07:01.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:00 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:01.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:00 smithi114 ceph-mon[34309]: pgmap v594: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-09-21T01:07:01.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:00 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:01.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:01.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:01.956 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:01 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:07:02.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:02.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:02.094 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:01 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:07:02.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:02.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:02.160 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:01 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' 2024-09-21T01:07:03.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:03 smithi134 ceph-mon[34785]: pgmap v595: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T01:07:03.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:03 smithi114 ceph-mon[34309]: pgmap v595: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:03 smithi047 ceph-mon[30960]: pgmap v595: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T01:07:03.869 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:07:04.146 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:04.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 -- 172.21.15.47:0/894677233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 msgr2=0x7feb70103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 --2- 172.21.15.47:0/894677233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 0x7feb70103f70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7feb60009900 tx=0x7feb6002a410 comp rx=0 tx=0).stop 2024-09-21T01:07:04.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 -- 172.21.15.47:0/894677233 shutdown_connections 2024-09-21T01:07:04.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 --2- 172.21.15.47:0/894677233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb70109df0 0x7feb70110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 --2- 172.21.15.47:0/894677233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb701094a0 0x7feb701098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 --2- 172.21.15.47:0/894677233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 0x7feb70103f70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 -- 172.21.15.47:0/894677233 >> 172.21.15.47:0/894677233 conn(0x7feb7007b850 msgr2=0x7feb7007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 -- 172.21.15.47:0/894677233 shutdown_connections 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.644+0000 7feb76c60640 1 -- 172.21.15.47:0/894677233 wait complete. 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb76c60640 1 Processor -- start 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb76c60640 1 -- start start 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb76c60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 0x7feb7019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb76c60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb701094a0 0x7feb7019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb76c60640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb70109df0 0x7feb7019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb76c60640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb70113ab0 con 0x7feb70103b60 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb76c60640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feb70113930 con 0x7feb701094a0 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb76c60640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb70113c30 con 0x7feb70109df0 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb749fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 0x7feb7019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb749fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 0x7feb7019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58870/0 (socket says 172.21.15.47:58870) 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.645+0000 7feb749fc640 1 -- 172.21.15.47:0/741896751 learned_addr learned my addr 172.21.15.47:0/741896751 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb751fd640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb70109df0 0x7feb7019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb6ffff640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb701094a0 0x7feb7019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb751fd640 1 -- 172.21.15.47:0/741896751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb701094a0 msgr2=0x7feb7019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb751fd640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb701094a0 0x7feb7019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb751fd640 1 -- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 msgr2=0x7feb7019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb751fd640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 0x7feb7019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb751fd640 1 -- 172.21.15.47:0/741896751 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb701a04f0 con 0x7feb70109df0 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb6ffff640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb701094a0 0x7feb7019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb749fc640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 0x7feb7019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb751fd640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb70109df0 0x7feb7019fdc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb68009fd0 tx=0x7feb6800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb6dffb640 1 -- 172.21.15.47:0/741896751 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6800ce20 con 0x7feb70109df0 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb76c60640 1 -- 172.21.15.47:0/741896751 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb701a07e0 con 0x7feb70109df0 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb6dffb640 1 -- 172.21.15.47:0/741896751 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb68005020 con 0x7feb70109df0 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.646+0000 7feb6dffb640 1 -- 172.21.15.47:0/741896751 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68010690 con 0x7feb70109df0 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.647+0000 7feb76c60640 1 -- 172.21.15.47:0/741896751 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb701a6f40 con 0x7feb70109df0 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb7d1d4740 1 Processor -- start 2024-09-21T01:07:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb6dffb640 1 -- 172.21.15.47:0/741896751 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7feb680054d0 con 0x7feb70109df0 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb7d1d4740 1 -- start start 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297b96650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297b96b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297b970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c297b0ce50 con 0x55c2977ef070 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55c297afc280 con 0x55c2977c61b0 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.649+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c297b00090 con 0x55c2977ce390 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297b96650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297b96650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58886/0 (socket says 172.21.15.47:58886) 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb6ffff640 1 -- 172.21.15.47:0/3782036195 learned_addr learned my addr 172.21.15.47:0/3782036195 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb749fc640 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297b96b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb6ffff640 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297b970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb6dffb640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb580b6510 0x7feb580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb749fc640 1 -- 172.21.15.47:0/3782036195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 msgr2=0x55c297b970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb749fc640 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297b970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb749fc640 1 -- 172.21.15.47:0/3782036195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 msgr2=0x55c297b96650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb749fc640 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297b96650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb749fc640 1 -- 172.21.15.47:0/3782036195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c29785a650 con 0x55c2977c61b0 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb6dffb640 1 -- 172.21.15.47:0/741896751 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7feb680e7980 con 0x7feb70109df0 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb751fd640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb580b6510 0x7feb580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.650+0000 7feb749fc640 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297b96b90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feb60004770 tx=0x7feb60005ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df684636f015e68c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.651+0000 7feb56ffd640 1 -- 172.21.15.47:0/3782036195 <== mon.2 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60035040 con 0x55c2977c61b0 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.651+0000 7feb751fd640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb580b6510 0x7feb580b8a20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feb680e7cb0 tx=0x7feb680057c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.651+0000 7feb56ffd640 1 -- 172.21.15.47:0/3782036195 <== mon.2 v2:172.21.15.114:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb60031820 con 0x55c2977c61b0 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.651+0000 7feb56ffd640 1 -- 172.21.15.47:0/3782036195 <== mon.2 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb600049e0 con 0x55c2977c61b0 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.651+0000 7feb7d1d4740 1 -- 172.21.15.47:0/3782036195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 msgr2=0x55c297b96b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.651+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297b96b90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feb60004770 tx=0x7feb60005ed0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 -- 172.21.15.47:0/3782036195 shutdown_connections 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297b970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297b96b90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/3782036195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297b96650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 -- 172.21.15.47:0/3782036195 >> 172.21.15.47:0/3782036195 conn(0x55c2977e3460 msgr2=0x55c297b94540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:04.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 -- 172.21.15.47:0/3782036195 shutdown_connections 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 -- 172.21.15.47:0/3782036195 wait complete. 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 -- start start 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.652+0000 7feb7d1d4740 1 Processor -- start 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977c61b0 0x55c297ba60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297ba6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ef070 0x55c297bb2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c29795d700 con 0x55c2977c61b0 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55c297a97110 con 0x55c2977ce390 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c297ba90d0 con 0x55c2977ef070 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977c61b0 0x55c297ba60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977c61b0 0x55c297ba60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58896/0 (socket says 172.21.15.47:58896) 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 -- 172.21.15.47:0/1307793173 learned_addr learned my addr 172.21.15.47:0/1307793173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb749fc640 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297ba6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb7d1d4740 10 client.0 _ll_register_callbacks cb 0x55c297ab0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ef070 0x55c297bb2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 -- 172.21.15.47:0/1307793173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ef070 msgr2=0x55c297bb2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ef070 0x55c297bb2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 -- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 msgr2=0x55c297ba6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297ba6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 -- 172.21.15.47:0/1307793173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c297ac4c40 con 0x55c2977c61b0 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb749fc640 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297ba6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb6ffff640 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977c61b0 0x55c297ba60f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7feb64013e70 tx=0x7feb640096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03a500467d082d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb4ffff640 1 -- 172.21.15.47:0/1307793173 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb64004030 con 0x55c2977c61b0 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb4ffff640 1 -- 172.21.15.47:0/1307793173 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7feb640041d0 con 0x55c2977c61b0 2024-09-21T01:07:04.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.653+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1307793173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb60031820 con 0x55c2977c61b0 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb4ffff640 1 -- 172.21.15.47:0/1307793173 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7feb640043d0 con 0x55c2977c61b0 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb7d1d4740 10 client.16203 fetch_fsmap learned FSMap version 19 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1307793173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c297bb4e00 con 0x55c2977c61b0 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb4ffff640 1 -- 172.21.15.47:0/1307793173 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb60031820 con 0x55c2977c61b0 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb4ffff640 1 -- 172.21.15.47:0/1307793173 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7feb64023470 con 0x55c2977c61b0 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb7d1d4740 10 client.16203 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb7d1d4740 10 client.16203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb7d1d4740 20 client.16203 populate_metadata read hostname 'smithi047' 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c2977ad9f0 0x55c297bb81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb7d1d4740 4 client.16203 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1307793173 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c297b0eda0 con 0x55c2977ad9f0 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.654+0000 7feb749fc640 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c2977ad9f0 0x55c297bb81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.655+0000 7feb749fc640 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c2977ad9f0 0x55c297bb81a0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b98bcf7e2db4eb6 server_cookie=4bcce0173fe5dfff in_seq=0 out_seq=0 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.655+0000 7feb4ffff640 10 client.16203 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.655+0000 7feb4ffff640 1 -- 172.21.15.47:0/1307793173 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c297b0eda0 con 0x55c2977ad9f0 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.655+0000 7feb4ffff640 10 client.16203 handle_command_reply: tid=0 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.655+0000 7feb7d1d4740 1 client.16203 shutdown 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.655+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1307793173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977c61b0 msgr2=0x55c297ba60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.655+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977c61b0 0x55c297ba60f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7feb64013e70 tx=0x7feb640096c0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1307793173 shutdown_connections 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c2977ad9f0 0x55c297bb81a0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ef070 0x55c297bb2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297ba6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1307793173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977c61b0 0x55c297ba60f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1307793173 >> 172.21.15.47:0/1307793173 conn(0x55c2977e3460 msgr2=0x55c297b92b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:04.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb4ffff640 0 client.16203 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:07:04.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1307793173 shutdown_connections 2024-09-21T01:07:04.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1307793173 wait complete. 2024-09-21T01:07:04.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.656+0000 7feb7d1d4740 20 client.16203 trim_cache size 0 max 16384 2024-09-21T01:07:04.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb7d1d4740 1 Processor -- start 2024-09-21T01:07:04.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb7d1d4740 1 -- start start 2024-09-21T01:07:04.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977c61b0 0x55c297ba65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297bb2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297ba32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb701ab120 con 0x55c2977ef070 2024-09-21T01:07:04.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feb701ad960 con 0x55c2977ce390 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb701ab770 con 0x55c2977c61b0 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297ba32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb749fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297bb2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb749fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297bb2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:58972/0 (socket says 172.21.15.47:58972) 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977c61b0 0x55c297ba65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.674+0000 7feb749fc640 1 -- 172.21.15.47:0/1198366151 learned_addr learned my addr 172.21.15.47:0/1198366151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb6ffff640 1 -- 172.21.15.47:0/1198366151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 msgr2=0x55c297bb2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb6ffff640 1 --2- 172.21.15.47:0/1198366151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297bb2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb6ffff640 1 -- 172.21.15.47:0/1198366151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 msgr2=0x55c297ba32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb6ffff640 1 --2- 172.21.15.47:0/1198366151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297ba32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb6ffff640 1 -- 172.21.15.47:0/1198366151 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c297ba5050 con 0x55c2977c61b0 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb6ffff640 1 --2- 172.21.15.47:0/1198366151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977c61b0 0x55c297ba65b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb64009690 tx=0x7feb64000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae3476a333e91ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb567fc640 1 -- 172.21.15.47:0/1198366151 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb64033070 con 0x55c2977c61b0 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb567fc640 1 -- 172.21.15.47:0/1198366151 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb64034040 con 0x55c2977c61b0 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.675+0000 7feb567fc640 1 -- 172.21.15.47:0/1198366151 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6402d8b0 con 0x55c2977c61b0 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1198366151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977c61b0 msgr2=0x55c297ba65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1198366151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977c61b0 0x55c297ba65b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb64009690 tx=0x7feb64000bc0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1198366151 shutdown_connections 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1198366151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297ba32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1198366151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977ce390 0x55c297bb2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/1198366151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977c61b0 0x55c297ba65b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1198366151 >> 172.21.15.47:0/1198366151 conn(0x55c2977e3460 msgr2=0x55c297ba5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1198366151 shutdown_connections 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 -- 172.21.15.47:0/1198366151 wait complete. 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.676+0000 7feb7d1d4740 1 -- start start 2024-09-21T01:07:04.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb7d1d4740 1 Processor -- start 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297baa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297baa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb7d1d4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297baada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb701abe20 con 0x55c2977ef070 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feb701ad290 con 0x55c2977c61b0 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb7d1d4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7feb701ac4f0 con 0x55c2977ce390 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb7d1d4740 10 client.0 _ll_register_callbacks cb 0x7feb64009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297baada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297baada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58916/0 (socket says 172.21.15.47:58916) 2024-09-21T01:07:04.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb6ffff640 1 -- 172.21.15.47:0/2839656932 learned_addr learned my addr 172.21.15.47:0/2839656932 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb749fc640 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297baa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.677+0000 7feb6ffff640 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297baa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb749fc640 1 -- 172.21.15.47:0/2839656932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 msgr2=0x55c297baa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb749fc640 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297baa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb749fc640 1 -- 172.21.15.47:0/2839656932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 msgr2=0x55c297baada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb749fc640 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297baada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb749fc640 1 -- 172.21.15.47:0/2839656932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c297c21b60 con 0x55c2977ce390 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb749fc640 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297baa860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feb60005520 tx=0x7feb60009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6863a18928b341 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb4ffff640 1 -- 172.21.15.47:0/2839656932 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60035040 con 0x55c2977ce390 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb4ffff640 1 -- 172.21.15.47:0/2839656932 <== mon.1 v2:172.21.15.134:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7feb60031cc0 con 0x55c2977ce390 2024-09-21T01:07:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb7d1d4740 1 -- 172.21.15.47:0/2839656932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb64034040 con 0x55c2977ce390 2024-09-21T01:07:04.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb4ffff640 1 -- 172.21.15.47:0/2839656932 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7feb60005850 con 0x55c2977ce390 2024-09-21T01:07:04.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb7d1d4740 10 client.25891 fetch_fsmap learned FSMap version 19 2024-09-21T01:07:04.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.678+0000 7feb7d1d4740 1 -- 172.21.15.47:0/2839656932 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c297c22de0 con 0x55c2977ce390 2024-09-21T01:07:04.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb4ffff640 1 -- 172.21.15.47:0/2839656932 <== mon.1 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb64034040 con 0x55c2977ce390 2024-09-21T01:07:04.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb4ffff640 1 -- 172.21.15.47:0/2839656932 <== mon.1 v2:172.21.15.134:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7feb60057030 con 0x55c2977ce390 2024-09-21T01:07:04.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb7d1d4740 10 client.25891 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:07:04.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb7d1d4740 10 client.25891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:07:04.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb7d1d4740 20 client.25891 populate_metadata read hostname 'smithi047' 2024-09-21T01:07:04.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c297782da0 0x55c297c25130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:04.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb7d1d4740 4 client.25891 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb7d1d4740 1 -- 172.21.15.47:0/2839656932 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c297b0a850 con 0x55c297782da0 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.679+0000 7feb6ffff640 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c297782da0 0x55c297c25130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb6ffff640 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c297782da0 0x55c297c25130 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57fe830d2ca32b43 server_cookie=2366f3d86a8aac0c in_seq=0 out_seq=0 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb4ffff640 10 client.25891 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb4ffff640 1 -- 172.21.15.47:0/2839656932 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55c297b0a850 con 0x55c297782da0 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb4ffff640 10 client.25891 handle_command_reply: tid=0 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 client.25891 shutdown 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 -- 172.21.15.47:0/2839656932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 msgr2=0x55c297baa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297baa860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feb60005520 tx=0x7feb60009260 comp rx=0 tx=0).stop 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 -- 172.21.15.47:0/2839656932 shutdown_connections 2024-09-21T01:07:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55c297782da0 0x55c297c25130 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c2977ef070 0x55c297baada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2977ce390 0x55c297baa860 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb4ffff640 0 client.25891 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 --2- 172.21.15.47:0/2839656932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2977c61b0 0x55c297baa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 -- 172.21.15.47:0/2839656932 >> 172.21.15.47:0/2839656932 conn(0x55c2977e3460 msgr2=0x55c297ba7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 -- 172.21.15.47:0/2839656932 shutdown_connections 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 1 -- 172.21.15.47:0/2839656932 wait complete. 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.680+0000 7feb7d1d4740 20 client.25891 trim_cache size 0 max 16384 2024-09-21T01:07:04.688 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "status": "no active scrubs running", 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "scrubs": {}, 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_stats": { 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "736e4c53-6a66-4fe2-8a04-61c577d889f1": { 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:55.468495+0000", 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:07:04.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "471bdb03-cfd3-4b33-8a48-5de4a9ff8c87": { 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:04:13.847440+0000", 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "d3e1990b-bd4b-4192-9c40-656f04b77a20": { 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:02:26.327885+0000", 2024-09-21T01:07:04.690 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "013c654d-123e-4be3-a479-1be70f6e1569": { 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T01:00:39.286315+0000", 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "3d075403-3cfd-47a8-ab47-0d01b5c16c0a": { 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:14.577232+0000", 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "7a754496-3920-4c5b-9027-06e8a64287e6": { 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:59:54.220335+0000", 2024-09-21T01:07:04.692 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "f1966ae8-5721-4668-bade-5c8cf1819177": { 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "start_time": "2024-09-21T00:58:35.245122+0000", 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "path": "/", 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_started": 0, 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_passed": 0, 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_failed": 0, 2024-09-21T01:07:04.693 INFO:teuthology.orchestra.run.smithi047.stdout: "uninline_skipped": 0 2024-09-21T01:07:04.694 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:04.694 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:04.694 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 -- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb580b6510 msgr2=0x7feb580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb580b6510 0x7feb580b8a20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feb680e7cb0 tx=0x7feb680057c0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 -- 172.21.15.47:0/741896751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb70109df0 msgr2=0x7feb7019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb70109df0 0x7feb7019fdc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb68009fd0 tx=0x7feb6800ef10 comp rx=0 tx=0).stop 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 -- 172.21.15.47:0/741896751 shutdown_connections 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7feb580b6510 0x7feb580b8a20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb70109df0 0x7feb7019fdc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb701094a0 0x7feb7019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 --2- 172.21.15.47:0/741896751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70103b60 0x7feb7019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:04.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 -- 172.21.15.47:0/741896751 >> 172.21.15.47:0/741896751 conn(0x7feb7007b850 msgr2=0x7feb70107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:04.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 -- 172.21.15.47:0/741896751 shutdown_connections 2024-09-21T01:07:04.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:04.681+0000 7feb76c60640 1 -- 172.21.15.47:0/741896751 wait complete. 2024-09-21T01:07:05.298 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:05 smithi047 ceph-mon[30960]: pgmap v596: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-21T01:07:05.347 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:05 smithi134 ceph-mon[34785]: pgmap v596: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-21T01:07:05.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:05 smithi114 ceph-mon[34309]: pgmap v596: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-21T01:07:05.491 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:07:05.491 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:07:05.754 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 -- 172.21.15.47:0/3305473220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801031b0 msgr2=0x7f69801035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 --2- 172.21.15.47:0/3305473220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801031b0 0x7f69801035c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6974009900 tx=0x7f697402a410 comp rx=0 tx=0).stop 2024-09-21T01:07:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 -- 172.21.15.47:0/3305473220 shutdown_connections 2024-09-21T01:07:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 --2- 172.21.15.47:0/3305473220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6980105b10 0x7f698010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 --2- 172.21.15.47:0/3305473220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69801051c0 0x7f69801055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 --2- 172.21.15.47:0/3305473220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801031b0 0x7f69801035c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 -- 172.21.15.47:0/3305473220 >> 172.21.15.47:0/3305473220 conn(0x7f6980079f90 msgr2=0x7f698007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 -- 172.21.15.47:0/3305473220 shutdown_connections 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.259+0000 7f6986bf9640 1 -- 172.21.15.47:0/3305473220 wait complete. 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6986bf9640 1 Processor -- start 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6986bf9640 1 -- start start 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6986bf9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69801031b0 0x7f698019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6986bf9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801051c0 0x7f698019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6986bf9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6980105b10 0x7f698019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6986bf9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6980112a10 con 0x7f69801051c0 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6986bf9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6980112890 con 0x7f6980105b10 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6986bf9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6980112b90 con 0x7f69801031b0 2024-09-21T01:07:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f697ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801051c0 0x7f698019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6984995640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69801031b0 0x7f698019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f697ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801051c0 0x7f698019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58932/0 (socket says 172.21.15.47:58932) 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f697ffff640 1 -- 172.21.15.47:0/2396412854 learned_addr learned my addr 172.21.15.47:0/2396412854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.260+0000 7f6985196640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6980105b10 0x7f698019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f6984995640 1 -- 172.21.15.47:0/2396412854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6980105b10 msgr2=0x7f698019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f6984995640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6980105b10 0x7f698019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f6984995640 1 -- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801051c0 msgr2=0x7f698019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f6984995640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801051c0 0x7f698019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f6984995640 1 -- 172.21.15.47:0/2396412854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69801a0440 con 0x7f69801031b0 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f697ffff640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801051c0 0x7f698019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f6984995640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69801031b0 0x7f698019a4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6974006010 tx=0x7f6974004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f697dffb640 1 -- 172.21.15.47:0/2396412854 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697403f070 con 0x7f69801031b0 2024-09-21T01:07:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69801a06d0 con 0x7f69801031b0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f697dffb640 1 -- 172.21.15.47:0/2396412854 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6974003ca0 con 0x7f69801031b0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f697dffb640 1 -- 172.21.15.47:0/2396412854 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974035070 con 0x7f69801031b0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.261+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69801a6e90 con 0x7f69801031b0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.262+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6980103f30 con 0x7f69801031b0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.264+0000 7f697dffb640 1 -- 172.21.15.47:0/2396412854 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f697403b460 con 0x7f69801031b0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.265+0000 7f697dffb640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f69700b6510 0x7f69700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.265+0000 7f697ffff640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f69700b6510 0x7f69700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.265+0000 7f697dffb640 1 -- 172.21.15.47:0/2396412854 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f6974107a10 con 0x7f69801031b0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.265+0000 7f697ffff640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f69700b6510 0x7f69700b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6980107e80 tx=0x7f696c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.268+0000 7f697dffb640 1 -- 172.21.15.47:0/2396412854 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69740d2680 con 0x7f69801031b0 2024-09-21T01:07:06.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.502+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69801035c0 con 0x7f69801031b0 2024-09-21T01:07:06.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.503+0000 7f697dffb640 1 -- 172.21.15.47:0/2396412854 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f69740d75c0 con 0x7f69801031b0 2024-09-21T01:07:06.504 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:07:06.504 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:07:06.504 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T01:07:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f69700b6510 msgr2=0x7f69700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f69700b6510 0x7f69700b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6980107e80 tx=0x7f696c005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69801031b0 msgr2=0x7f698019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69801031b0 0x7f698019a4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6974006010 tx=0x7f6974004060 comp rx=0 tx=0).stop 2024-09-21T01:07:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 shutdown_connections 2024-09-21T01:07:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f69700b6510 0x7f69700b8a20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6980105b10 0x7f698019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69801051c0 0x7f698019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 --2- 172.21.15.47:0/2396412854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69801031b0 0x7f698019a4d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.505+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 >> 172.21.15.47:0/2396412854 conn(0x7f6980079f90 msgr2=0x7f6980106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.506+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 shutdown_connections 2024-09-21T01:07:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:06.506+0000 7f6986bf9640 1 -- 172.21.15.47:0/2396412854 wait complete. 2024-09-21T01:07:07.129 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:07 smithi047 ceph-mon[30960]: pgmap v597: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-21T01:07:07.130 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:07 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2396412854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:07.159 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:07:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:07 smithi134 ceph-mon[34785]: pgmap v597: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-21T01:07:07.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:07 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2396412854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:07.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:07 smithi114 ceph-mon[34309]: pgmap v597: 97 pgs: 97 active+clean; 12 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-21T01:07:07.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:07 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2396412854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:07.418 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 -- 172.21.15.47:0/628648524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc103b80 msgr2=0x7fa3dc103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/628648524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc103b80 0x7fa3dc103f90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009900 tx=0x7fa3cc02a410 comp rx=0 tx=0).stop 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 -- 172.21.15.47:0/628648524 shutdown_connections 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/628648524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3dc109e10 0x7fa3dc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/628648524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3dc1094c0 0x7fa3dc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/628648524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc103b80 0x7fa3dc103f90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 -- 172.21.15.47:0/628648524 >> 172.21.15.47:0/628648524 conn(0x7fa3dc0ff610 msgr2=0x7fa3dc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 -- 172.21.15.47:0/628648524 shutdown_connections 2024-09-21T01:07:08.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.910+0000 7fa3e20fa640 1 -- 172.21.15.47:0/628648524 wait complete. 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.911+0000 7fa3e20fa640 1 Processor -- start 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.911+0000 7fa3e20fa640 1 -- start start 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.911+0000 7fa3e20fa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3dc103b80 0x7fa3dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.911+0000 7fa3e20fa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc1094c0 0x7fa3dc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.911+0000 7fa3e20fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3dc109e10 0x7fa3dc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.911+0000 7fa3e20fa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc113b20 con 0x7fa3dc1094c0 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.911+0000 7fa3e20fa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1139a0 con 0x7fa3dc109e10 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.911+0000 7fa3e20fa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc113ca0 con 0x7fa3dc103b80 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc1094c0 0x7fa3dc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc1094c0 0x7fa3dc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58954/0 (socket says 172.21.15.47:58954) 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 -- 172.21.15.47:0/3802939234 learned_addr learned my addr 172.21.15.47:0/3802939234 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3dc103b80 0x7fa3dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3dc109e10 0x7fa3dc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 -- 172.21.15.47:0/3802939234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3dc103b80 msgr2=0x7fa3dc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3dc103b80 0x7fa3dc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 -- 172.21.15.47:0/3802939234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3dc109e10 msgr2=0x7fa3dc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3dc109e10 0x7fa3dc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 -- 172.21.15.47:0/3802939234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc1a8770 con 0x7fa3dc1094c0 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3daffd640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc1094c0 0x7fa3dc075c50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e9c0 tx=0x7fa3d000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3d8ff9640 1 -- 172.21.15.47:0/3802939234 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000ccc0 con 0x7fa3dc1094c0 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3d8ff9640 1 -- 172.21.15.47:0/3802939234 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3d00054d0 con 0x7fa3dc1094c0 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3e20fa640 1 -- 172.21.15.47:0/3802939234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3dc1a8a60 con 0x7fa3dc1094c0 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3d8ff9640 1 -- 172.21.15.47:0/3802939234 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0010430 con 0x7fa3dc1094c0 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.912+0000 7fa3e20fa640 1 -- 172.21.15.47:0/3802939234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3dc1a8f20 con 0x7fa3dc1094c0 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3e866e740 1 Processor -- start 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3e866e740 1 -- start start 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3d8ff9640 1 -- 172.21.15.47:0/3802939234 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa3d0005020 con 0x7fa3dc1094c0 2024-09-21T01:07:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd8605070 0x55ccd89ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85e4390 0x55ccd89ad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3e866e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ccd8922ea0 con 0x55ccd85dc1b0 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3e866e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55ccd89122d0 con 0x55ccd8605070 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3e866e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ccd89160e0 con 0x55ccd85e4390 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.915+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89acbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58966/0 (socket says 172.21.15.47:58966) 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3db7fe640 1 -- 172.21.15.47:0/1304264872 learned_addr learned my addr 172.21.15.47:0/1304264872 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd8605070 0x55ccd89ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3daffd640 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85e4390 0x55ccd89ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3db7fe640 1 -- 172.21.15.47:0/1304264872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85e4390 msgr2=0x55ccd89ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85e4390 0x55ccd89ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3db7fe640 1 -- 172.21.15.47:0/1304264872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd8605070 msgr2=0x55ccd89ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd8605070 0x55ccd89ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3db7fe640 1 -- 172.21.15.47:0/1304264872 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccd8670650 con 0x55ccd85dc1b0 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3daffd640 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85e4390 0x55ccd89ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89acbe0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc000c00 tx=0x7fa3cc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aeac8a64c90a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3d8ff9640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa3c40b6510 0x7fa3c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3c1ffb640 1 -- 172.21.15.47:0/1304264872 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc035040 con 0x55ccd85dc1b0 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa3c40b6510 0x7fa3c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3c1ffb640 1 -- 172.21.15.47:0/1304264872 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3cc0054f0 con 0x55ccd85dc1b0 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3c1ffb640 1 -- 172.21.15.47:0/1304264872 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0035f0 con 0x55ccd85dc1b0 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.916+0000 7fa3d8ff9640 1 -- 172.21.15.47:0/3802939234 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa3d00e75c0 con 0x7fa3dc1094c0 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 -- 172.21.15.47:0/1304264872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 msgr2=0x55ccd89acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa3c40b6510 0x7fa3c40b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005fd0 tx=0x7fa3d4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89acbe0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc000c00 tx=0x7fa3cc0040c0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 -- 172.21.15.47:0/1304264872 shutdown_connections 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85e4390 0x55ccd89ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89acbe0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1304264872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd8605070 0x55ccd89ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 -- 172.21.15.47:0/1304264872 >> 172.21.15.47:0/1304264872 conn(0x55ccd85f9460 msgr2=0x55ccd89aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 -- 172.21.15.47:0/1304264872 shutdown_connections 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.917+0000 7fa3e866e740 1 -- 172.21.15.47:0/1304264872 wait complete. 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 1 -- start start 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 1 Processor -- start 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd8605070 0x55ccd89c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ccd8773700 con 0x55ccd85dc1b0 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55ccd88ad160 con 0x55ccd85e4390 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ccd89bae20 con 0x55ccd8605070 2024-09-21T01:07:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3e866e740 10 client.0 _ll_register_callbacks cb 0x55ccd88c69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.918+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58968/0 (socket says 172.21.15.47:58968) 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3daffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3db7fe640 1 -- 172.21.15.47:0/2180952137 learned_addr learned my addr 172.21.15.47:0/2180952137 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd8605070 0x55ccd89c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3db7fe640 1 -- 172.21.15.47:0/2180952137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd8605070 msgr2=0x55ccd89c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd8605070 0x55ccd89c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3db7fe640 1 -- 172.21.15.47:0/2180952137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 msgr2=0x55ccd89b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3db7fe640 1 -- 172.21.15.47:0/2180952137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccd88dac90 con 0x55ccd85dc1b0 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3daffd640 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b7d60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005ab0 tx=0x7fa3cc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519bfa02e807282d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3baffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3baffd640 1 -- 172.21.15.47:0/2180952137 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc053060 con 0x55ccd85dc1b0 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3baffd640 1 -- 172.21.15.47:0/2180952137 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa3cc004980 con 0x55ccd85dc1b0 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3e866e740 1 -- 172.21.15.47:0/2180952137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3cc0054f0 con 0x55ccd85dc1b0 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.919+0000 7fa3baffd640 1 -- 172.21.15.47:0/2180952137 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa3cc035050 con 0x55ccd85dc1b0 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3e866e740 10 client.16227 fetch_fsmap learned FSMap version 19 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3e866e740 1 -- 172.21.15.47:0/2180952137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ccd89c6a40 con 0x55ccd85dc1b0 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3baffd640 1 -- 172.21.15.47:0/2180952137 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3cc0054f0 con 0x55ccd85dc1b0 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3baffd640 1 -- 172.21.15.47:0/2180952137 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa3cc058070 con 0x55ccd85dc1b0 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3e866e740 10 client.16227 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3e866e740 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3e866e740 20 client.16227 populate_metadata read hostname 'smithi047' 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3e866e740 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ccd85c39f0 0x55ccd89c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3e866e740 4 client.16227 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3e866e740 1 -- 172.21.15.47:0/2180952137 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccd8924df0 con 0x55ccd85c39f0 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.920+0000 7fa3daffd640 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ccd85c39f0 0x55ccd89c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.921+0000 7fa3baffd640 10 client.16227 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.921+0000 7fa3daffd640 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ccd85c39f0 0x55ccd89c9da0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f46cd1e0573484 server_cookie=78f982cf2611c2d1 in_seq=0 out_seq=0 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.921+0000 7fa3baffd640 1 -- 172.21.15.47:0/2180952137 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ccd8924df0 con 0x55ccd85c39f0 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.921+0000 7fa3baffd640 10 client.16227 handle_command_reply: tid=0 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.921+0000 7fa3e866e740 1 client.16227 shutdown 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.921+0000 7fa3e866e740 1 -- 172.21.15.47:0/2180952137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 msgr2=0x55ccd89b7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b7d60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005ab0 tx=0x7fa3cc02a410 comp rx=0 tx=0).stop 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 -- 172.21.15.47:0/2180952137 shutdown_connections 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ccd85c39f0 0x55ccd89c9da0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd8605070 0x55ccd89c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3baffd640 0 client.16227 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 --2- 172.21.15.47:0/2180952137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b7d60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 -- 172.21.15.47:0/2180952137 >> 172.21.15.47:0/2180952137 conn(0x55ccd85f9460 msgr2=0x55ccd89af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 -- 172.21.15.47:0/2180952137 shutdown_connections 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 1 -- 172.21.15.47:0/2180952137 wait complete. 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.922+0000 7fa3e866e740 20 client.16227 trim_cache size 0 max 16384 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3e866e740 1 Processor -- start 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3e866e740 1 -- start start 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85c39f0 0x55ccd89ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3e866e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1af430 con 0x55ccd85dc1b0 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3e866e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1b1c90 con 0x55ccd85e4390 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3e866e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1afa80 con 0x55ccd85c39f0 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58982/0 (socket says 172.21.15.47:58982) 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3daffd640 1 -- 172.21.15.47:0/3942246151 learned_addr learned my addr 172.21.15.47:0/3942246151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85c39f0 0x55ccd89ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.935+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3db7fe640 1 -- 172.21.15.47:0/3942246151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 msgr2=0x55ccd89c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3db7fe640 1 -- 172.21.15.47:0/3942246151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 msgr2=0x55ccd89b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3db7fe640 1 -- 172.21.15.47:0/3942246151 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccd89b9020 con 0x55ccd85c39f0 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3daffd640 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85c39f0 0x55ccd89ae1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc02a930 tx=0x7fa3cc005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec013658d72dc9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3c17fa640 1 -- 172.21.15.47:0/3942246151 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc05e020 con 0x55ccd85c39f0 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3c17fa640 1 -- 172.21.15.47:0/3942246151 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3cc003cd0 con 0x55ccd85c39f0 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.936+0000 7fa3c17fa640 1 -- 172.21.15.47:0/3942246151 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc031c20 con 0x55ccd85c39f0 2024-09-21T01:07:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 -- 172.21.15.47:0/3942246151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85c39f0 msgr2=0x55ccd89ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85c39f0 0x55ccd89ae1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc02a930 tx=0x7fa3cc005fd0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 -- 172.21.15.47:0/3942246151 shutdown_connections 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85e4390 0x55ccd89c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85dc1b0 0x55ccd89b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 --2- 172.21.15.47:0/3942246151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85c39f0 0x55ccd89ae1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 -- 172.21.15.47:0/3942246151 >> 172.21.15.47:0/3942246151 conn(0x55ccd85f9460 msgr2=0x55ccd89b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 -- 172.21.15.47:0/3942246151 shutdown_connections 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 -- 172.21.15.47:0/3942246151 wait complete. 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.937+0000 7fa3e866e740 1 -- start start 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3e866e740 1 Processor -- start 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85c39f0 0x55ccd89cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85dc1b0 0x55ccd89cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3e866e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85e4390 0x55ccd89cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3e866e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1b0150 con 0x55ccd85e4390 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3e866e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1b15c0 con 0x55ccd85c39f0 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3e866e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc1b0820 con 0x55ccd85dc1b0 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3e866e740 10 client.0 _ll_register_callbacks cb 0x7fa3d4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3dbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85e4390 0x55ccd89cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3daffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85dc1b0 0x55ccd89cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3db7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85c39f0 0x55ccd89cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3dbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85e4390 0x55ccd89cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58988/0 (socket says 172.21.15.47:58988) 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.938+0000 7fa3dbfff640 1 -- 172.21.15.47:0/1728486854 learned_addr learned my addr 172.21.15.47:0/1728486854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3dbfff640 1 -- 172.21.15.47:0/1728486854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85dc1b0 msgr2=0x55ccd89cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85dc1b0 0x55ccd89cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3dbfff640 1 -- 172.21.15.47:0/1728486854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85c39f0 msgr2=0x55ccd89cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85c39f0 0x55ccd89cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3dbfff640 1 -- 172.21.15.47:0/1728486854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccd8a33520 con 0x55ccd85e4390 2024-09-21T01:07:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3daffd640 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85dc1b0 0x55ccd89cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85c39f0 0x55ccd89cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3dbfff640 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85e4390 0x55ccd89cb7f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40042e0 tx=0x7fa3d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135d4688d40ed41e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3baffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3baffd640 1 -- 172.21.15.47:0/1728486854 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400fbf0 con 0x55ccd85e4390 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3baffd640 1 -- 172.21.15.47:0/1728486854 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa3d400fd90 con 0x55ccd85e4390 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3e866e740 1 -- 172.21.15.47:0/1728486854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3cc003cd0 con 0x55ccd85e4390 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3baffd640 1 -- 172.21.15.47:0/1728486854 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa3d4004b20 con 0x55ccd85e4390 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3e866e740 10 client.16233 fetch_fsmap learned FSMap version 19 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3e866e740 1 -- 172.21.15.47:0/1728486854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ccd8a347a0 con 0x55ccd85e4390 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.939+0000 7fa3baffd640 1 -- 172.21.15.47:0/1728486854 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3cc003cd0 con 0x55ccd85e4390 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3baffd640 1 -- 172.21.15.47:0/1728486854 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa3d4029400 con 0x55ccd85e4390 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3e866e740 10 client.16233 fetch_fsmap finished waiting for FSMap version 19 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3e866e740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:07:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3e866e740 20 client.16233 populate_metadata read hostname 'smithi047' 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ccd8605070 0x55ccd8a36f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3e866e740 4 client.16233 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3e866e740 1 -- 172.21.15.47:0/1728486854 --> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ccd89208a0 con 0x55ccd8605070 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ccd8605070 0x55ccd8a36f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3baffd640 10 client.16233 ms_handle_connect on v2:172.21.15.114:6838/4124175185 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3db7fe640 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ccd8605070 0x55ccd8a36f80 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b632d21fac39e555 server_cookie=5dde1714c803d1f4 in_seq=0 out_seq=0 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3baffd640 1 -- 172.21.15.47:0/1728486854 <== mds.0 v2:172.21.15.114:6838/4124175185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ccd89208a0 con 0x55ccd8605070 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3baffd640 10 client.16233 handle_command_reply: tid=0 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.940+0000 7fa3e866e740 1 client.16233 shutdown 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 -- 172.21.15.47:0/1728486854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85e4390 msgr2=0x55ccd89cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85e4390 0x55ccd89cb7f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40042e0 tx=0x7fa3d4004a40 comp rx=0 tx=0).stop 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 -- 172.21.15.47:0/1728486854 shutdown_connections 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.114:6838/4124175185,v1:172.21.15.114:6839/4124175185] conn(0x55ccd8605070 0x55ccd8a36f80 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ccd85e4390 0x55ccd89cb7f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ccd85dc1b0 0x55ccd89cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3baffd640 0 client.16233 ms_handle_reset on v2:172.21.15.114:6838/4124175185 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 --2- 172.21.15.47:0/1728486854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ccd85c39f0 0x55ccd89cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 -- 172.21.15.47:0/1728486854 >> 172.21.15.47:0/1728486854 conn(0x55ccd85f9460 msgr2=0x55ccd89b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 -- 172.21.15.47:0/1728486854 shutdown_connections 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 1 -- 172.21.15.47:0/1728486854 wait complete. 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e866e740 20 client.16233 trim_cache size 0 max 16384 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stdout:[] 2024-09-21T01:07:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 -- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa3c40b6510 msgr2=0x7fa3c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa3c40b6510 0x7fa3c40b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005fd0 tx=0x7fa3d4009500 comp rx=0 tx=0).stop 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 -- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc1094c0 msgr2=0x7fa3dc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc1094c0 0x7fa3dc075c50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e9c0 tx=0x7fa3d000ee80 comp rx=0 tx=0).stop 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 -- 172.21.15.47:0/3802939234 shutdown_connections 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa3c40b6510 0x7fa3c40b8a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3dc109e10 0x7fa3dc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3dc1094c0 0x7fa3dc075c50 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.941+0000 7fa3e20fa640 1 --2- 172.21.15.47:0/3802939234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3dc103b80 0x7fa3dc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.942+0000 7fa3e20fa640 1 -- 172.21.15.47:0/3802939234 >> 172.21.15.47:0/3802939234 conn(0x7fa3dc0ff610 msgr2=0x7fa3dc108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.942+0000 7fa3e20fa640 1 -- 172.21.15.47:0/3802939234 shutdown_connections 2024-09-21T01:07:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:07.942+0000 7fa3e20fa640 1 -- 172.21.15.47:0/3802939234 wait complete. 2024-09-21T01:07:08.745 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T01:07:08.746 INFO:tasks.fwd_scrub:done joining 2024-09-21T01:07:08.746 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T01:07:08.757 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:07:08.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 -- 172.21.15.47:0/3626674753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 msgr2=0x7f961010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 --2- 172.21.15.47:0/3626674753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 0x7f961010b8b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9608009ca0 tx=0x7f960802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 -- 172.21.15.47:0/3626674753 shutdown_connections 2024-09-21T01:07:08.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 --2- 172.21.15.47:0/3626674753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 0x7f961010b8b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 --2- 172.21.15.47:0/3626674753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96101068b0 0x7f9610108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 --2- 172.21.15.47:0/3626674753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f961006b190 0x7f9610106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 -- 172.21.15.47:0/3626674753 >> 172.21.15.47:0/3626674753 conn(0x7f96100fdeb0 msgr2=0x7f9610100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:08.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 -- 172.21.15.47:0/3626674753 shutdown_connections 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.877+0000 7f9616fe4640 1 -- 172.21.15.47:0/3626674753 wait complete. 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9616fe4640 1 Processor -- start 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9616fe4640 1 -- start start 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9616fe4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961006b190 0x7f9610199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9616fe4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96101068b0 0x7f961019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9616fe4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 0x7f961019b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9616fe4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f961010f2b0 con 0x7f96101093c0 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9616fe4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f961010f130 con 0x7f96101068b0 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9616fe4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f961010f430 con 0x7f961006b190 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9615581640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 0x7f961019b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9615581640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 0x7f961019b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59006/0 (socket says 172.21.15.47:59006) 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9615581640 1 -- 172.21.15.47:0/316694559 learned_addr learned my addr 172.21.15.47:0/316694559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f9614d80640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961006b190 0x7f9610199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.878+0000 7f960ffff640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96101068b0 0x7f961019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f9615581640 1 -- 172.21.15.47:0/316694559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961006b190 msgr2=0x7f9610199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f9615581640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961006b190 0x7f9610199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f9615581640 1 -- 172.21.15.47:0/316694559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96101068b0 msgr2=0x7f961019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f9615581640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96101068b0 0x7f961019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f9615581640 1 -- 172.21.15.47:0/316694559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961019b8e0 con 0x7f96101093c0 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f9615581640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 0x7f961019b0c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f96080097b0 tx=0x7f9608031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f960dffb640 1 -- 172.21.15.47:0/316694559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608003bf0 con 0x7f96101093c0 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961019bb70 con 0x7f96101093c0 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f960dffb640 1 -- 172.21.15.47:0/316694559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9608003d90 con 0x7f96101093c0 2024-09-21T01:07:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.879+0000 7f960dffb640 1 -- 172.21.15.47:0/316694559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960802fc30 con 0x7f96101093c0 2024-09-21T01:07:08.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.880+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96101a22c0 con 0x7f96101093c0 2024-09-21T01:07:08.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.880+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9610106cc0 con 0x7f96101093c0 2024-09-21T01:07:08.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.882+0000 7f960dffb640 1 -- 172.21.15.47:0/316694559 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9608004040 con 0x7f96101093c0 2024-09-21T01:07:08.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.883+0000 7f960dffb640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f96000b6510 0x7f96000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.883+0000 7f9614d80640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f96000b6510 0x7f96000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.883+0000 7f960dffb640 1 -- 172.21.15.47:0/316694559 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f96081087c0 con 0x7f96101093c0 2024-09-21T01:07:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.884+0000 7f9614d80640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f96000b6510 0x7f96000b8a20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96040095f0 tx=0x7f9604005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:08.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:08.886+0000 7f960dffb640 1 -- 172.21.15.47:0/316694559 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96080cf0f0 con 0x7f96101093c0 2024-09-21T01:07:09.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.076+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f961002e640 con 0x7f96101093c0 2024-09-21T01:07:09.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.077+0000 7f960dffb640 1 -- 172.21.15.47:0/316694559 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22632 (secure 0 0 0) 0x7f96080d34d0 con 0x7f96101093c0 2024-09-21T01:07:09.078 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:07:09.078 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":77,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:57:26.756741+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:07:09.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f96000b6510 msgr2=0x7f96000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f96000b6510 0x7f96000b8a20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96040095f0 tx=0x7f9604005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 msgr2=0x7f961019b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 0x7f961019b0c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f96080097b0 tx=0x7f9608031840 comp rx=0 tx=0).stop 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 shutdown_connections 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f96000b6510 0x7f96000b8a20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96101093c0 0x7f961019b0c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96101068b0 0x7f961019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 --2- 172.21.15.47:0/316694559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f961006b190 0x7f9610199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.079+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 >> 172.21.15.47:0/316694559 conn(0x7f96100fdeb0 msgr2=0x7f9610104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.080+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 shutdown_connections 2024-09-21T01:07:09.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.080+0000 7f9616fe4640 1 -- 172.21.15.47:0/316694559 wait complete. 2024-09-21T01:07:09.092 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T00:52:17.628162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T00:56:45.468079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T00:56:47.230573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:07:09.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T01:07:09.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 -- 172.21.15.47:0/2063817122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 msgr2=0x7f2e34102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 --2- 172.21.15.47:0/2063817122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 0x7f2e34102190 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009900 tx=0x7f2e2402a410 comp rx=0 tx=0).stop 2024-09-21T01:07:09.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 -- 172.21.15.47:0/2063817122 shutdown_connections 2024-09-21T01:07:09.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 --2- 172.21.15.47:0/2063817122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e34103740 0x7f2e3410a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 --2- 172.21.15.47:0/2063817122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e34102da0 0x7f2e341031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 --2- 172.21.15.47:0/2063817122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 0x7f2e34102190 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 -- 172.21.15.47:0/2063817122 >> 172.21.15.47:0/2063817122 conn(0x7f2e340fd660 msgr2=0x7f2e340ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:09.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 -- 172.21.15.47:0/2063817122 shutdown_connections 2024-09-21T01:07:09.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.209+0000 7f2e3a684640 1 -- 172.21.15.47:0/2063817122 wait complete. 2024-09-21T01:07:09.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e3a684640 1 Processor -- start 2024-09-21T01:07:09.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e3a684640 1 -- start start 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e3a684640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 0x7f2e34199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e3a684640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e34102da0 0x7f2e3419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e3a684640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e34103740 0x7f2e3419b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e3a684640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3410d0e0 con 0x7f2e34101d20 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e3a684640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3410cf60 con 0x7f2e34103740 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e3a684640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3410d260 con 0x7f2e34102da0 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e33fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 0x7f2e34199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e33fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 0x7f2e34199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59020/0 (socket says 172.21.15.47:59020) 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e33fff640 1 -- 172.21.15.47:0/3039270020 learned_addr learned my addr 172.21.15.47:0/3039270020 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e337fe640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e34102da0 0x7f2e3419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e38c21640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e34103740 0x7f2e3419b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e33fff640 1 -- 172.21.15.47:0/3039270020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e34102da0 msgr2=0x7f2e3419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e33fff640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e34102da0 0x7f2e3419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e33fff640 1 -- 172.21.15.47:0/3039270020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e34103740 msgr2=0x7f2e3419b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e33fff640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e34103740 0x7f2e3419b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.210+0000 7f2e33fff640 1 -- 172.21.15.47:0/3039270020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3419b930 con 0x7f2e34101d20 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.211+0000 7f2e33fff640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 0x7f2e34199ef0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2e24006010 tx=0x7f2e240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.211+0000 7f2e317fa640 1 -- 172.21.15.47:0/3039270020 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2403f030 con 0x7f2e34101d20 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.211+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3419bbc0 con 0x7f2e34101d20 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.211+0000 7f2e317fa640 1 -- 172.21.15.47:0/3039270020 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e24032e50 con 0x7f2e34101d20 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.211+0000 7f2e317fa640 1 -- 172.21.15.47:0/3039270020 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24035070 con 0x7f2e34101d20 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.211+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3419bed0 con 0x7f2e34101d20 2024-09-21T01:07:09.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.212+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e34108ef0 con 0x7f2e34101d20 2024-09-21T01:07:09.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.214+0000 7f2e317fa640 1 -- 172.21.15.47:0/3039270020 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2e24042030 con 0x7f2e34101d20 2024-09-21T01:07:09.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.214+0000 7f2e317fa640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2e1c0b6510 0x7f2e1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.215+0000 7f2e337fe640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2e1c0b6510 0x7f2e1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.215+0000 7f2e317fa640 1 -- 172.21.15.47:0/3039270020 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f2e24107d90 con 0x7f2e34101d20 2024-09-21T01:07:09.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.215+0000 7f2e337fe640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2e1c0b6510 0x7f2e1c0b8a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009bd0 tx=0x7f2e28005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:09.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.218+0000 7f2e317fa640 1 -- 172.21.15.47:0/3039270020 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e240d2aa0 con 0x7f2e34101d20 2024-09-21T01:07:09.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:09 smithi134 ceph-mon[34785]: pgmap v598: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T01:07:09.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.404+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2e3402e640 con 0x7f2e34101d20 2024-09-21T01:07:09.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.404+0000 7f2e317fa640 1 -- 172.21.15.47:0/3039270020 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f2e240d5e20 con 0x7f2e34101d20 2024-09-21T01:07:09.405 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-09-21T01:07:09.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2e1c0b6510 msgr2=0x7f2e1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2e1c0b6510 0x7f2e1c0b8a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009bd0 tx=0x7f2e28005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:09.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 msgr2=0x7f2e34199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 0x7f2e34199ef0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2e24006010 tx=0x7f2e240042f0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 shutdown_connections 2024-09-21T01:07:09.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f2e1c0b6510 0x7f2e1c0b8a20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e34103740 0x7f2e3419b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e34102da0 0x7f2e3419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 --2- 172.21.15.47:0/3039270020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e34101d20 0x7f2e34199ef0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 >> 172.21.15.47:0/3039270020 conn(0x7f2e340fd660 msgr2=0x7f2e341060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:09.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 shutdown_connections 2024-09-21T01:07:09.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.406+0000 7f2e3a684640 1 -- 172.21.15.47:0/3039270020 wait complete. 2024-09-21T01:07:09.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:09 smithi114 ceph-mon[34309]: pgmap v598: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T01:07:09.417 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:09 smithi047 ceph-mon[30960]: pgmap v598: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T01:07:09.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T01:07:09.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 -- 172.21.15.47:0/3120307854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 msgr2=0x7f5f301031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 --2- 172.21.15.47:0/3120307854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 0x7f5f301031c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800aa10 tx=0x7f5f1802b720 comp rx=0 tx=0).stop 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 -- 172.21.15.47:0/3120307854 shutdown_connections 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 --2- 172.21.15.47:0/3120307854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f30103750 0x7f5f3010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 --2- 172.21.15.47:0/3120307854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 0x7f5f301031c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 --2- 172.21.15.47:0/3120307854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f30101d30 0x7f5f301021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 -- 172.21.15.47:0/3120307854 >> 172.21.15.47:0/3120307854 conn(0x7f5f300fd690 msgr2=0x7f5f300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 -- 172.21.15.47:0/3120307854 shutdown_connections 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.534+0000 7f5f356a9640 1 -- 172.21.15.47:0/3120307854 wait complete. 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f356a9640 1 Processor -- start 2024-09-21T01:07:09.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f356a9640 1 -- start start 2024-09-21T01:07:09.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f356a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f30101d30 0x7f5f30199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f356a9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 0x7f5f3019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f356a9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f30103750 0x7f5f3019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f356a9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3010d0f0 con 0x7f5f30102db0 2024-09-21T01:07:09.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f356a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3010cf70 con 0x7f5f30101d30 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f356a9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3010d270 con 0x7f5f30103750 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f267fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 0x7f5f3019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f267fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 0x7f5f3019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59036/0 (socket says 172.21.15.47:59036) 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f267fc640 1 -- 172.21.15.47:0/2123724660 learned_addr learned my addr 172.21.15.47:0/2123724660 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f2effd640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f30101d30 0x7f5f30199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.535+0000 7f5f2f7fe640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f30103750 0x7f5f3019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f267fc640 1 -- 172.21.15.47:0/2123724660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f30103750 msgr2=0x7f5f3019b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f267fc640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f30103750 0x7f5f3019b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f267fc640 1 -- 172.21.15.47:0/2123724660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f30101d30 msgr2=0x7f5f30199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f267fc640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f30101d30 0x7f5f30199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f267fc640 1 -- 172.21.15.47:0/2123724660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3019b990 con 0x7f5f30102db0 2024-09-21T01:07:09.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f2effd640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f30101d30 0x7f5f30199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f267fc640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 0x7f5f3019a5c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004770 tx=0x7f5f180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f2cff9640 1 -- 172.21.15.47:0/2123724660 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1803f070 con 0x7f5f30102db0 2024-09-21T01:07:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f2cff9640 1 -- 172.21.15.47:0/2123724660 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f18032400 con 0x7f5f30102db0 2024-09-21T01:07:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3019bc20 con 0x7f5f30102db0 2024-09-21T01:07:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f2cff9640 1 -- 172.21.15.47:0/2123724660 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f18036040 con 0x7f5f30102db0 2024-09-21T01:07:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.536+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f301a2370 con 0x7f5f30102db0 2024-09-21T01:07:09.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.537+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f301021a0 con 0x7f5f30102db0 2024-09-21T01:07:09.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.539+0000 7f5f2cff9640 1 -- 172.21.15.47:0/2123724660 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5f18042070 con 0x7f5f30102db0 2024-09-21T01:07:09.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.539+0000 7f5f2cff9640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5f1c0b6590 0x7f5f1c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.540+0000 7f5f2cff9640 1 -- 172.21.15.47:0/2123724660 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f5f18107f80 con 0x7f5f30102db0 2024-09-21T01:07:09.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.540+0000 7f5f2effd640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5f1c0b6590 0x7f5f1c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.540+0000 7f5f2effd640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5f1c0b6590 0x7f5f1c0b8aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009fc0 tx=0x7f5f20005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:09.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.543+0000 7f5f2cff9640 1 -- 172.21.15.47:0/2123724660 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f180d2c90 con 0x7f5f30102db0 2024-09-21T01:07:09.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.733+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5f30063fc0 con 0x7f5f30102db0 2024-09-21T01:07:09.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.733+0000 7f5f2cff9640 1 -- 172.21.15.47:0/2123724660 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f5f180d7bd0 con 0x7f5f30102db0 2024-09-21T01:07:09.734 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.735+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5f1c0b6590 msgr2=0x7f5f1c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.735+0000 7f5f356a9640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5f1c0b6590 0x7f5f1c0b8aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009fc0 tx=0x7f5f20005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.735+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 msgr2=0x7f5f3019a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.735+0000 7f5f356a9640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 0x7f5f3019a5c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004770 tx=0x7f5f180042f0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.736+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 shutdown_connections 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.736+0000 7f5f356a9640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f5f1c0b6590 0x7f5f1c0b8aa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.736+0000 7f5f356a9640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f30103750 0x7f5f3019b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.736+0000 7f5f356a9640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f30102db0 0x7f5f3019a5c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.736+0000 7f5f356a9640 1 --2- 172.21.15.47:0/2123724660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f30101d30 0x7f5f30199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.736+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 >> 172.21.15.47:0/2123724660 conn(0x7f5f300fd690 msgr2=0x7f5f301060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:09.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.736+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 shutdown_connections 2024-09-21T01:07:09.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.736+0000 7f5f356a9640 1 -- 172.21.15.47:0/2123724660 wait complete. 2024-09-21T01:07:09.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T01:07:09.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 -- 172.21.15.47:0/1984563826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4103fa0 msgr2=0x7fdec410a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 --2- 172.21.15.47:0/1984563826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4103fa0 0x7fdec410a940 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009900 tx=0x7fdebc02a410 comp rx=0 tx=0).stop 2024-09-21T01:07:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 -- 172.21.15.47:0/1984563826 shutdown_connections 2024-09-21T01:07:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 --2- 172.21.15.47:0/1984563826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4103fa0 0x7fdec410a940 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 --2- 172.21.15.47:0/1984563826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4103600 0x7fdec4103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 --2- 172.21.15.47:0/1984563826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec4102580 0x7fdec41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 -- 172.21.15.47:0/1984563826 >> 172.21.15.47:0/1984563826 conn(0x7fdec40fdee0 msgr2=0x7fdec4100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 -- 172.21.15.47:0/1984563826 shutdown_connections 2024-09-21T01:07:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.866+0000 7fdecb162640 1 -- 172.21.15.47:0/1984563826 wait complete. 2024-09-21T01:07:09.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdecb162640 1 Processor -- start 2024-09-21T01:07:09.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdecb162640 1 -- start start 2024-09-21T01:07:09.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdecb162640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4102580 0x7fdec4199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdecb162640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4103600 0x7fdec419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdecb162640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec4103fa0 0x7fdec419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdecb162640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdec410e1e0 con 0x7fdec4102580 2024-09-21T01:07:09.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdecb162640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdec410e060 con 0x7fdec4103fa0 2024-09-21T01:07:09.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdecb162640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdec410e360 con 0x7fdec4103600 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdec8efe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4102580 0x7fdec4199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdec8efe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4102580 0x7fdec4199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59060/0 (socket says 172.21.15.47:59060) 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdec8efe640 1 -- 172.21.15.47:0/1824672438 learned_addr learned my addr 172.21.15.47:0/1824672438 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdec96ff640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec4103fa0 0x7fdec419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.867+0000 7fdec3fff640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4103600 0x7fdec419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec8efe640 1 -- 172.21.15.47:0/1824672438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4103600 msgr2=0x7fdec419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec8efe640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4103600 0x7fdec419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec8efe640 1 -- 172.21.15.47:0/1824672438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec4103fa0 msgr2=0x7fdec419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec8efe640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec4103fa0 0x7fdec419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec8efe640 1 -- 172.21.15.47:0/1824672438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec419b8f0 con 0x7fdec4102580 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec3fff640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4103600 0x7fdec419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec8efe640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4102580 0x7fdec4199eb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400ea60 tx=0x7fdeb400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:09.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec1ffb640 1 -- 172.21.15.47:0/1824672438 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb400cde0 con 0x7fdec4102580 2024-09-21T01:07:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec419bbe0 con 0x7fdec4102580 2024-09-21T01:07:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec1ffb640 1 -- 172.21.15.47:0/1824672438 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeb40035f0 con 0x7fdec4102580 2024-09-21T01:07:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdec1ffb640 1 -- 172.21.15.47:0/1824672438 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4010690 con 0x7fdec4102580 2024-09-21T01:07:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.868+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec41a22d0 con 0x7fdec4102580 2024-09-21T01:07:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.869+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec41a24a0 con 0x7fdec4102580 2024-09-21T01:07:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.871+0000 7fdec1ffb640 1 -- 172.21.15.47:0/1824672438 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdeb40037a0 con 0x7fdec4102580 2024-09-21T01:07:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.871+0000 7fdec1ffb640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdeb00b6510 0x7fdeb00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.871+0000 7fdec3fff640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdeb00b6510 0x7fdeb00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.872+0000 7fdec1ffb640 1 -- 172.21.15.47:0/1824672438 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fdeb40e77f0 con 0x7fdec4102580 2024-09-21T01:07:09.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.872+0000 7fdec3fff640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdeb00b6510 0x7fdeb00b8a20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdeac005fd0 tx=0x7fdeac009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:09.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:09.874+0000 7fdec1ffb640 1 -- 172.21.15.47:0/1824672438 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdeb4056710 con 0x7fdec4102580 2024-09-21T01:07:10.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.062+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdec41a2670 con 0x7fdec4102580 2024-09-21T01:07:10.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.063+0000 7fdec1ffb640 1 -- 172.21.15.47:0/1824672438 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7fdeb40ae120 con 0x7fdec4102580 2024-09-21T01:07:10.064 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-09-21T01:07:10.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdeb00b6510 msgr2=0x7fdeb00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:10.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdeb00b6510 0x7fdeb00b8a20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdeac005fd0 tx=0x7fdeac009500 comp rx=0 tx=0).stop 2024-09-21T01:07:10.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4102580 msgr2=0x7fdec4199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:10.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4102580 0x7fdec4199eb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400ea60 tx=0x7fdeb400ef20 comp rx=0 tx=0).stop 2024-09-21T01:07:10.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 shutdown_connections 2024-09-21T01:07:10.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fdeb00b6510 0x7fdeb00b8a20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec4103fa0 0x7fdec419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4103600 0x7fdec419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 --2- 172.21.15.47:0/1824672438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec4102580 0x7fdec4199eb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 >> 172.21.15.47:0/1824672438 conn(0x7fdec40fdee0 msgr2=0x7fdec40ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 shutdown_connections 2024-09-21T01:07:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.065+0000 7fdecb162640 1 -- 172.21.15.47:0/1824672438 wait complete. 2024-09-21T01:07:10.078 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T01:07:10.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 -- 172.21.15.47:0/3539755138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e81050a0 msgr2=0x7fa9e810ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:10.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 --2- 172.21.15.47:0/3539755138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e81050a0 0x7fa9e810ba40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009ca0 tx=0x7fa9e002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 -- 172.21.15.47:0/3539755138 shutdown_connections 2024-09-21T01:07:10.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 --2- 172.21.15.47:0/3539755138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e81050a0 0x7fa9e810ba40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 --2- 172.21.15.47:0/3539755138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e8104700 0x7fa9e8104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 --2- 172.21.15.47:0/3539755138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9e8103680 0x7fa9e8103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 -- 172.21.15.47:0/3539755138 >> 172.21.15.47:0/3539755138 conn(0x7fa9e80fefe0 msgr2=0x7fa9e8101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:10.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 -- 172.21.15.47:0/3539755138 shutdown_connections 2024-09-21T01:07:10.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.191+0000 7fa9ef962640 1 -- 172.21.15.47:0/3539755138 wait complete. 2024-09-21T01:07:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ef962640 1 Processor -- start 2024-09-21T01:07:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ef962640 1 -- start start 2024-09-21T01:07:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ef962640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e8103680 0x7fa9e819c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ef962640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e8104700 0x7fa9e819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ef962640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9e81050a0 0x7fa9e819d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ef962640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e810f2b0 con 0x7fa9e8104700 2024-09-21T01:07:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ef962640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e810f130 con 0x7fa9e81050a0 2024-09-21T01:07:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ef962640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e810f430 con 0x7fa9e8103680 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ecefd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e8104700 0x7fa9e819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ecefd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e8104700 0x7fa9e819c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59092/0 (socket says 172.21.15.47:59092) 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ecefd640 1 -- 172.21.15.47:0/2734172611 learned_addr learned my addr 172.21.15.47:0/2734172611 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9ed6fe640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e8103680 0x7fa9e819c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.192+0000 7fa9edeff640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9e81050a0 0x7fa9e819d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9ecefd640 1 -- 172.21.15.47:0/2734172611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e8103680 msgr2=0x7fa9e819c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9ecefd640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e8103680 0x7fa9e819c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9ecefd640 1 -- 172.21.15.47:0/2734172611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9e81050a0 msgr2=0x7fa9e819d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9ecefd640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9e81050a0 0x7fa9e819d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9ecefd640 1 -- 172.21.15.47:0/2734172611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e819daf0 con 0x7fa9e8104700 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9edeff640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9e81050a0 0x7fa9e819d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9ecefd640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e8104700 0x7fa9e819c720 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800d950 tx=0x7fa9d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9de7fc640 1 -- 172.21.15.47:0/2734172611 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8017070 con 0x7fa9e8104700 2024-09-21T01:07:10.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9de7fc640 1 -- 172.21.15.47:0/2734172611 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d8009c30 con 0x7fa9e8104700 2024-09-21T01:07:10.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9de7fc640 1 -- 172.21.15.47:0/2734172611 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800f620 con 0x7fa9e8104700 2024-09-21T01:07:10.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e819dde0 con 0x7fa9e8104700 2024-09-21T01:07:10.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.193+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e81a44d0 con 0x7fa9e8104700 2024-09-21T01:07:10.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.194+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e81a46a0 con 0x7fa9e8104700 2024-09-21T01:07:10.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.196+0000 7fa9de7fc640 1 -- 172.21.15.47:0/2734172611 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa9d8010460 con 0x7fa9e8104700 2024-09-21T01:07:10.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.197+0000 7fa9de7fc640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa9d40b6510 0x7fa9d40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:10.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.197+0000 7fa9ed6fe640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa9d40b6510 0x7fa9d40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:10.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.197+0000 7fa9de7fc640 1 -- 172.21.15.47:0/2734172611 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fa9d80e6ea0 con 0x7fa9e8104700 2024-09-21T01:07:10.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.197+0000 7fa9ed6fe640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa9d40b6510 0x7fa9d40b8a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4005d00 tx=0x7fa9e400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:10.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.200+0000 7fa9de7fc640 1 -- 172.21.15.47:0/2734172611 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9d80ad730 con 0x7fa9e8104700 2024-09-21T01:07:10.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:10 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/316694559' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:07:10.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:10 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3039270020' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:07:10.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:10 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2123724660' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:07:10.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:10 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/316694559' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:07:10.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:10 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3039270020' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:07:10.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:10 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2123724660' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:07:10.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.443+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fa9e81a4870 con 0x7fa9e8104700 2024-09-21T01:07:10.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.452+0000 7fa9de7fc640 1 -- 172.21.15.47:0/2734172611 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v19) ==== 81+0+833521 (secure 0 0 0) 0x7fa9d8009de0 con 0x7fa9e8104700 2024-09-21T01:07:10.460 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:07:10.460 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:07:10.460 INFO:teuthology.orchestra.run.smithi047.stdout: "epoch": 19, 2024-09-21T01:07:10.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.460 INFO:teuthology.orchestra.run.smithi047.stdout: "active_gid": 14152, 2024-09-21T01:07:10.460 INFO:teuthology.orchestra.run.smithi047.stdout: "active_name": "x", 2024-09-21T01:07:10.460 INFO:teuthology.orchestra.run.smithi047.stdout: "active_addrs": { 2024-09-21T01:07:10.460 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:6800", 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2364161608 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:6801", 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2364161608 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: "active_addr": "172.21.15.47:6801/2364161608", 2024-09-21T01:07:10.461 INFO:teuthology.orchestra.run.smithi047.stdout: "active_change": "2024-09-21T00:49:25.158032+0000", 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "available": true, 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "standbys": [ 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "gid": 24124, 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "z", 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.462 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.464 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.465 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.466 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.467 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.468 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.469 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.470 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.471 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.472 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-09-21T01:07:10.473 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.474 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.475 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.476 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-09-21T01:07:10.478 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:07:10.480 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:07:10.481 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:07:10.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.484 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.485 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-09-21T01:07:10.486 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.487 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.488 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.489 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.490 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.491 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.492 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-09-21T01:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.494 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.495 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.496 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.497 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.498 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.499 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-09-21T01:07:10.500 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.501 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.502 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.504 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.506 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.507 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-09-21T01:07:10.508 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-09-21T01:07:10.509 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-09-21T01:07:10.510 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-09-21T01:07:10.511 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-09-21T01:07:10.512 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.513 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.514 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.517 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.518 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.520 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.521 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.522 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.523 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.524 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.525 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.526 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.527 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba_metrics": { 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.528 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.529 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.530 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:10.531 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-09-21T01:07:10.532 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-09-21T01:07:10.533 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.534 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.536 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.537 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-09-21T01:07:10.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-09-21T01:07:10.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-09-21T01:07:10.540 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.541 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.542 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.545 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.546 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.547 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.548 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.549 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-09-21T01:07:10.550 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-09-21T01:07:10.551 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-09-21T01:07:10.552 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.553 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:07:10.554 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:07:10.555 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.556 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:07:10.558 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.560 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.562 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_keepalive_interval": { 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:07:10.565 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.566 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.567 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.568 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.569 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.572 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.574 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-09-21T01:07:10.576 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.577 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-09-21T01:07:10.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.580 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.582 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.583 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.584 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.585 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.586 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.587 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.588 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.590 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.591 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.592 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.593 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.594 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.595 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.597 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.598 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.599 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.601 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-09-21T01:07:10.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.604 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.606 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.607 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.608 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.609 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.610 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.611 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.612 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.614 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.616 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.617 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.618 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:10.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.620 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.621 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.622 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.623 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:07:10.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:07:10.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-09-21T01:07:10.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-09-21T01:07:10.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-09-21T01:07:10.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-09-21T01:07:10.629 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-09-21T01:07:10.630 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.631 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.632 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.633 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.634 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.635 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.641 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.643 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "sso_oauth2": { 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sso_oauth2", 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.644 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-09-21T01:07:10.645 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-09-21T01:07:10.646 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.647 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-09-21T01:07:10.648 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-09-21T01:07:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.650 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.652 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.653 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-09-21T01:07:10.655 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-09-21T01:07:10.656 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-09-21T01:07:10.657 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-09-21T01:07:10.658 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.659 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.661 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.661 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:07:10.661 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.661 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.662 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.663 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.664 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.666 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.667 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.670 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.671 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.672 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.674 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.676 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-09-21T01:07:10.677 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.678 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.679 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.680 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.681 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.682 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.683 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.684 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.685 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-09-21T01:07:10.686 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.687 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.688 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.689 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.690 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.691 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.693 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.694 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.696 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.698 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.700 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.701 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.703 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-09-21T01:07:10.704 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.705 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.706 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.708 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.709 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.710 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.713 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.714 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.715 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.716 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.717 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.718 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.719 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-09-21T01:07:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-09-21T01:07:10.721 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.722 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.723 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.724 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.725 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.726 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.727 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.729 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.731 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.732 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.733 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.735 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.736 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.737 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.738 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.739 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.740 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.741 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.742 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.743 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.744 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.745 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.746 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.747 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.748 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.749 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.750 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-09-21T01:07:10.751 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-09-21T01:07:10.752 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.753 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.754 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.755 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.756 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.757 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.758 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.759 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.760 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.761 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.762 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.763 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.765 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.766 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.767 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.768 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.769 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.770 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.771 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.772 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.773 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.774 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.775 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.776 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.777 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.779 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.780 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.783 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.784 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.785 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:10.787 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.788 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.790 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.791 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.792 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.793 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.794 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.795 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.796 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.798 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-09-21T01:07:10.799 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.800 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.801 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.802 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.803 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.804 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-09-21T01:07:10.805 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.807 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.808 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.809 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.810 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.811 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.812 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.813 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.816 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.817 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.818 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.819 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.820 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.821 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "max_requests": { 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_requests", 2024-09-21T01:07:10.823 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:10.824 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:10.825 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.826 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.827 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.828 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.829 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.830 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.831 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.832 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.833 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.835 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.836 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.837 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.838 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.839 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.841 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.845 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.846 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.847 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.850 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.853 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.854 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.855 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.856 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.857 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.858 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.859 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.861 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.863 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.863 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.866 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.867 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.868 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.869 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.872 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.873 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.874 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.875 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.876 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.877 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.878 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.879 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.880 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.882 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.884 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.885 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.886 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.887 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.888 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.889 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.890 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.891 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.892 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.893 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.895 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.896 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.897 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.900 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.901 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.902 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-09-21T01:07:10.903 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.905 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.908 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.909 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.911 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.912 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.917 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.918 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.919 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.920 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.921 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.922 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.923 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.924 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.926 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.927 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.928 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.929 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-09-21T01:07:10.932 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.933 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.935 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.936 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.937 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.939 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.940 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:07:10.941 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.942 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.943 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.944 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.946 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.947 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.949 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.950 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.951 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-09-21T01:07:10.952 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-09-21T01:07:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "gid": 24134, 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "y", 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-09-21T01:07:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:07:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-09-21T01:07:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-09-21T01:07:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-09-21T01:07:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-09-21T01:07:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-09-21T01:07:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-09-21T01:07:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:07:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-09-21T01:07:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-09-21T01:07:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba_metrics": { 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:07:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-09-21T01:07:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-09-21T01:07:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-09-21T01:07:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-09-21T01:07:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:07:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:07:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_keepalive_interval": { 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:07:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:07:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.085 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.086 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.087 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.088 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.089 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.090 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.092 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.093 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.094 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.095 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.097 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.098 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.099 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.100 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.101 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:07:11.102 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.104 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.105 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.106 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.107 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.108 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.109 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.110 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.111 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.112 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.113 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.114 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.116 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.117 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.118 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.119 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.120 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.121 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.122 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.123 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.124 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.125 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.126 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.127 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.128 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.129 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.130 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.131 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.132 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.133 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-09-21T01:07:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.135 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.136 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.137 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.138 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "sso_oauth2": { 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sso_oauth2", 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.139 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.140 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.141 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.143 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.144 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.145 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.146 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.147 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.148 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.149 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.150 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.151 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.152 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-09-21T01:07:11.153 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-09-21T01:07:11.154 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.155 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.156 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-09-21T01:07:11.157 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.159 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.160 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.161 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.162 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.163 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.164 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.165 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.166 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.167 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-09-21T01:07:11.168 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.170 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.173 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.174 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.175 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.178 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.180 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.181 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.182 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:07:11.183 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:07:11.184 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.186 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.187 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.188 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.189 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.190 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.192 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.193 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.194 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.195 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.196 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.197 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.198 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.201 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.202 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.203 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.206 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.207 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.208 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.209 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.210 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.211 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.212 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.213 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.214 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-09-21T01:07:11.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-09-21T01:07:11.216 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-09-21T01:07:11.218 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.220 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.222 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.223 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.224 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.225 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.226 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.227 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.228 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.229 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.230 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.231 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.232 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.233 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.236 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.237 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.238 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.239 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.241 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.242 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.243 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.244 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.245 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-09-21T01:07:11.246 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.247 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.248 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.249 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.250 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.251 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.252 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.253 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.255 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.257 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.258 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.259 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.260 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.261 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.262 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.263 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.264 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.265 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.266 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.267 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.268 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-09-21T01:07:11.269 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:07:11.270 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-09-21T01:07:11.271 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.272 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.273 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.274 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.275 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.278 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.279 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.282 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.283 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.284 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.285 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.286 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.287 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.288 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.289 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.290 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.291 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.292 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.293 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-09-21T01:07:11.294 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.296 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.297 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.299 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.300 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.301 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.303 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.307 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.308 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.309 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.310 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.311 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.313 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.314 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "max_requests": { 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_requests", 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.315 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.316 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.317 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.318 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.320 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.321 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.322 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.323 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.324 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.325 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.326 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.327 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.328 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.330 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.331 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.332 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.333 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:07:11.334 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.335 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.336 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.337 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.338 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.342 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.344 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.345 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.346 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.347 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.348 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.349 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.350 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.351 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.352 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.353 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-09-21T01:07:11.354 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:07:11.355 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.356 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.357 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.358 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.359 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.360 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.361 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.362 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.363 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.364 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.365 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.366 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.367 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.368 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.369 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.370 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.371 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.372 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.373 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.374 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.375 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.376 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.377 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.378 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.379 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.380 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.381 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.382 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.386 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.387 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.388 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.389 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.390 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.391 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.392 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.393 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.394 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.395 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.396 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.397 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.398 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.399 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.400 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.401 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.402 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-09-21T01:07:11.403 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.404 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-09-21T01:07:11.405 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-09-21T01:07:11.406 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.407 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.408 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.409 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.410 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.411 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.412 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.414 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.415 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.416 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.417 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.418 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.419 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.420 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.421 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.422 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.423 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.424 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.425 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.427 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.428 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.429 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-09-21T01:07:11.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.431 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:07:11.432 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:07:11.433 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.434 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.436 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.437 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.438 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.439 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.440 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.442 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.443 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.444 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.445 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.446 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:07:11.447 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.448 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.448 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.448 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.448 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.448 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:10 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/316694559' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:07:11.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:10 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3039270020' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:07:11.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:10 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2123724660' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:07:11.452 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:11 smithi114 ceph-mon[34309]: pgmap v599: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T01:07:11.452 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:11 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1824672438' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:07:11.452 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:11 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2734172611' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:07:11.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:11 smithi134 ceph-mon[34785]: pgmap v599: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T01:07:11.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:11 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1824672438' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:07:11.452 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:11 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2734172611' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:07:11.452 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: "modules": [ 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: "dashboard", 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: "iostat", 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: "nfs", 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: "restful" 2024-09-21T01:07:11.453 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "available_modules": [ 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "alerts", 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:11.454 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.455 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.456 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.457 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.458 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.460 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_destination": { 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_destination", 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_from_name": { 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_from_name", 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "Ceph", 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Email From: name", 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.462 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_host": { 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_host", 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP server", 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.463 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_password": { 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_password", 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Password to authenticate with", 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.464 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_port": { 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_port", 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "465", 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP port", 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_sender": { 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_sender", 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:07:11.466 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_ssl": { 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_ssl", 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.467 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "smtp_user": { 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smtp_user", 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.468 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "User to authenticate as", 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.469 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "balancer", 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "active": { 2024-09-21T01:07:11.470 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "active", 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.471 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_time": { 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_time", 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0000", 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "begin_weekday": { 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "begin_weekday", 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.473 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_max_iterations": { 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "25", 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "250", 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.474 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_metrics": { 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_metrics", 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:07:11.475 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "crush_compat_step": { 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crush_compat_step", 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.5", 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0.001", 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "0.999", 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:07:11.476 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "end_time": { 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_time", 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2359", 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:07:11.477 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "end_weekday": { 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "end_weekday", 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "0", 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "6", 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:07:11.478 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.479 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.483 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "min_score": { 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_score", 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.484 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "upmap", 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.485 INFO:teuthology.orchestra.run.smithi047.stdout: "crush-compat", 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "none", 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "read", 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap", 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap-read" 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Balancer mode", 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_ids": { 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_ids", 2024-09-21T01:07:11.486 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.488 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_deviation": { 2024-09-21T01:07:11.489 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_deviation", 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "upmap_max_optimizations": { 2024-09-21T01:07:11.490 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm", 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_down_multiplier": { 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_down_multiplier", 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_refresh_rate": { 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_refresh_rate", 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "20", 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.493 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "agent_starting_port": { 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "agent_starting_port", 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4721", 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.494 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_ptrace": { 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_ptrace", 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.495 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_interval": { 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_interval", 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.496 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0.7", 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.497 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm_log_destination": { 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephadm_log_destination", 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.498 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "file", 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "file,syslog", 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "syslog" 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "cgroups_split": { 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cgroups_split", 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.499 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "config_checks_enabled": { 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_checks_enabled", 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.500 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "config_dashboard": { 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_dashboard", 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.501 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_alertmanager": { 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_alertmanager", 2024-09-21T01:07:11.502 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_base": { 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_base", 2024-09-21T01:07:11.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_elasticsearch": { 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:07:11.504 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "elasticsearch container image", 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_grafana": { 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_grafana", 2024-09-21T01:07:11.505 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_haproxy": { 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_haproxy", 2024-09-21T01:07:11.506 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "HAproxy container image", 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_agent": { 2024-09-21T01:07:11.507 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_collector": { 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:07:11.508 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_jaeger_query": { 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:07:11.509 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Jaeger query container image", 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_keepalived": { 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_keepalived", 2024-09-21T01:07:11.510 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Keepalived container image", 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_loki": { 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_loki", 2024-09-21T01:07:11.511 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Loki container image", 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nginx": { 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nginx", 2024-09-21T01:07:11.512 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nginx container image", 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_node_exporter": { 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_node_exporter", 2024-09-21T01:07:11.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_nvmeof": { 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_nvmeof", 2024-09-21T01:07:11.514 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Nvme-of container image", 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:07:11.515 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_prometheus": { 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_prometheus", 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Prometheus container image", 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_promtail": { 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_promtail", 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Promtail container image", 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.518 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba": { 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba", 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_samba_metrics": { 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "container_image_snmp_gateway": { 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.521 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "container_init": { 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "container_init", 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.522 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "daemon_cache_timeout": { 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.523 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "900", 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.524 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "default_registry": { 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "default_registry", 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "docker.io", 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "device_cache_timeout": { 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_cache_timeout", 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1800", 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.526 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "device_enhanced_scan": { 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_enhanced_scan", 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.527 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "facts_cache_timeout": { 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "facts_cache_timeout", 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.528 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "grafana_dashboards_path": { 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.529 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "host_check_interval": { 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "host_check_interval", 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.530 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "hw_monitoring": { 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hw_monitoring", 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "inventory_list_all": { 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "inventory_list_all", 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:07:11.532 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.533 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "log_refresh_metadata": { 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_refresh_metadata", 2024-09-21T01:07:11.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.536 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.537 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.538 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.539 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "*", 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.540 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "max_count_per_host": { 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_count_per_host", 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.541 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "max_osd_draining_count": { 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_osd_draining_count", 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.542 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "migration_current": { 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "migration_current", 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.543 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "internal - do not modify", 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "mode": { 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mode", 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "root", 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.544 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm-package", 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "root" 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "oob_default_addr": { 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "oob_default_addr", 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.545 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "169.254.1.1", 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "prometheus_alerts_path": { 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.546 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_insecure": { 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_insecure", 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.547 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_password": { 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_password", 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.548 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_url": { 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_url", 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.549 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "registry_username": { 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "registry_username", 2024-09-21T01:07:11.550 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.551 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "secure_monitoring_stack": { 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.552 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "service_discovery_port": { 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "service_discovery_port", 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.553 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8765", 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.554 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_config_file": { 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_config_file", 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:07:11.556 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-09-21T01:07:11.557 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "ssh_keepalive_interval": { 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.558 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.559 INFO:teuthology.orchestra.run.smithi047.stdout: "use_agent": { 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_agent", 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.560 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "use_repo_digest": { 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "use_repo_digest", 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.562 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.562 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:07:11.562 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.562 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_failed_host_check": { 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.563 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_daemons": { 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.564 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_on_stray_hosts": { 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:07:11.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crash", 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.567 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.568 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.569 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.570 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "retain_interval": { 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retain_interval", 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "31536000", 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.573 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_recent_interval": { 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_recent_interval", 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1209600", 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dashboard", 2024-09-21T01:07:11.575 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.576 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.578 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.579 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.580 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.581 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.582 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.583 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.584 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.585 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.586 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.587 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.588 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.589 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.590 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.591 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_URL": { 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.592 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.593 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.594 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.595 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.596 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.597 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.598 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "[]", 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:07:11.599 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "{}", 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:07:11.600 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:07:11.601 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.602 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.603 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.604 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.605 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8", 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.613 INFO:teuthology.orchestra.run.smithi047.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "45", 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "admin", 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.618 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.619 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.620 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.621 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.622 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "cross_origin_url": { 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cross_origin_url", 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.623 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "crt_file": { 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "crt_file", 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.624 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "debug": { 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "debug", 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.625 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "jwt_token_ttl": { 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "jwt_token_ttl", 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "28800", 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.627 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.628 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.629 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.631 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.632 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "motd": { 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "motd", 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "The message of the day", 2024-09-21T01:07:11.633 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.634 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8080", 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.636 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.637 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.638 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl_server_port": { 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl_server_port", 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8443", 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.639 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "sso_oauth2": { 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sso_oauth2", 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.640 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "redirect", 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.641 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "redirect" 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.642 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "url_prefix": { 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url_prefix", 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.643 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.644 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_monitoring": { 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_monitoring", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "monitor device health metrics", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.645 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.646 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.649 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.650 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "mark_out_threshold": { 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mark_out_threshold", 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "2419200", 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.651 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "pool_name": { 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pool_name", 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "device_health_metrics", 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.652 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "retention_period": { 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "retention_period", 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15552000", 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.653 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_frequency": { 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_frequency", 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.654 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "self_heal": { 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "self_heal", 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.655 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.656 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.657 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "warn_threshold": { 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "warn_threshold", 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.658 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7257600", 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "diskprediction_local", 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.659 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.660 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.661 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.662 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.663 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.664 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "predict_interval": { 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predict_interval", 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "86400", 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.665 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "predictor_model": { 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "predictor_model", 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "prophetstor", 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.666 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "600", 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.667 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.668 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "influx", 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": false, 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "batch_size": { 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "batch_size", 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.669 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5000", 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "database": { 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "database", 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.670 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "ceph", 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": { 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "hostname", 2024-09-21T01:07:11.671 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.672 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "30", 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "5", 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.673 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.674 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.675 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.676 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "password": { 2024-09-21T01:07:11.678 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "password", 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "port": { 2024-09-21T01:07:11.679 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "port", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "8086", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "InfluxDB server port", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.681 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "ssl": { 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ssl", 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "false", 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "threads": { 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threads", 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "32", 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:07:11.683 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "username": { 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "username", 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:07:11.684 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "verify_ssl": { 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "verify_ssl", 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "true", 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:07:11.685 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "insights", 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.687 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.688 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.689 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.690 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.691 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "iostat", 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.693 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.694 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.695 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.697 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.698 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "k8sevents", 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.699 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_event_retention_days": { 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "7", 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "config_check_secs": { 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "config_check_secs", 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "10", 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.702 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.703 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.704 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.705 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.706 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.707 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "localpool", 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "failure_domain": { 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "failure_domain", 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.708 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "host", 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.709 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.710 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.711 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.712 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.713 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "min_size": { 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "min_size", 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.714 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "num_rep": { 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "num_rep", 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.715 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3", 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_num": { 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_num", 2024-09-21T01:07:11.716 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "128", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "prefix": { 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prefix", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "subtree": { 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "subtree", 2024-09-21T01:07:11.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "rack", 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mds_autoscaler", 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.721 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.723 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.724 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.725 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirroring", 2024-09-21T01:07:11.727 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.728 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.729 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.730 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.731 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.732 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.733 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "nfs", 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.734 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.735 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.736 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.737 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.739 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.740 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "fail_fs": { 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "fail_fs", 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.741 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.742 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.743 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.744 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.745 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.746 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.747 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator": { 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "orchestrator", 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "cephadm", 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "rook", 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: "test_orchestrator" 2024-09-21T01:07:11.748 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Orchestrator backend", 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.749 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_perf_query", 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.750 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.751 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.752 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.753 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.754 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.755 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.756 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "osd_support", 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.757 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.758 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.759 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.760 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.761 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "pg_autoscaler", 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.763 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.764 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.766 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.768 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.769 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.770 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "threshold": { 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "threshold", 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.771 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "3.0", 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1.0", 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "scaling threshold", 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.772 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "progress", 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_pg_recovery_event": { 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.773 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.774 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.775 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.776 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.778 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.779 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "max_completed_events": { 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_completed_events", 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.780 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "50", 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "sleep_interval": { 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sleep_interval", 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.781 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.782 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.783 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "prometheus", 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "cache": { 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cache", 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.784 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "exclude_perf_counters": { 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "exclude_perf_counters", 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.785 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.786 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.787 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.789 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.790 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools": { 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools", 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.792 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "300", 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "scrape_interval": { 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "scrape_interval", 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.793 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15.0", 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:11.794 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "::", 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:11.795 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "9283", 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.796 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "stale_cache_strategy": { 2024-09-21T01:07:11.797 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stale_cache_strategy", 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "log", 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.798 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_behaviour": { 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_behaviour", 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "default", 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "default", 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "error" 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.799 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "standby_error_status_code": { 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "standby_error_status_code", 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "400", 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "599", 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.800 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.801 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.802 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.803 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.804 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.805 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.806 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_snap_create": { 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10", 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.807 INFO:teuthology.orchestra.run.smithi047.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.808 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.809 INFO:teuthology.orchestra.run.smithi047.stdout: "trash_purge_schedule": { 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "trash_purge_schedule", 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.810 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "restful", 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "enable_auth": { 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enable_auth", 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.811 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "key_file": { 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "key_file", 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.812 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.813 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.814 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.816 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "max_requests": { 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_requests", 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.818 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "500", 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "server_addr": { 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_addr", 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "server_port": { 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "server_port", 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.820 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.822 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rgw", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.823 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.824 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.825 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.826 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.827 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "5", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.828 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.829 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rook", 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.830 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.831 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.832 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.833 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.834 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.835 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "storage_class": { 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "storage_class", 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.836 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "local", 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "selftest", 2024-09-21T01:07:11.837 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.838 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.840 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.841 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.842 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "roption1": { 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption1", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.843 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "roption2": { 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "roption2", 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "xyz", 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.844 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption1": { 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption1", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.845 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption2": { 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption2", 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.846 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption3": { 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption3", 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "float", 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.847 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption4": { 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption4", 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.848 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption5": { 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption5", 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.849 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption6": { 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption6", 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.850 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "rwoption7": { 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rwoption7", 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "1", 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "42", 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.851 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.852 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "testkey": { 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testkey", 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.853 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "testlkey": { 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testlkey", 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.854 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "testnewline": { 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "testnewline", 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.855 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "smb", 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "internal_store_backend": { 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "internal_store_backend", 2024-09-21T01:07:11.856 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.858 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.859 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.860 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.861 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.862 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "update_orchestration": { 2024-09-21T01:07:11.863 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "update_orchestration", 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snap_schedule", 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "allow_m_granularity": { 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "allow_m_granularity", 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.865 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "dump_on_update": { 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "dump_on_update", 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.866 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.867 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.868 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.870 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "stats", 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.873 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.874 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.875 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.876 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.877 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.878 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.879 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "status", 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.880 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.881 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.882 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.883 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.884 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telegraf", 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "address": { 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "address", 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.887 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "15", 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.888 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.889 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.892 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.893 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.895 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "telemetry", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_basic": { 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_basic", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:07:11.896 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_crash": { 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_crash", 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:07:11.897 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_device": { 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_device", 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.898 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_ident": { 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_ident", 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.899 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "channel_perf": { 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "channel_perf", 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.900 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "contact": { 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "contact", 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.901 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "description": { 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "description", 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.902 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "device_url": { 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "device_url", 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.903 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "enabled": { 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "enabled", 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.904 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "24", 2024-09-21T01:07:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "8", 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "last_opt_revision": { 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "last_opt_revision", 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "1", 2024-09-21T01:07:11.906 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard": { 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard", 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "leaderboard_description": { 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "leaderboard_description", 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.908 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.909 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.911 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.912 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "organization": { 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "organization", 2024-09-21T01:07:11.914 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "proxy": { 2024-09-21T01:07:11.915 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "proxy", 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.916 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "url": { 2024-09-21T01:07:11.917 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "url", 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "test_orchestrator", 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.919 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.920 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.921 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.922 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.923 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.924 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.925 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.926 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.927 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.928 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.929 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.930 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "max_concurrent_clones": { 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "max_concurrent_clones", 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "4", 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.931 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "periodic_async_work": { 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "periodic_async_work", 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.932 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Periodically check for async work", 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_delay": { 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.933 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.934 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "True", 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.935 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix", 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "can_run": true, 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "error_string": "", 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "module_options": { 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "discovery_interval": { 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "discovery_interval", 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "uint", 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "100", 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.937 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "identifier": { 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "identifier", 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.938 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "interval": { 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "interval", 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "secs", 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "60", 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.939 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "log_level": { 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_level", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.940 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster": { 2024-09-21T01:07:11.941 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster", 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.942 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_cluster_level": { 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_cluster_level", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "info", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [ 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "critical", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "debug", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "error", 2024-09-21T01:07:11.943 INFO:teuthology.orchestra.run.smithi047.stdout: "info", 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "warning" 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "log_to_file": { 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "log_to_file", 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "bool", 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "False", 2024-09-21T01:07:11.944 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "sqlite3_killpoint": { 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "dev", 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 1, 2024-09-21T01:07:11.945 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "0", 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_host": { 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_host", 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.946 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "", 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_port": { 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_port", 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "int", 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.947 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "10051", 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "zabbix_sender": { 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "zabbix_sender", 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "str", 2024-09-21T01:07:11.948 INFO:teuthology.orchestra.run.smithi047.stdout: "level": "advanced", 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "flags": 0, 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "min": "", 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "max": "", 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "enum_allowed": [], 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "desc": "", 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "long_desc": "", 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "tags": [], 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "see_also": [] 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.949 INFO:teuthology.orchestra.run.smithi047.stdout: "services": { 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "dashboard": "https://172.21.15.47:8443/" 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "always_on_modules": { 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "octopus": [ 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-09-21T01:07:11.950 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "pacific": [ 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-09-21T01:07:11.951 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "quincy": [ 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "reef": [ 2024-09-21T01:07:11.952 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: ], 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "squid": [ 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "balancer", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "crash", 2024-09-21T01:07:11.953 INFO:teuthology.orchestra.run.smithi047.stdout: "devicehealth", 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "orchestrator", 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "pg_autoscaler", 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "progress", 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "rbd_support", 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "status", 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "telemetry", 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "volumes" 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "last_failure_osd_epoch": 3, 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "active_clients": [ 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "devicehealth", 2024-09-21T01:07:11.954 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3055298638 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "libcephsqlite", 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-09-21T01:07:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2955153405 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "rbd_support", 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 494016281 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.956 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "volumes", 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "addrvec": [ 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v2", 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 159171098 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-21T01:07:11.957 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa9d40b6510 msgr2=0x7fa9d40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa9d40b6510 0x7fa9d40b8a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4005d00 tx=0x7fa9e400b410 comp rx=0 tx=0).stop 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e8104700 msgr2=0x7fa9e819c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e8104700 0x7fa9e819c720 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800d950 tx=0x7fa9d800de10 comp rx=0 tx=0).stop 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 shutdown_connections 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fa9d40b6510 0x7fa9d40b8a20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9e81050a0 0x7fa9e819d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9e8104700 0x7fa9e819c720 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 --2- 172.21.15.47:0/2734172611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9e8103680 0x7fa9e819c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 >> 172.21.15.47:0/2734172611 conn(0x7fa9e80fefe0 msgr2=0x7fa9e80755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:11.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 shutdown_connections 2024-09-21T01:07:11.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:10.458+0000 7fa9ef962640 1 -- 172.21.15.47:0/2734172611 wait complete. 2024-09-21T01:07:12.033 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T01:07:12.034 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T01:07:12.035 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:11 smithi047 ceph-mon[30960]: pgmap v599: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T01:07:12.035 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:11 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1824672438' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:07:12.035 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:11 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2734172611' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:07:12.300 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:12.935 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:07:12.935 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:12.935 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 179, 2024-09-21T01:07:12.935 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 174, 2024-09-21T01:07:12.935 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 518448, 2024-09-21T01:07:12.935 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 106096, 2024-09-21T01:07:12.936 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:12.936 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:12.936 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.028402175, 2024-09-21T01:07:12.936 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.012882632, 2024-09-21T01:07:12.936 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.018279642, 2024-09-21T01:07:12.937 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:12.937 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:12.937 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 174, 2024-09-21T01:07:12.937 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.011192895, 2024-09-21T01:07:12.937 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000064326 2024-09-21T01:07:12.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.937 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:12.937 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 518448, 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 106096 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1, 2024-09-21T01:07:12.938 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 131, 2024-09-21T01:07:12.939 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:07:12.939 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 103248, 2024-09-21T01:07:12.939 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:12.939 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:12.939 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.011693487, 2024-09-21T01:07:12.939 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.009115764, 2024-09-21T01:07:12.939 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001298364, 2024-09-21T01:07:12.940 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:12.940 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:12.940 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 129, 2024-09-21T01:07:12.940 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.010185503, 2024-09-21T01:07:12.940 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000078957 2024-09-21T01:07:12.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.940 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:12.941 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:12.941 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:12.941 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:12.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.941 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:12.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 103248 2024-09-21T01:07:12.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.942 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:12.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 0, 2024-09-21T01:07:12.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 2, 2024-09-21T01:07:12.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:07:12.942 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 0, 2024-09-21T01:07:12.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:12.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:12.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.000272868, 2024-09-21T01:07:12.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:07:12.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.000208833, 2024-09-21T01:07:12.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:12.943 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:12.944 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:12.944 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:12.944 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:12.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-09-21T01:07:12.945 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-09-21T01:07:12.946 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-09-21T01:07:12.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.946 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-09-21T01:07:12.946 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:12.946 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:12.946 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:12.946 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:12.946 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:12.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:12.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:12.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:12.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:12.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:12.947 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:12.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:12.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:12.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:12.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:12.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:12.948 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:12.949 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:12.950 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:12.950 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:12.950 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:12.950 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:12.950 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:12.950 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-09-21T01:07:12.951 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:12.951 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:12.951 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:12.951 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:12.951 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 148935, 2024-09-21T01:07:12.951 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 28, 2024-09-21T01:07:12.951 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:12.951 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:12.952 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-09-21T01:07:12.952 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-09-21T01:07:12.952 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:12.952 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:12.952 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:12.952 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:12.952 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:12.952 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-09-21T01:07:12.953 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 176, 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 490801, 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:12.954 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 176, 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 176, 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 490801, 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:12.955 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:12.956 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:12.956 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:07:13.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:13 smithi047 ceph-mon[30960]: pgmap v600: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T01:07:13.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:13 smithi134 ceph-mon[34785]: pgmap v600: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T01:07:13.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:13 smithi114 ceph-mon[34309]: pgmap v600: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T01:07:13.659 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-21T01:07:13.659 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T01:07:13.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T01:07:13.919 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:14.570 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 0, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 2, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 0, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.001403070, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.000303245, 2024-09-21T01:07:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:07:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 135, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 103952, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.012176165, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.009522516, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001395954, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 133, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.005285935, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000039743 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 103952 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 185, 2024-09-21T01:07:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 180, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 520144, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 109456, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.029466716, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.013330241, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.020909776, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 180, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.012036453, 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000066869 2024-09-21T01:07:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 520144, 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 109456 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-09-21T01:07:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 149007, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 30, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-09-21T01:07:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 182, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 491645, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 182, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-09-21T01:07:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 182, 2024-09-21T01:07:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 491645, 2024-09-21T01:07:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-09-21T01:07:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:14.582 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:07:15.234 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-21T01:07:15.235 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T01:07:15.235 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T01:07:15.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:15 smithi134 ceph-mon[34785]: pgmap v601: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T01:07:15.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:15 smithi114 ceph-mon[34309]: pgmap v601: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T01:07:15.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:15 smithi047 ceph-mon[30960]: pgmap v601: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T01:07:15.494 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:15.999 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:07:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:15.999 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 177, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 174, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 516112, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 106448, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.027665185, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.012693003, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.018328712, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 173, 2024-09-21T01:07:16.000 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.008222227, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000047527 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 516112, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 106448 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 132, 2024-09-21T01:07:16.001 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 103424, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.011457737, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.008973353, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001327246, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 130, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.004835114, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000037193 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:16.002 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 103424 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 4, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 4, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2944, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 448, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:16.003 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.002436382, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000050180, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.002378381, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.004202745, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001400915 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:16.004 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:16.005 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:16.006 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:16.007 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 148984, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 30, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:16.008 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:16.009 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 178, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 491125, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 178, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-09-21T01:07:16.010 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 178, 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 491125, 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:16.011 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:07:16.616 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-21T01:07:16.616 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T01:07:16.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T01:07:16.874 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:17.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:17 smithi134 ceph-mon[34785]: pgmap v602: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 8 op/s 2024-09-21T01:07:17.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:17 smithi114 ceph-mon[34309]: pgmap v602: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 8 op/s 2024-09-21T01:07:17.451 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:17 smithi047 ceph-mon[30960]: pgmap v602: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 8 op/s 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 4, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 4, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2944, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 448, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.003162063, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.000049325, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.002224961, 2024-09-21T01:07:17.575 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.004013490, 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001337830 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:07:17.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 136, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 104128, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.011818870, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.009245140, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001326832, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 134, 2024-09-21T01:07:17.577 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.005379258, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000040143 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 104128 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 182, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 179, 2024-09-21T01:07:17.578 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 517472, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 109648, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.027768695, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.013632907, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.018613709, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 178, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.007908028, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000044427 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:17.579 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 517472, 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 109648 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 0, 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:17.580 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:17.581 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:17.582 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 149998, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 30, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:17.583 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:17.584 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 183, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 491775, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 183, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 183, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 491775, 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-09-21T01:07:17.585 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-09-21T01:07:17.586 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-09-21T01:07:17.586 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-09-21T01:07:17.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:17.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-21T01:07:17.586 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-21T01:07:18.368 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-21T01:07:18.368 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T01:07:18.368 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T01:07:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 4086, 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 4115, 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 1318823, 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 27983935, 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 13, 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 4, 2024-09-21T01:07:19.188 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.467877013, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.222290437, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.081183596, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.129779209, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 4113, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.406245879, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000098771 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 4, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000431, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000107 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.189 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 2323, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 2473, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 976730, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 26663037, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 87, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 6, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.312761449, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.149330504, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.069550059, 2024-09-21T01:07:19.190 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.077028970, 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 2471, 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.409768940, 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000165831 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 80, 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000009814, 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000122 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 325856 2024-09-21T01:07:19.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 31552, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 36910, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 13023898, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 18539287, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 31, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 5, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 2.476772622, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 1.283104630, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 2.230325719, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.074231074, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 36909, 2024-09-21T01:07:19.192 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 4.074873017, 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000110403 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 58915, 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.012095909, 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000205 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 12570176, 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 17010864 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "cct": { 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "total_workers": 1, 2024-09-21T01:07:19.193 INFO:teuthology.orchestra.run.smithi114.stdout: "unhealthy_workers": 0 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: "finisher-MDSRank": { 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: "queue_len": 0, 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: "complete_latency": { 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 6070, 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 9.311644304, 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001534043 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: "finisher-PurgeQueue": { 2024-09-21T01:07:19.194 INFO:teuthology.orchestra.run.smithi114.stdout: "queue_len": 0, 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "complete_latency": { 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 887, 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.079433181, 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000089552 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": { 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "request": 2888, 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "reply": 2888, 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "reply_latency": { 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 2888, 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 489.560202211, 2024-09-21T01:07:19.195 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.169515305 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "slow_reply": 0, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "forward": 0, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_fetch_complete": 0, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_fetch_keys": 0, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_commit": 392, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_split": 1, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_merge": 0, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes": 83, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_top": 5, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_bottom": 78, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_pin_tail": 0, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_pinned": 75, 2024-09-21T01:07:19.196 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_expired": 0, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "inodes_with_caps": 3, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": 3, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "subtrees": 2, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse": 5527, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_hit": 5413, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_forward": 0, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_discover": 0, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_remote_ino": 0, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "traverse_lock": 51, 2024-09-21T01:07:19.197 INFO:teuthology.orchestra.run.smithi114.stdout: "load_cent": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "q": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "exported": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "exported_inodes": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "imported": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "imported_inodes": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_dir_fetch": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_backtrace_fetch": 2011, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "openino_peer_discover": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rfiles": 4, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rbytes": 234, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "root_rsnaps": 0, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_backtrace_fetch": 2011, 2024-09-21T01:07:19.198 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_set_tag": 0, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dir_inodes": 466, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dir_base_inodes": 7, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_dirfrag_rstats": 459, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_file_inodes": 1545, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_revoke": 2272, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_grant": 4720, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_trunc": 6, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_caps": 26658, 2024-09-21T01:07:19.199 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_caps_dirty": 23796, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_cap_release": 64, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "process_request_cap_release": 1336 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_cache": { 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_update": 0, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_update_receipt": 0, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_try_discover": 0, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_send_discover": 0, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "dir_handle_discover": 0, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays": 0, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays_delayed": 0, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:07:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_created": 934, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_enqueued": 873, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_reintegrated": 61, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "strays_migrated": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_processing": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "recovery_started": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "recovery_completed": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_enqueue_scrub": 7, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_exportdir": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_flush": 0, 2024-09-21T01:07:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_fragmentdir": 1, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_fragstats": 0, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "ireq_inodestats": 0, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "uninline_started": 0, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "uninline_succeeded": 0, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "uninline_write_failed": 0 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_log": { 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "evlrg": 0, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "evadd": 28130, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "evex": 28054, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "evtrm": 28054, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "ev": 76, 2024-09-21T01:07:19.202 INFO:teuthology.orchestra.run.smithi114.stdout: "evexg": 0, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "evexd": 1197, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "segadd": 46, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "segex": 45, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "segtrm": 45, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "seg": 1, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "segmjr": 1, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "segexg": 0, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "segexd": 2, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "expos": 63492371, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "wrpos": 63559741, 2024-09-21T01:07:19.203 INFO:teuthology.orchestra.run.smithi114.stdout: "rdpos": 0, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "jlat": { 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 2863, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 7058.641591936, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 2.465470342 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "replayed": 0 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_mem": { 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 23, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "ino+": 903, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "ino-": 880, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "dir": 18, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "dir+": 125, 2024-09-21T01:07:19.204 INFO:teuthology.orchestra.run.smithi114.stdout: "dir-": 107, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "dn": 83, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "dn+": 1581, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "dn-": 1498, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "cap": 3, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "cap+": 887, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "cap-": 884, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "rss": 147104, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "heap": 398336000 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_server": { 2024-09-21T01:07:19.205 INFO:teuthology.orchestra.run.smithi114.stdout: "dispatch_client_request": 3638, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "dispatch_server_request": 0, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_request": 2888, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_client_session": 13, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "handle_peer_request": 0, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "req_create_latency": { 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 765, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.849597462, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001110584 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getattr_latency": { 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 624, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 470.008665197, 2024-09-21T01:07:19.206 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.753219014 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getfilelock_latency": { 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "req_link_latency": { 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 61, 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.047223612, 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000774157 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookup_latency": { 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 60, 2024-09-21T01:07:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.014216273, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000236937 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookuphash_latency": { 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupino_latency": { 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 2, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000336750, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000168375 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupname_latency": { 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupparent_latency": { 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lookupsnap_latency": { 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: "req_lssnap_latency": { 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mkdir_latency": { 2024-09-21T01:07:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 105, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.108803262, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001036221 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mknod_latency": { 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "req_mksnap_latency": { 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: "req_open_latency": { 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 49, 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.009488470, 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000193642 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "req_readdir_latency": { 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 175, 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.901658770, 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.005152335 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rename_latency": { 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 113, 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 11.056527295, 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.097845374 2024-09-21T01:07:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "req_renamesnap_latency": { 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "req_snapdiff_latency": { 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmdir_latency": { 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 99, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 5.523481413, 2024-09-21T01:07:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.055792741 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmsnap_latency": { 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: "req_rmxattr_latency": { 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setattr_latency": { 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 7, 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.029877561, 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.004268223 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setdirlayout_latency": { 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setfilelock_latency": { 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 4, 2024-09-21T01:07:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.001125127, 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000281281 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setlayout_latency": { 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "req_setxattr_latency": { 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 9, 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.023801307, 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.002644589 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "req_symlink_latency": { 2024-09-21T01:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 13, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.014796431, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001138187 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "req_unlink_latency": { 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 802, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.970603281, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001210228 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "req_getvxattr_latency": { 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_sessions": { 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "session_count": 1, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "session_add": 2, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "session_remove": 1, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "sessions_open": 1, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "sessions_stale": 0, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "total_load": 462, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "average_load": 462, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "avg_session_uptime": 528, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "mdthresh_evicted": 0 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: "mempool": { 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:19.219 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:19.220 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_items": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_bytes": 327038, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_items": 98, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_bytes": 440, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_items": 5, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_bytes": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_items": 0, 2024-09-21T01:07:19.221 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_bytes": 7304, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_items": 150, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_items": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_bytes": 136922, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_items": 1141, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_items": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:19.222 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_items": 0 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "objecter": { 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "op_active": 19, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "op_laggy": 0, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "op_send": 7452, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "op_send_bytes": 61152216, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "op_resend": 37, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "op_reply": 7433, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "op_latency": { 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 7433, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 9733.540413497, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 1.309503620 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.223 INFO:teuthology.orchestra.run.smithi114.stdout: "op_inflight": 18, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "oplen_avg": { 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 7452, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 9439 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "op": 7452, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "op_r": 2041, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "op_w": 5411, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "op_rmw": 0, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "op_pg": 0, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_stat": 283, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_create": 514, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_read": 23, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_write": 2879, 2024-09-21T01:07:19.224 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_writefull": 78, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_writesame": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_append": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_zero": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_truncate": 1, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_delete": 1321, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_mapext": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_sparse_read": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_clonerange": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_getxattr": 2018, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_setxattr": 1031, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_rmxattr": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_call": 0, 2024-09-21T01:07:19.225 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_watch": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_notify": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_pgls": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "osdop_other": 6, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_active": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_send": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_resend": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "linger_ping": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_active": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_send": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "poolop_resend": 0, 2024-09-21T01:07:19.226 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_active": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_send": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "poolstat_resend": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_active": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_send": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "statfs_resend": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "command_active": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "command_send": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "command_resend": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "map_epoch": 77, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "map_full": 0, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "map_inc": 2, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_sessions": 12, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_session_open": 12, 2024-09-21T01:07:19.227 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_session_close": 0, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_laggy": 0, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_wr": 1073, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_rd": 0, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_del": 212 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "oft": { 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_objs": 1, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_updates": 0, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "omap_total_removes": 0 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "purge_queue": { 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_ops": 50, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_ops_high_water": 51, 2024-09-21T01:07:19.228 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing": 2, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executing_high_water": 32, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executed_ops": 745, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_executed": 481, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "pq_item_in_journal": 392 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 37958, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 10385348, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 37958, 2024-09-21T01:07:19.229 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 37958, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 10385348, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-objecter_bytes": { 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2024-09-21T01:07:19.230 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 0, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 0, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 0, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 7452, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 61240397, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 7433, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 61240397, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.231 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-objecter_ops": { 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 19, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 1024, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 0, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 0, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 0, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 7452, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 7452, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 7433, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 7433, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.232 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 3758096384, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 873, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 88181, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 873, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 16, 2024-09-21T01:07:19.233 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 88181, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-write_buf_throttle-0x55b8b41035f0": { 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 3758096384, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 28130, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 59365437, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 28130, 2024-09-21T01:07:19.234 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 2863, 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 59365437, 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "trackedop": { 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: "slow_ops_count": 266 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:19.235 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-21T01:07:19.314 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:19 smithi114 ceph-mon[34309]: pgmap v603: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T01:07:19.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:19 smithi134 ceph-mon[34785]: pgmap v603: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T01:07:19.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:19 smithi047 ceph-mon[30960]: pgmap v603: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T01:07:19.977 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=1 2024-09-21T01:07:19.977 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T01:07:19.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T01:07:20.236 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:07:20.768 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-21T01:07:20.768 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:20.768 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 0, 2024-09-21T01:07:20.768 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 2, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 0, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.001186540, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.000302607, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.769 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 182, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 179, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 517472, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 109648, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:20.770 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.027640408, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.013253934, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.020450705, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 178, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.007422403, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000041698 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:20.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 517472, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 109648 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 5, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 137, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 3104, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 104400, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.011366489, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.007361556, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.002894541, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:20.772 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 136, 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.009098605, 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000066901 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 104400 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "cct": { 2024-09-21T01:07:20.773 INFO:teuthology.orchestra.run.smithi114.stdout: "total_workers": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "unhealthy_workers": 0 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "mempool": { 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:20.774 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:20.775 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_items": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_bytes": 148984, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_items": 30, 2024-09-21T01:07:20.776 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_bytes": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_items": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_items": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_items": 0, 2024-09-21T01:07:20.777 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_items": 2, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_items": 0, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_items": 0 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 183, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 491775, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:20.778 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 183, 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 183, 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 491775, 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:20.779 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-21T01:07:21.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:21 smithi134 ceph-mon[34785]: pgmap v604: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 8 op/s 2024-09-21T01:07:21.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:21 smithi114 ceph-mon[34309]: pgmap v604: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 8 op/s 2024-09-21T01:07:21.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:21 smithi047 ceph-mon[30960]: pgmap v604: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 8 op/s 2024-09-21T01:07:21.542 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-21T01:07:21.542 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T01:07:21.542 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T01:07:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:07:22.342 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-21T01:07:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 0, 2024-09-21T01:07:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 2, 2024-09-21T01:07:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:07:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 0, 2024-09-21T01:07:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.001288565, 2024-09-21T01:07:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:07:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.000409310, 2024-09-21T01:07:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:22.344 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.345 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:07:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:07:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 1, 2024-09-21T01:07:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 134, 2024-09-21T01:07:22.346 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:07:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 103776, 2024-09-21T01:07:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.009399950, 2024-09-21T01:07:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.007042623, 2024-09-21T01:07:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.001136259, 2024-09-21T01:07:22.347 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 132, 2024-09-21T01:07:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.005700353, 2024-09-21T01:07:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000043184 2024-09-21T01:07:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.348 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 103776 2024-09-21T01:07:22.349 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 184, 2024-09-21T01:07:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 179, 2024-09-21T01:07:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 519872, 2024-09-21T01:07:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 108816, 2024-09-21T01:07:22.350 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.028316367, 2024-09-21T01:07:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.012452973, 2024-09-21T01:07:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.021924464, 2024-09-21T01:07:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:22.351 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 179, 2024-09-21T01:07:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.012177591, 2024-09-21T01:07:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000068031 2024-09-21T01:07:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:22.352 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 519872, 2024-09-21T01:07:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 108816 2024-09-21T01:07:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.353 INFO:teuthology.orchestra.run.smithi114.stdout: "cct": { 2024-09-21T01:07:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "total_workers": 0, 2024-09-21T01:07:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "unhealthy_workers": 0 2024-09-21T01:07:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "mempool": { 2024-09-21T01:07:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:22.354 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:22.355 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:22.356 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_items": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_bytes": 148984, 2024-09-21T01:07:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_items": 30, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_bytes": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_items": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_items": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:22.361 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_items": 0, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_items": 2, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_items": 0, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_items": 0 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 181, 2024-09-21T01:07:22.362 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 491515, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 181, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 181, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 491515, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:22.363 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-21T01:07:23.067 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.h 2024-09-21T01:07:23.068 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T01:07:23.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T01:07:23.321 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:07:23.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:23 smithi134 ceph-mon[34785]: pgmap v605: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:07:23.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:23 smithi114 ceph-mon[34309]: pgmap v605: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:07:23.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:23 smithi047 ceph-mon[30960]: pgmap v605: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:07:23.858 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 4, 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 4, 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 2944, 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 448, 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.003144477, 2024-09-21T01:07:23.859 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.000052013, 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.002131420, 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 3, 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.003829975, 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.001276658 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:23.860 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 185, 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 182, 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 518288, 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 111568, 2024-09-21T01:07:23.861 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.027359700, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.012815779, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.019946144, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 181, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.008060952, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000044535 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.862 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 518288, 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 111568 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_messages": 1, 2024-09-21T01:07:23.863 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages": 138, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_bytes": 104480, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_total_time": 0.010059626, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_send_time": 0.007704586, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_recv_time": 0.001054702, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 136, 2024-09-21T01:07:23.864 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.005810660, 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000042725 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:23.865 INFO:teuthology.orchestra.run.smithi114.stdout: "msgr_send_encrypted_bytes": 104480 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: "cct": { 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: "total_workers": 0, 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: "unhealthy_workers": 0 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: "mempool": { 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:23.866 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:23.867 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:23.868 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_items": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:23.869 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_bytes": 149024, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_anon_items": 31, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_bytes": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_items": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:23.870 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_items": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "pgmap_items": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_co_items": 2, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_1_items": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "unittest_2_items": 0 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:23.871 INFO:teuthology.orchestra.run.smithi114.stdout: "val": 0, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "max": 104857600, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "get_started": 0, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "get": 186, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "get_sum": 492165, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "get_or_fail_success": 186, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "take": 0, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "take_sum": 0, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "put": 186, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "put_sum": 492165, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "wait": { 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "avgcount": 0, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "sum": 0.000000000, 2024-09-21T01:07:23.872 INFO:teuthology.orchestra.run.smithi114.stdout: "avgtime": 0.000000000 2024-09-21T01:07:23.873 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:23.873 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-21T01:07:23.873 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-21T01:07:24.510 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-21T01:07:24.510 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T01:07:24.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T01:07:24.773 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:25.185 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:25 smithi134 ceph-mon[34785]: pgmap v606: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 4, 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 4, 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 2944, 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 448, 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:25.316 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.003025161, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.000040961, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.002113287, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.003743085, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001247695 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:25.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 181, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 178, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 517200, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 109008, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.027733871, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.013589017, 2024-09-21T01:07:25.318 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.018804762, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 177, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.010508170, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000059368 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 517200, 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 109008 2024-09-21T01:07:25.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 135, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 103952, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.010763673, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.007688253, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.001642543, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 133, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.006120212, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000046016 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 103952 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 0, 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-21T01:07:25.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 149007, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 30, 2024-09-21T01:07:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-21T01:07:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 2, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 182, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 491645, 2024-09-21T01:07:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 182, 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 182, 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 491645, 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:25.327 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T01:07:25.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:25 smithi114 ceph-mon[34309]: pgmap v606: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T01:07:25.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:25 smithi047 ceph-mon[30960]: pgmap v606: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T01:07:26.059 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2024-09-21T01:07:26.059 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T01:07:26.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T01:07:26.315 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:26.863 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 182, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 179, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 517472, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 109648, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.028739283, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.013064864, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.021127810, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 178, 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.008643937, 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000048561 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 517472, 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 109648 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 5, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 138, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 3104, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 104576, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.012415392, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.008014076, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.002945033, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 137, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.010020536, 2024-09-21T01:07:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000073142 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 104576 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 0, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 2, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:07:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 0, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.000353713, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.000275654, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 0, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 148967, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 29, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 2, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 183, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 491775, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 183, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 183, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 491775, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:26.875 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T01:07:27.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:27 smithi134 ceph-mon[34785]: pgmap v607: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:07:27.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:27 smithi114 ceph-mon[34309]: pgmap v607: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:07:27.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:27 smithi047 ceph-mon[30960]: pgmap v607: 97 pgs: 97 active+clean; 11 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:07:27.524 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-09-21T01:07:27.524 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T01:07:27.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T01:07:27.777 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 714, 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 710, 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 13273428, 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 276988, 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 6, 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.102650714, 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.041270416, 2024-09-21T01:07:28.333 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.041988366, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.018530500, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 709, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.030710496, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000043315 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 530912, 2024-09-21T01:07:28.334 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 110352 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 139, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 274, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 25205419, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 365275, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 6, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 5, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.038075971, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.011466101, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.020537985, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.004176018, 2024-09-21T01:07:28.335 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 272, 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.013400857, 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000049267 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 321248 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:28.336 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 382, 2024-09-21T01:07:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 384, 2024-09-21T01:07:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 21715470, 2024-09-21T01:07:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 120813, 2024-09-21T01:07:28.337 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 6, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 5, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.054192199, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.016941363, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.022996122, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.011429399, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 383, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.020329061, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000053078 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.338 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-21T01:07:28.339 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1733, 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.063105021, 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000036413 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-21T01:07:28.340 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-21T01:07:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 953, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 616, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 337, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 72, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 2, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:07:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:07:28.343 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-09-21T01:07:28.344 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-09-21T01:07:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:07:28.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "uninline_started": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "uninline_succeeded": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "uninline_write_failed": 0 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 28130, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-21T01:07:28.347 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 0, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 3, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 19, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 63492371, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 63559741, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 63558089, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 28130 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 19, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 892, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 873, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 14, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 121, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 107, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 953, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 1539, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 586, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-09-21T01:07:28.349 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 119560, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 327217152 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 0, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.350 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.351 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.352 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.354 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-21T01:07:28.354 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.354 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.354 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.354 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-21T01:07:28.354 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.355 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.356 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-21T01:07:28.357 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.358 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.360 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:07:28.361 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 2, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-09-21T01:07:28.362 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 1810, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:28.363 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:28.364 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 223288, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 71, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:28.365 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7304, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 150, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-21T01:07:28.366 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 709658, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 4117, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 1040, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 26, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 4, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 1040, 2024-09-21T01:07:28.367 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1040, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 345.567585464, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.332276524 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1040, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1041 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 1040, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 1040, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 0, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-21T01:07:28.368 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 601, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 436, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 2, 2024-09-21T01:07:28.369 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-21T01:07:28.370 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 77, 2024-09-21T01:07:28.371 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 9, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 9, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 0, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 2, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 0 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 0, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-21T01:07:28.372 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-21T01:07:28.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 1231, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 60070853, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 1231, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-21T01:07:28.374 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1231, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 60070853, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-21T01:07:28.375 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 1040, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 59370561, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1040, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 59370561, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.376 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 1040, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 1040, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1040, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1040, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.377 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-21T01:07:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x560c4a465450": { 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-21T01:07:28.379 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:28.380 INFO:teuthology.orchestra.run.smithi134.stdout: "trackedop": { 2024-09-21T01:07:28.381 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-21T01:07:28.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:28.381 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T01:07:29.235 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-21T01:07:29.235 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T01:07:29.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T01:07:29.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:29 smithi134 ceph-mon[34785]: pgmap v608: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-21T01:07:29.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:29 smithi114 ceph-mon[34309]: pgmap v608: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-21T01:07:29.456 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:29 smithi047 ceph-mon[30960]: pgmap v608: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-21T01:07:29.488 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:29.984 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T01:07:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 4, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 4, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 2944, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 448, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 0, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.002952309, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.000042495, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.002191008, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3, 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.003921532, 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001307177 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:07:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 187, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 184, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 518832, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 112848, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 2, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.028641779, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.013544908, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.019744254, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 183, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.009515265, 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000051995 2024-09-21T01:07:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 518832, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 112848 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 140, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 104832, 2024-09-21T01:07:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 3, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.010536756, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.008099498, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.000998265, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 138, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.008342612, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000060453 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 104832 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 0, 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:07:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:07:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:07:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 149007, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 30, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-21T01:07:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 968, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 2, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-21T01:07:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 188, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 492425, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 188, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-21T01:07:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 188, 2024-09-21T01:07:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 492425, 2024-09-21T01:07:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-21T01:07:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-21T01:07:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-21T01:07:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-21T01:07:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T01:07:29.996 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T01:07:30.668 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-21T01:07:30.668 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T01:07:30.677 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T01:07:30.677 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T01:07:30.678 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:07:30.700 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-21T01:07:30.700 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:07:30.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:07:31.075 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:31.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:31 smithi047 ceph-mon[30960]: pgmap v609: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 10 op/s 2024-09-21T01:07:31.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:31 smithi134 ceph-mon[34785]: pgmap v609: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 10 op/s 2024-09-21T01:07:31.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:31 smithi114 ceph-mon[34309]: pgmap v609: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 10 op/s 2024-09-21T01:07:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 -- 172.21.15.47:0/2907781107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c10de70 msgr2=0x7f6e6c110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 --2- 172.21.15.47:0/2907781107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c10de70 0x7f6e6c110380 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009ca0 tx=0x7f6e6402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 -- 172.21.15.47:0/2907781107 shutdown_connections 2024-09-21T01:07:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 --2- 172.21.15.47:0/2907781107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c10de70 0x7f6e6c110380 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 --2- 172.21.15.47:0/2907781107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c1052f0 0x7f6e6c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 --2- 172.21.15.47:0/2907781107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e6c1048c0 0x7f6e6c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 -- 172.21.15.47:0/2907781107 >> 172.21.15.47:0/2907781107 conn(0x7f6e6c079770 msgr2=0x7f6e6c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 -- 172.21.15.47:0/2907781107 shutdown_connections 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 -- 172.21.15.47:0/2907781107 wait complete. 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.582+0000 7f6e71da8640 1 Processor -- start 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e71da8640 1 -- start start 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e71da8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c1048c0 0x7f6e6c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e71da8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c1052f0 0x7f6e6c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e71da8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e6c10de70 0x7f6e6c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e71da8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c113b10 con 0x7f6e6c1052f0 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e71da8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c113990 con 0x7f6e6c10de70 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e71da8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c113c90 con 0x7f6e6c1048c0 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c1052f0 0x7f6e6c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:31.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c1052f0 0x7f6e6c19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57430/0 (socket says 172.21.15.47:57430) 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6affd640 1 -- 172.21.15.47:0/1489781258 learned_addr learned my addr 172.21.15.47:0/1489781258 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6bfff640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e6c10de70 0x7f6e6c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6b7fe640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c1048c0 0x7f6e6c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6affd640 1 -- 172.21.15.47:0/1489781258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c1048c0 msgr2=0x7f6e6c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6affd640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c1048c0 0x7f6e6c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6affd640 1 -- 172.21.15.47:0/1489781258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e6c10de70 msgr2=0x7f6e6c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6affd640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e6c10de70 0x7f6e6c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.583+0000 7f6e6affd640 1 -- 172.21.15.47:0/1489781258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c1a0490 con 0x7f6e6c1052f0 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.584+0000 7f6e6affd640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c1052f0 0x7f6e6c19aac0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e9c0 tx=0x7f6e6000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.584+0000 7f6e68ff9640 1 -- 172.21.15.47:0/1489781258 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000ccc0 con 0x7f6e6c1052f0 2024-09-21T01:07:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.584+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6c1a0780 con 0x7f6e6c1052f0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.584+0000 7f6e68ff9640 1 -- 172.21.15.47:0/1489781258 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e600054d0 con 0x7f6e6c1052f0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.584+0000 7f6e68ff9640 1 -- 172.21.15.47:0/1489781258 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e60010430 con 0x7f6e6c1052f0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.584+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6c1a6ee0 con 0x7f6e6c1052f0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.585+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6c06c200 con 0x7f6e6c1052f0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.587+0000 7f6e68ff9640 1 -- 172.21.15.47:0/1489781258 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6e60005020 con 0x7f6e6c1052f0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.587+0000 7f6e68ff9640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e540b6510 0x7f6e540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.588+0000 7f6e6b7fe640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e540b6510 0x7f6e540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.588+0000 7f6e68ff9640 1 -- 172.21.15.47:0/1489781258 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f6e600e75c0 con 0x7f6e6c1052f0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.588+0000 7f6e6b7fe640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e540b6510 0x7f6e540b8a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00bbe0 tx=0x7f6e5c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:31.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.592+0000 7f6e68ff9640 1 -- 172.21.15.47:0/1489781258 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e600adef0 con 0x7f6e6c1052f0 2024-09-21T01:07:31.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.808+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6e6c1a70e0 con 0x7f6e6c1052f0 2024-09-21T01:07:31.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.808+0000 7f6e68ff9640 1 -- 172.21.15.47:0/1489781258 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v77) ==== 81+0+592 (secure 0 0 0) 0x7f6e600b22d0 con 0x7f6e6c1052f0 2024-09-21T01:07:31.809 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3201312639 2024-09-22T00:49:25.157910+0000 2024-09-21T01:07:31.809 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/1191304788 2024-09-22T00:49:25.157910+0000 2024-09-21T01:07:31.809 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/3930494204 2024-09-22T00:49:25.157910+0000 2024-09-21T01:07:31.809 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/1191304788 2024-09-22T00:49:25.157910+0000 2024-09-21T01:07:31.809 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2329069135 2024-09-22T00:49:25.157910+0000 2024-09-21T01:07:31.810 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/2951177130 2024-09-22T00:48:58.868983+0000 2024-09-21T01:07:31.810 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1944491425 2024-09-22T00:48:58.868983+0000 2024-09-21T01:07:31.810 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6801/3263172120 2024-09-22T00:48:58.868983+0000 2024-09-21T01:07:31.810 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:0/1988986045 2024-09-22T00:48:58.868983+0000 2024-09-21T01:07:31.810 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47:6800/3263172120 2024-09-22T00:48:58.868983+0000 2024-09-21T01:07:31.810 INFO:teuthology.orchestra.run.smithi047.stderr:listed 10 entries 2024-09-21T01:07:31.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.810+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e540b6510 msgr2=0x7f6e540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:31.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.810+0000 7f6e71da8640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e540b6510 0x7f6e540b8a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00bbe0 tx=0x7f6e5c00b390 comp rx=0 tx=0).stop 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.810+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c1052f0 msgr2=0x7f6e6c19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.810+0000 7f6e71da8640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c1052f0 0x7f6e6c19aac0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e9c0 tx=0x7f6e6000ee80 comp rx=0 tx=0).stop 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.811+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 shutdown_connections 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.811+0000 7f6e71da8640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f6e540b6510 0x7f6e540b8a20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.811+0000 7f6e71da8640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e6c10de70 0x7f6e6c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.811+0000 7f6e71da8640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c1052f0 0x7f6e6c19aac0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.811+0000 7f6e71da8640 1 --2- 172.21.15.47:0/1489781258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e6c1048c0 0x7f6e6c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.811+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 >> 172.21.15.47:0/1489781258 conn(0x7f6e6c079770 msgr2=0x7f6e6c107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.811+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 shutdown_connections 2024-09-21T01:07:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:31.811+0000 7f6e71da8640 1 -- 172.21.15.47:0/1489781258 wait complete. 2024-09-21T01:07:32.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:32 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1489781258' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:07:32.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:32 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1489781258' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:07:32.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:32 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1489781258' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:07:32.536 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T01:07:32.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:07:32.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T01:07:33.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:33 smithi134 ceph-mon[34785]: pgmap v610: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 10 op/s 2024-09-21T01:07:33.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:33 smithi114 ceph-mon[34309]: pgmap v610: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 10 op/s 2024-09-21T01:07:33.455 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:33 smithi047 ceph-mon[30960]: pgmap v610: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 10 op/s 2024-09-21T01:07:34.058 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-09-21T01:07:34.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:07:34.059 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T01:07:34.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:07:34.103 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-09-21T01:07:34.143 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T01:07:34.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:07:34.144 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:07:34.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:07:34.211 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-09-21T01:07:34.305 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T01:07:34.329 INFO:tasks.cephadm:Teardown begin 2024-09-21T01:07:34.329 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T01:07:34.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:07:34.591 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 -- 172.21.15.47:0/1778088087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c108cf0 msgr2=0x7f7c6c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 --2- 172.21.15.47:0/1778088087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c108cf0 0x7f7c6c10f520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009ca0 tx=0x7f7c6402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 -- 172.21.15.47:0/1778088087 shutdown_connections 2024-09-21T01:07:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 --2- 172.21.15.47:0/1778088087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c108cf0 0x7f7c6c10f520 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 --2- 172.21.15.47:0/1778088087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c6c1083a0 0x7f7c6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 --2- 172.21.15.47:0/1778088087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c102a60 0x7f7c6c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 -- 172.21.15.47:0/1778088087 >> 172.21.15.47:0/1778088087 conn(0x7f7c6c079730 msgr2=0x7f7c6c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:35.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 -- 172.21.15.47:0/1778088087 shutdown_connections 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.091+0000 7f7c74114640 1 -- 172.21.15.47:0/1778088087 wait complete. 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c74114640 1 Processor -- start 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c74114640 1 -- start start 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c74114640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c102a60 0x7f7c6c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c74114640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c1083a0 0x7f7c6c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c74114640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c6c108cf0 0x7f7c6c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c74114640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c112960 con 0x7f7c6c102a60 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c74114640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c1127e0 con 0x7f7c6c108cf0 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c74114640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c112ae0 con 0x7f7c6c1083a0 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c71eb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c102a60 0x7f7c6c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c71eb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c102a60 0x7f7c6c0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57450/0 (socket says 172.21.15.47:57450) 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c71eb0640 1 -- 172.21.15.47:0/1089484968 learned_addr learned my addr 172.21.15.47:0/1089484968 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:35.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c716af640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c1083a0 0x7f7c6c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c726b1640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c6c108cf0 0x7f7c6c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c71eb0640 1 -- 172.21.15.47:0/1089484968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c1083a0 msgr2=0x7f7c6c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c71eb0640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c1083a0 0x7f7c6c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.092+0000 7f7c71eb0640 1 -- 172.21.15.47:0/1089484968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c6c108cf0 msgr2=0x7f7c6c1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.093+0000 7f7c71eb0640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c6c108cf0 0x7f7c6c1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.093+0000 7f7c71eb0640 1 -- 172.21.15.47:0/1089484968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c1a8700 con 0x7f7c6c102a60 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.093+0000 7f7c71eb0640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c102a60 0x7f7c6c0ff670 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e9f0 tx=0x7f7c6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.093+0000 7f7c62ffd640 1 -- 172.21.15.47:0/1089484968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800cd80 con 0x7f7c6c102a60 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.093+0000 7f7c62ffd640 1 -- 172.21.15.47:0/1089484968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c680054d0 con 0x7f7c6c102a60 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.093+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6c1a89f0 con 0x7f7c6c102a60 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.093+0000 7f7c62ffd640 1 -- 172.21.15.47:0/1089484968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68010690 con 0x7f7c6c102a60 2024-09-21T01:07:35.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.093+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6c1a8f30 con 0x7f7c6c102a60 2024-09-21T01:07:35.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.094+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6c102e70 con 0x7f7c6c102a60 2024-09-21T01:07:35.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.096+0000 7f7c62ffd640 1 -- 172.21.15.47:0/1089484968 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7c68004e30 con 0x7f7c6c102a60 2024-09-21T01:07:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.097+0000 7f7c62ffd640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c580b6590 0x7f7c580b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.097+0000 7f7c716af640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c580b6590 0x7f7c580b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.097+0000 7f7c62ffd640 1 -- 172.21.15.47:0/1089484968 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f7c680e78c0 con 0x7f7c6c102a60 2024-09-21T01:07:35.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.097+0000 7f7c716af640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c580b6590 0x7f7c580b8aa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c102620 tx=0x7f7c5c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:35.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.100+0000 7f7c62ffd640 1 -- 172.21.15.47:0/1089484968 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c68056710 con 0x7f7c6c102a60 2024-09-21T01:07:35.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.341+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c6c100970 con 0x7f7c6c102a60 2024-09-21T01:07:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:35 smithi047 ceph-mon[30960]: pgmap v611: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:07:35.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.341+0000 7f7c62ffd640 1 -- 172.21.15.47:0/1089484968 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f7c6c100970 con 0x7f7c6c102a60 2024-09-21T01:07:35.343 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:07:35.343 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:07:35.343 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T01:07:35.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:35 smithi134 ceph-mon[34785]: pgmap v611: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c580b6590 msgr2=0x7f7c580b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c580b6590 0x7f7c580b8aa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c102620 tx=0x7f7c5c005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c102a60 msgr2=0x7f7c6c0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c102a60 0x7f7c6c0ff670 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e9f0 tx=0x7f7c6800edf0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 shutdown_connections 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7c580b6590 0x7f7c580b8aa0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c6c108cf0 0x7f7c6c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c1083a0 0x7f7c6c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 --2- 172.21.15.47:0/1089484968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c6c102a60 0x7f7c6c0ff670 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 >> 172.21.15.47:0/1089484968 conn(0x7f7c6c079730 msgr2=0x7f7c6c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 shutdown_connections 2024-09-21T01:07:35.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:35.344+0000 7f7c74114640 1 -- 172.21.15.47:0/1089484968 wait complete. 2024-09-21T01:07:35.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:35 smithi114 ceph-mon[34309]: pgmap v611: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T01:07:36.038 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:07:36.322 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:37.062 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:36 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1089484968' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:37.063 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:36 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1089484968' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:37.063 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:36 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1089484968' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 -- 172.21.15.47:0/2774625585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 msgr2=0x7f7788104ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 --2- 172.21.15.47:0/2774625585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 0x7f7788104ca0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7778009900 tx=0x7f777802a410 comp rx=0 tx=0).stop 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 -- 172.21.15.47:0/2774625585 shutdown_connections 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 --2- 172.21.15.47:0/2774625585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778810de40 0x7f7788110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 --2- 172.21.15.47:0/2774625585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77881052c0 0x7f778810d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 --2- 172.21.15.47:0/2774625585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 0x7f7788104ca0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 -- 172.21.15.47:0/2774625585 >> 172.21.15.47:0/2774625585 conn(0x7f7788079730 msgr2=0x7f7788079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 -- 172.21.15.47:0/2774625585 shutdown_connections 2024-09-21T01:07:37.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.796+0000 7f778c834640 1 -- 172.21.15.47:0/2774625585 wait complete. 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778c834640 1 Processor -- start 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778c834640 1 -- start start 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778c834640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 0x7f778819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778c834640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77881052c0 0x7f778819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778c834640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778810de40 0x7f778819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778c834640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7788113aa0 con 0x7f7788104890 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778c834640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7788113920 con 0x7f778810de40 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778c834640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7788113c20 con 0x7f77881052c0 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f7786d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778810de40 0x7f778819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 0x7f778819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 0x7f778819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57464/0 (socket says 172.21.15.47:57464) 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f7786d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778810de40 0x7f778819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.47:38892/0 (socket says 172.21.15.47:38892) 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f778659c640 1 -- 172.21.15.47:0/1841878663 learned_addr learned my addr 172.21.15.47:0/1841878663 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.797+0000 7f7785d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77881052c0 0x7f778819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f778659c640 1 -- 172.21.15.47:0/1841878663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77881052c0 msgr2=0x7f778819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f778659c640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77881052c0 0x7f778819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f778659c640 1 -- 172.21.15.47:0/1841878663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778810de40 msgr2=0x7f778819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f778659c640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778810de40 0x7f778819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f778659c640 1 -- 172.21.15.47:0/1841878663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77881a04a0 con 0x7f7788104890 2024-09-21T01:07:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f7786d9d640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778810de40 0x7f778819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f778659c640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 0x7f778819a530 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7778005940 tx=0x7f7778004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f77777fe640 1 -- 172.21.15.47:0/1841878663 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777803f030 con 0x7f7788104890 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77881a0730 con 0x7f7788104890 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f77777fe640 1 -- 172.21.15.47:0/1841878663 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7778003aa0 con 0x7f7788104890 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f77777fe640 1 -- 172.21.15.47:0/1841878663 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778035070 con 0x7f7788104890 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.798+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77881a6ef0 con 0x7f7788104890 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.799+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778806c1c0 con 0x7f7788104890 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.802+0000 7f77777fe640 1 -- 172.21.15.47:0/1841878663 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7778042030 con 0x7f7788104890 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.803+0000 7f77777fe640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77700b6510 0x7f77700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.803+0000 7f7785d9b640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77700b6510 0x7f77700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.803+0000 7f77777fe640 1 -- 172.21.15.47:0/1841878663 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f7778107bb0 con 0x7f7788104890 2024-09-21T01:07:37.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.804+0000 7f7785d9b640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77700b6510 0x7f77700b8a20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7788102310 tx=0x7f777c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:37.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:36.806+0000 7f77777fe640 1 -- 172.21.15.47:0/1841878663 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77780ce4c0 con 0x7f7788104890 2024-09-21T01:07:37.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.035+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7788109020 con 0x7f7788104890 2024-09-21T01:07:37.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.036+0000 7f77777fe640 1 -- 172.21.15.47:0/1841878663 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11852 (secure 0 0 0) 0x7f77780d28a0 con 0x7f7788104890 2024-09-21T01:07:37.070 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:07:37.071 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"btime":"2024-09-21T00:56:58:679975+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14697,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/661733967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":661733967},{"type":"v1","addr":"172.21.15.47:6835","nonce":661733967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14709,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1306058041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1306058041},{"type":"v1","addr":"172.21.15.47:6837","nonce":1306058041}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1305457594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1305457594},{"type":"v1","addr":"172.21.15.47:6839","nonce":1305457594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14769,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6841/1666315878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6840","nonce":1666315878},{"type":"v1","addr":"172.21.15.47:6841","nonce":1666315878}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24563,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/1826356330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1826356330},{"type":"v1","addr":"172.21.15.114:6833","nonce":1826356330}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2433850762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2433850762},{"type":"v1","addr":"172.21.15.134:6833","nonce":2433850762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/27443904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":27443904},{"type":"v1","addr":"172.21.15.114:6835","nonce":27443904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1078728658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1078728658},{"type":"v1","addr":"172.21.15.134:6835","nonce":1078728658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2922289361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2922289361},{"type":"v1","addr":"172.21.15.114:6837","nonce":2922289361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/4289116211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":4289116211},{"type":"v1","addr":"172.21.15.134:6837","nonce":4289116211}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T00:56:49.241985+0000","modified":"2024-09-21T00:56:58.284880+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6839/924032014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":924032014},{"type":"v1","addr":"172.21.15.134:6839","nonce":924032014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6839/4124175185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6838","nonce":4124175185},{"type":"v1","addr":"172.21.15.114:6839","nonce":4124175185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:07:37.071 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 19 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77700b6510 msgr2=0x7f77700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77700b6510 0x7f77700b8a20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7788102310 tx=0x7f777c00b390 comp rx=0 tx=0).stop 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 msgr2=0x7f778819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 0x7f778819a530 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7778005940 tx=0x7f7778004270 comp rx=0 tx=0).stop 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 shutdown_connections 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f77700b6510 0x7f77700b8a20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f778810de40 0x7f778819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77881052c0 0x7f778819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 --2- 172.21.15.47:0/1841878663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7788104890 0x7f778819a530 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 >> 172.21.15.47:0/1841878663 conn(0x7f7788079730 msgr2=0x7f77881008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 shutdown_connections 2024-09-21T01:07:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:37.038+0000 7f778c834640 1 -- 172.21.15.47:0/1841878663 wait complete. 2024-09-21T01:07:37.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:37 smithi134 ceph-mon[34785]: pgmap v612: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:07:37.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:37 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1841878663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:37.388 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:37 smithi047 ceph-mon[30960]: pgmap v612: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:07:37.388 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:37 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1841878663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:37.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:37 smithi114 ceph-mon[34309]: pgmap v612: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:07:37.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:37 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1841878663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:07:37.820 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:07:38.091 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.553+0000 7f34c683e640 1 -- 172.21.15.47:0/2154934766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c0108cf0 msgr2=0x7f34c010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.553+0000 7f34c683e640 1 --2- 172.21.15.47:0/2154934766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c0108cf0 0x7f34c010f520 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009ca0 tx=0x7f34b802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.553+0000 7f34c683e640 1 -- 172.21.15.47:0/2154934766 shutdown_connections 2024-09-21T01:07:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.553+0000 7f34c683e640 1 --2- 172.21.15.47:0/2154934766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c0108cf0 0x7f34c010f520 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.553+0000 7f34c683e640 1 --2- 172.21.15.47:0/2154934766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34c01083a0 0x7f34c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.553+0000 7f34c683e640 1 --2- 172.21.15.47:0/2154934766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c0102a60 0x7f34c0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.553+0000 7f34c683e640 1 -- 172.21.15.47:0/2154934766 >> 172.21.15.47:0/2154934766 conn(0x7f34c0079730 msgr2=0x7f34c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.554+0000 7f34c683e640 1 -- 172.21.15.47:0/2154934766 shutdown_connections 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.554+0000 7f34c683e640 1 -- 172.21.15.47:0/2154934766 wait complete. 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.554+0000 7f34c683e640 1 Processor -- start 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.554+0000 7f34c683e640 1 -- start start 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34c683e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c0102a60 0x7f34c019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34c683e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c01083a0 0x7f34c019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34c683e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34c0108cf0 0x7f34c019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34c683e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f34c0112960 con 0x7f34c01083a0 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34c683e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f34c01127e0 con 0x7f34c0102a60 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34c683e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34c0112ae0 con 0x7f34c0108cf0 2024-09-21T01:07:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c01083a0 0x7f34c019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c01083a0 0x7f34c019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57490/0 (socket says 172.21.15.47:57490) 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 -- 172.21.15.47:0/4092873137 learned_addr learned my addr 172.21.15.47:0/4092873137 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34bffff640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c0102a60 0x7f34c019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34c4ddb640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34c0108cf0 0x7f34c019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 -- 172.21.15.47:0/4092873137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34c0108cf0 msgr2=0x7f34c019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34c0108cf0 0x7f34c019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 -- 172.21.15.47:0/4092873137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c0102a60 msgr2=0x7f34c019b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c0102a60 0x7f34c019b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 -- 172.21.15.47:0/4092873137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c01a6560 con 0x7f34c01083a0 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34c4ddb640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34c0108cf0 0x7f34c019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34b7fff640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c01083a0 0x7f34c019b790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f34a800e9c0 tx=0x7f34a800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.555+0000 7f34bdffb640 1 -- 172.21.15.47:0/4092873137 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a800cd80 con 0x7f34c01083a0 2024-09-21T01:07:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.556+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c01a6850 con 0x7f34c01083a0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.556+0000 7f34bdffb640 1 -- 172.21.15.47:0/4092873137 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a80054d0 con 0x7f34c01083a0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.556+0000 7f34bdffb640 1 -- 172.21.15.47:0/4092873137 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8010430 con 0x7f34c01083a0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.556+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c01a6d90 con 0x7f34c01083a0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.557+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c0102e70 con 0x7f34c01083a0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.558+0000 7f34bdffb640 1 -- 172.21.15.47:0/4092873137 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f34a8004fd0 con 0x7f34c01083a0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.559+0000 7f34bdffb640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f34ac0b6510 0x7f34ac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.559+0000 7f34bffff640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f34ac0b6510 0x7f34ac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.559+0000 7f34bdffb640 1 -- 172.21.15.47:0/4092873137 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7f34a80e7770 con 0x7f34c01083a0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.559+0000 7f34bffff640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f34ac0b6510 0x7f34ac0b8a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f34c006ba20 tx=0x7f34b000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.563+0000 7f34bdffb640 1 -- 172.21.15.47:0/4092873137 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f34a80ae000 con 0x7f34c01083a0 2024-09-21T01:07:38.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.753+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34c002e640 con 0x7f34c01083a0 2024-09-21T01:07:38.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.754+0000 7f34bdffb640 1 -- 172.21.15.47:0/4092873137 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22632 (secure 0 0 0) 0x7f34a80b23e0 con 0x7f34c01083a0 2024-09-21T01:07:38.756 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-21T01:07:38.756 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":77,"fsid":"1256112e-77b3-11ef-baf5-efdc52797490","created":"2024-09-21T00:48:36.407074+0000","modified":"2024-09-21T00:57:26.756741+0000","last_up_change":"2024-09-21T00:55:59.929184+0000","last_in_change":"2024-09-21T00:55:37.568702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T00:52:17.628162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T00:56:45.468079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T00:56:47.230573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de86c79d-f53b-4eab-800e-4d753d91edcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6803","nonce":629047334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6805","nonce":629047334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6809","nonce":629047334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":629047334},{"type":"v1","addr":"172.21.15.47:6807","nonce":629047334}]},"public_addr":"172.21.15.47:6803/629047334","cluster_addr":"172.21.15.47:6805/629047334","heartbeat_back_addr":"172.21.15.47:6809/629047334","heartbeat_front_addr":"172.21.15.47:6807/629047334","state":["exists","up"]},{"osd":1,"uuid":"fb0a490d-37e6-4813-8581-97797d58186e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6801","nonce":2077637956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6803","nonce":2077637956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6807","nonce":2077637956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2077637956},{"type":"v1","addr":"172.21.15.114:6805","nonce":2077637956}]},"public_addr":"172.21.15.114:6801/2077637956","cluster_addr":"172.21.15.114:6803/2077637956","heartbeat_back_addr":"172.21.15.114:6807/2077637956","heartbeat_front_addr":"172.21.15.114:6805/2077637956","state":["exists","up"]},{"osd":2,"uuid":"8b64b789-55fa-4e4e-bb5d-d853fd5f466c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6801","nonce":2759710953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6803","nonce":2759710953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6807","nonce":2759710953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2759710953},{"type":"v1","addr":"172.21.15.134:6805","nonce":2759710953}]},"public_addr":"172.21.15.134:6801/2759710953","cluster_addr":"172.21.15.134:6803/2759710953","heartbeat_back_addr":"172.21.15.134:6807/2759710953","heartbeat_front_addr":"172.21.15.134:6805/2759710953","state":["exists","up"]},{"osd":3,"uuid":"4a93ad02-8a42-41ef-9eb8-6f787f0ae186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6811","nonce":1095561403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6813","nonce":1095561403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6817","nonce":1095561403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1095561403},{"type":"v1","addr":"172.21.15.47:6815","nonce":1095561403}]},"public_addr":"172.21.15.47:6811/1095561403","cluster_addr":"172.21.15.47:6813/1095561403","heartbeat_back_addr":"172.21.15.47:6817/1095561403","heartbeat_front_addr":"172.21.15.47:6815/1095561403","state":["exists","up"]},{"osd":4,"uuid":"3fefab4d-27ed-43e7-bc5e-8438c93a827c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6809","nonce":3945171658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6811","nonce":3945171658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6815","nonce":3945171658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3945171658},{"type":"v1","addr":"172.21.15.114:6813","nonce":3945171658}]},"public_addr":"172.21.15.114:6809/3945171658","cluster_addr":"172.21.15.114:6811/3945171658","heartbeat_back_addr":"172.21.15.114:6815/3945171658","heartbeat_front_addr":"172.21.15.114:6813/3945171658","state":["exists","up"]},{"osd":5,"uuid":"e32d102e-b303-4ecd-83af-60bcb38996d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6809","nonce":1310952352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6811","nonce":1310952352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6815","nonce":1310952352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1310952352},{"type":"v1","addr":"172.21.15.134:6813","nonce":1310952352}]},"public_addr":"172.21.15.134:6809/1310952352","cluster_addr":"172.21.15.134:6811/1310952352","heartbeat_back_addr":"172.21.15.134:6815/1310952352","heartbeat_front_addr":"172.21.15.134:6813/1310952352","state":["exists","up"]},{"osd":6,"uuid":"775f48c6-25b0-4e62-b1dd-c132a13c72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6819","nonce":4174188807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6821","nonce":4174188807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6825","nonce":4174188807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4174188807},{"type":"v1","addr":"172.21.15.47:6823","nonce":4174188807}]},"public_addr":"172.21.15.47:6819/4174188807","cluster_addr":"172.21.15.47:6821/4174188807","heartbeat_back_addr":"172.21.15.47:6825/4174188807","heartbeat_front_addr":"172.21.15.47:6823/4174188807","state":["exists","up"]},{"osd":7,"uuid":"57c50ddf-b4db-435a-bfda-5cf763920d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6817","nonce":4057336411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6819","nonce":4057336411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6823","nonce":4057336411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":4057336411},{"type":"v1","addr":"172.21.15.114:6821","nonce":4057336411}]},"public_addr":"172.21.15.114:6817/4057336411","cluster_addr":"172.21.15.114:6819/4057336411","heartbeat_back_addr":"172.21.15.114:6823/4057336411","heartbeat_front_addr":"172.21.15.114:6821/4057336411","state":["exists","up"]},{"osd":8,"uuid":"f5c831d8-e430-457b-a42f-2fd18ee686be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6817","nonce":690122230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6819","nonce":690122230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6823","nonce":690122230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":690122230},{"type":"v1","addr":"172.21.15.134:6821","nonce":690122230}]},"public_addr":"172.21.15.134:6817/690122230","cluster_addr":"172.21.15.134:6819/690122230","heartbeat_back_addr":"172.21.15.134:6823/690122230","heartbeat_front_addr":"172.21.15.134:6821/690122230","state":["exists","up"]},{"osd":9,"uuid":"3820216c-43ae-4cab-8f20-487787f5fa2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6827","nonce":525420370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6829","nonce":525420370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6833","nonce":525420370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":525420370},{"type":"v1","addr":"172.21.15.47:6831","nonce":525420370}]},"public_addr":"172.21.15.47:6827/525420370","cluster_addr":"172.21.15.47:6829/525420370","heartbeat_back_addr":"172.21.15.47:6833/525420370","heartbeat_front_addr":"172.21.15.47:6831/525420370","state":["exists","up"]},{"osd":10,"uuid":"8b2e5646-7db2-41ad-9b2d-ca7c7377466d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6825","nonce":1056730214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6827","nonce":1056730214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6831","nonce":1056730214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1056730214},{"type":"v1","addr":"172.21.15.114:6829","nonce":1056730214}]},"public_addr":"172.21.15.114:6825/1056730214","cluster_addr":"172.21.15.114:6827/1056730214","heartbeat_back_addr":"172.21.15.114:6831/1056730214","heartbeat_front_addr":"172.21.15.114:6829/1056730214","state":["exists","up"]},{"osd":11,"uuid":"78c28fc6-4934-498a-8600-d78cf377eb4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6825","nonce":1422408215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6827","nonce":1422408215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6831","nonce":1422408215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1422408215},{"type":"v1","addr":"172.21.15.134:6829","nonce":1422408215}]},"public_addr":"172.21.15.134:6825/1422408215","cluster_addr":"172.21.15.134:6827/1422408215","heartbeat_back_addr":"172.21.15.134:6831/1422408215","heartbeat_front_addr":"172.21.15.134:6829/1422408215","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:21.867910+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:51:47.639459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:13.469976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:52:38.660987+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:03.717733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:28.956434+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:53:54.956678+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:20.381821+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:54:44.550991+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:09.714553+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:34.459261+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T00:55:58.371800+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/3201312639":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6801/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/3930494204":"2024-09-22T00:49:25.157910+0000","172.21.15.47:6800/1191304788":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2329069135":"2024-09-22T00:49:25.157910+0000","172.21.15.47:0/2951177130":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1944491425":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6801/3263172120":"2024-09-22T00:48:58.868983+0000","172.21.15.47:0/1988986045":"2024-09-22T00:48:58.868983+0000","172.21.15.47:6800/3263172120":"2024-09-22T00:48:58.868983+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f34ac0b6510 msgr2=0x7f34ac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f34ac0b6510 0x7f34ac0b8a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f34c006ba20 tx=0x7f34b000b410 comp rx=0 tx=0).stop 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c01083a0 msgr2=0x7f34c019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c01083a0 0x7f34c019b790 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f34a800e9c0 tx=0x7f34a800ee80 comp rx=0 tx=0).stop 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 shutdown_connections 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f34ac0b6510 0x7f34ac0b8a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34c0108cf0 0x7f34c019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34c01083a0 0x7f34c019b790 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 --2- 172.21.15.47:0/4092873137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c0102a60 0x7f34c019b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 >> 172.21.15.47:0/4092873137 conn(0x7f34c0079730 msgr2=0x7f34c0104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:38.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 shutdown_connections 2024-09-21T01:07:38.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:38.757+0000 7f34c683e640 1 -- 172.21.15.47:0/4092873137 wait complete. 2024-09-21T01:07:39.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:39 smithi134 ceph-mon[34785]: pgmap v613: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 10 op/s 2024-09-21T01:07:39.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:39 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/4092873137' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:07:39.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:39 smithi047 ceph-mon[30960]: pgmap v613: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 10 op/s 2024-09-21T01:07:39.392 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:39 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/4092873137' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:07:39.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:39 smithi114 ceph-mon[34309]: pgmap v613: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 10 op/s 2024-09-21T01:07:39.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:39 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/4092873137' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:07:39.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T01:07:39.683 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:40.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.166+0000 7fd2b9598640 1 -- 172.21.15.47:0/2526093115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b41100c0 msgr2=0x7fd2b4112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.166+0000 7fd2b9598640 1 --2- 172.21.15.47:0/2526093115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b41100c0 0x7fd2b4112500 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009ca0 tx=0x7fd2ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.166+0000 7fd2b9598640 1 -- 172.21.15.47:0/2526093115 shutdown_connections 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.166+0000 7fd2b9598640 1 --2- 172.21.15.47:0/2526093115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b41100c0 0x7fd2b4112500 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.166+0000 7fd2b9598640 1 --2- 172.21.15.47:0/2526093115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2b4076100 0x7fd2b410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.166+0000 7fd2b9598640 1 --2- 172.21.15.47:0/2526093115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2b40757b0 0x7fd2b4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.166+0000 7fd2b9598640 1 -- 172.21.15.47:0/2526093115 >> 172.21.15.47:0/2526093115 conn(0x7fd2b407b850 msgr2=0x7fd2b407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.167+0000 7fd2b9598640 1 -- 172.21.15.47:0/2526093115 shutdown_connections 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.167+0000 7fd2b9598640 1 -- 172.21.15.47:0/2526093115 wait complete. 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.167+0000 7fd2b9598640 1 Processor -- start 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b9598640 1 -- start start 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b9598640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2b40757b0 0x7fd2b419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b9598640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b4076100 0x7fd2b419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b9598640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2b41100c0 0x7fd2b41a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:40.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b9598640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4115c70 con 0x7fd2b4076100 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b9598640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4115af0 con 0x7fd2b41100c0 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b9598640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4115df0 con 0x7fd2b40757b0 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b4076100 0x7fd2b419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2b40757b0 0x7fd2b419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b4076100 0x7fd2b419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57518/0 (socket says 172.21.15.47:57518) 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2abfff640 1 -- 172.21.15.47:0/3313609112 learned_addr learned my addr 172.21.15.47:0/3313609112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b37fe640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2b41100c0 0x7fd2b41a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2abfff640 1 -- 172.21.15.47:0/3313609112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2b40757b0 msgr2=0x7fd2b419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2abfff640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2b40757b0 0x7fd2b419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2abfff640 1 -- 172.21.15.47:0/3313609112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2b41100c0 msgr2=0x7fd2b41a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2abfff640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2b41100c0 0x7fd2b41a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2abfff640 1 -- 172.21.15.47:0/3313609112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b41a2650 con 0x7fd2b4076100 2024-09-21T01:07:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.168+0000 7fd2b37fe640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2b41100c0 0x7fd2b41a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.169+0000 7fd2abfff640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b4076100 0x7fd2b419cc80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00e9c0 tx=0x7fd29c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.169+0000 7fd2b0ff9640 1 -- 172.21.15.47:0/3313609112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00cd80 con 0x7fd2b4076100 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.169+0000 7fd2b0ff9640 1 -- 172.21.15.47:0/3313609112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd29c0035f0 con 0x7fd2b4076100 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.169+0000 7fd2b0ff9640 1 -- 172.21.15.47:0/3313609112 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c010690 con 0x7fd2b4076100 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.169+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b41a2940 con 0x7fd2b4076100 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.169+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b41a90a0 con 0x7fd2b4076100 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.170+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b4075bc0 con 0x7fd2b4076100 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.172+0000 7fd2b0ff9640 1 -- 172.21.15.47:0/3313609112 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd29c004000 con 0x7fd2b4076100 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.172+0000 7fd2b0ff9640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd2a00b6590 0x7fd2a00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.172+0000 7fd2b2ffd640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd2a00b6590 0x7fd2a00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.173+0000 7fd2b0ff9640 1 -- 172.21.15.47:0/3313609112 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8153+0+0 (secure 0 0 0) 0x7fd29c0e76e0 con 0x7fd2b4076100 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.173+0000 7fd2b2ffd640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd2a00b6590 0x7fd2a00b8aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009bd0 tx=0x7fd2a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.177+0000 7fd2b0ff9640 1 -- 172.21.15.47:0/3313609112 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd29c0ae010 con 0x7fd2b4076100 2024-09-21T01:07:40.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.406+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd2b41a9360 con 0x7fd2b4076100 2024-09-21T01:07:40.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.409+0000 7fd2b0ff9640 1 -- 172.21.15.47:0/3313609112 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7fd29c0b23f0 con 0x7fd2b4076100 2024-09-21T01:07:40.410 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T01:07:40.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd2a00b6590 msgr2=0x7fd2a00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd2a00b6590 0x7fd2a00b8aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009bd0 tx=0x7fd2a4005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:40.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b4076100 msgr2=0x7fd2b419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b4076100 0x7fd2b419cc80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00e9c0 tx=0x7fd29c00ee80 comp rx=0 tx=0).stop 2024-09-21T01:07:40.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 shutdown_connections 2024-09-21T01:07:40.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fd2a00b6590 0x7fd2a00b8aa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2b41100c0 0x7fd2b41a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2b4076100 0x7fd2b419cc80 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 --2- 172.21.15.47:0/3313609112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2b40757b0 0x7fd2b419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.412+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 >> 172.21.15.47:0/3313609112 conn(0x7fd2b407b850 msgr2=0x7fd2b4108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:40.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.413+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 shutdown_connections 2024-09-21T01:07:40.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:40.413+0000 7fd2b9598640 1 -- 172.21.15.47:0/3313609112 wait complete. 2024-09-21T01:07:40.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a[30956]: 2024-09-21T01:07:40.407+0000 7f3ce316a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:07:40.844 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:07:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i[62797]: ignoring --setuser ceph since I am not root 2024-09-21T01:07:40.844 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:07:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i[62797]: ignoring --setgroup ceph since I am not root 2024-09-21T01:07:40.844 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:07:40 smithi134 ceph-mds[62801]: -- 172.21.15.134:0/2050958875 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c936bc5860 con 0x55c93ad6d600 2024-09-21T01:07:40.844 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:07:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i[62797]: starting mds.i at 2024-09-21T01:07:40.910 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:07:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b[62424]: ignoring --setuser ceph since I am not root 2024-09-21T01:07:40.910 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:07:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b[62424]: ignoring --setgroup ceph since I am not root 2024-09-21T01:07:40.910 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:07:40 smithi114 ceph-mds[62429]: -- 172.21.15.114:0/3536478803 <== mon.2 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c4f825860 con 0x564c539cd600 2024-09-21T01:07:40.910 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:07:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b[62424]: starting mds.b at 2024-09-21T01:07:41.060 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T01:07:41.081 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:41 smithi047 ceph-mon[30960]: pgmap v614: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:07:41.082 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:41 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3313609112' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:07:41.082 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:41 smithi047 ceph-mon[30960]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:07:41.082 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:41 smithi047 ceph-mon[30960]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:07:41.082 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:41 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/3313609112' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:07:41.323 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:41 smithi134 ceph-mon[34785]: pgmap v614: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:07:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:41 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3313609112' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:07:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:41 smithi134 ceph-mon[34785]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:07:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:41 smithi134 ceph-mon[34785]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:07:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:41 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/3313609112' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:07:41.344 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:41 smithi134 ceph-mon[34785]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:07:41.345 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:41 smithi134 ceph-mon[34785]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T01:07:41.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:41 smithi114 ceph-mon[34309]: pgmap v614: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:07:41.409 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:41 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3313609112' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:07:41.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:41 smithi114 ceph-mon[34309]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:07:41.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:41 smithi114 ceph-mon[34309]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:07:41.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:41 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/3313609112' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:07:41.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:41 smithi114 ceph-mon[34309]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:07:41.410 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:41 smithi114 ceph-mon[34309]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T01:07:41.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:41 smithi047 ceph-mon[30960]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:07:41.445 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:41 smithi047 ceph-mon[30960]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T01:07:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 -- 172.21.15.47:0/3470407413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 msgr2=0x7fc9c010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/3470407413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 0x7fc9c010d930 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009900 tx=0x7fc9b002a410 comp rx=0 tx=0).stop 2024-09-21T01:07:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 -- 172.21.15.47:0/3470407413 shutdown_connections 2024-09-21T01:07:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/3470407413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c010de70 0x7fc9c0110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/3470407413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 0x7fc9c010d930 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/3470407413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c01048c0 0x7fc9c0104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 -- 172.21.15.47:0/3470407413 >> 172.21.15.47:0/3470407413 conn(0x7fc9c0079760 msgr2=0x7fc9c0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 -- 172.21.15.47:0/3470407413 shutdown_connections 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.774+0000 7fc9c5bce640 1 -- 172.21.15.47:0/3470407413 wait complete. 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.775+0000 7fc9c5bce640 1 Processor -- start 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.775+0000 7fc9c5bce640 1 -- start start 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.775+0000 7fc9c5bce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c01048c0 0x7fc9c019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.775+0000 7fc9c5bce640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 0x7fc9c019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.775+0000 7fc9c5bce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c010de70 0x7fc9c019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.775+0000 7fc9c5bce640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0113ab0 con 0x7fc9c01052a0 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.775+0000 7fc9c5bce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0113930 con 0x7fc9c010de70 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.775+0000 7fc9c5bce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0113c30 con 0x7fc9c01048c0 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 0x7fc9c019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 0x7fc9c019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46424/0 (socket says 172.21.15.47:46424) 2024-09-21T01:07:41.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 -- 172.21.15.47:0/2420674587 learned_addr learned my addr 172.21.15.47:0/2420674587 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9bffff640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c010de70 0x7fc9c019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9bf7fe640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c01048c0 0x7fc9c019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 -- 172.21.15.47:0/2420674587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c01048c0 msgr2=0x7fc9c019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c01048c0 0x7fc9c019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 -- 172.21.15.47:0/2420674587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c010de70 msgr2=0x7fc9c019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c010de70 0x7fc9c019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 -- 172.21.15.47:0/2420674587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c01a04d0 con 0x7fc9c01052a0 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9bffff640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c010de70 0x7fc9c019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9beffd640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 0x7fc9c019ab00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0006010 tx=0x7fc9b0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9bcff9640 1 -- 172.21.15.47:0/2420674587 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b003f030 con 0x7fc9c01052a0 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c01a0760 con 0x7fc9c01052a0 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9bcff9640 1 -- 172.21.15.47:0/2420674587 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9b0003aa0 con 0x7fc9c01052a0 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9bcff9640 1 -- 172.21.15.47:0/2420674587 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0035070 con 0x7fc9c01052a0 2024-09-21T01:07:41.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.776+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c01a6f20 con 0x7fc9c01052a0 2024-09-21T01:07:41.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.777+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c006c190 con 0x7fc9c01052a0 2024-09-21T01:07:41.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.780+0000 7fc9bcff9640 1 -- 172.21.15.47:0/2420674587 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc9b0042030 con 0x7fc9c01052a0 2024-09-21T01:07:41.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.781+0000 7fc9bcff9640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9ac0b6510 0x7fc9ac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:41.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.781+0000 7fc9bf7fe640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9ac0b6510 0x7fc9ac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:41.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.781+0000 7fc9bcff9640 1 -- 172.21.15.47:0/2420674587 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8239+0+0 (secure 0 0 0) 0x7fc9b0107b70 con 0x7fc9c01052a0 2024-09-21T01:07:41.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.781+0000 7fc9bf7fe640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9ac0b6510 0x7fc9ac0b8a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006c890 tx=0x7fc9a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:41.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:41.784+0000 7fc9bcff9640 1 -- 172.21.15.47:0/2420674587 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9b00ce400 con 0x7fc9c01052a0 2024-09-21T01:07:42.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.015+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc9c0108fa0 con 0x7fc9c01052a0 2024-09-21T01:07:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.416+0000 7fc9bcff9640 1 -- 172.21.15.47:0/2420674587 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7fc9b00d27e0 con 0x7fc9c01052a0 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.419+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9ac0b6510 msgr2=0x7fc9ac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.419+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9ac0b6510 0x7fc9ac0b8a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006c890 tx=0x7fc9a8005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.419+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 msgr2=0x7fc9c019ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.419+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 0x7fc9c019ab00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0006010 tx=0x7fc9b0004060 comp rx=0 tx=0).stop 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.420+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 shutdown_connections 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.420+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7fc9ac0b6510 0x7fc9ac0b8a20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.420+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c010de70 0x7fc9c019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.420+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9c01052a0 0x7fc9c019ab00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.420+0000 7fc9c5bce640 1 --2- 172.21.15.47:0/2420674587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c01048c0 0x7fc9c019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.420+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 >> 172.21.15.47:0/2420674587 conn(0x7fc9c0079760 msgr2=0x7fc9c00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.420+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 shutdown_connections 2024-09-21T01:07:42.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:42.420+0000 7fc9c5bce640 1 -- 172.21.15.47:0/2420674587 wait complete. 2024-09-21T01:07:42.465 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:42 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.134:6838/4288706656,v1:172.21.15.134:6839/4288706656] up:boot 2024-09-21T01:07:42.466 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:42 smithi047 ceph-mon[30960]: mds.? [v2:172.21.15.114:6838/2383501716,v1:172.21.15.114:6839/2383501716] up:boot 2024-09-21T01:07:42.466 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:42 smithi047 ceph-mon[30960]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T01:07:42.466 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:07:42.466 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:42 smithi047 ceph-mon[30960]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:07:42.466 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:42 smithi047 ceph-mon[30960]: pgmap v616: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 409 B/s wr, 9 op/s 2024-09-21T01:07:42.466 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:42 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2420674587' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:42 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.134:6838/4288706656,v1:172.21.15.134:6839/4288706656] up:boot 2024-09-21T01:07:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:42 smithi134 ceph-mon[34785]: mds.? [v2:172.21.15.114:6838/2383501716,v1:172.21.15.114:6839/2383501716] up:boot 2024-09-21T01:07:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:42 smithi134 ceph-mon[34785]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T01:07:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:07:42.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:42 smithi134 ceph-mon[34785]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:07:42.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:42 smithi134 ceph-mon[34785]: pgmap v616: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 409 B/s wr, 9 op/s 2024-09-21T01:07:42.845 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:42 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2420674587' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:42.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:42 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.134:6838/4288706656,v1:172.21.15.134:6839/4288706656] up:boot 2024-09-21T01:07:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:42 smithi114 ceph-mon[34309]: mds.? [v2:172.21.15.114:6838/2383501716,v1:172.21.15.114:6839/2383501716] up:boot 2024-09-21T01:07:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:42 smithi114 ceph-mon[34309]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T01:07:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:07:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:42 smithi114 ceph-mon[34309]: from='mgr.14152 172.21.15.47:0/3545093132' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:07:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:42 smithi114 ceph-mon[34309]: pgmap v616: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 409 B/s wr, 9 op/s 2024-09-21T01:07:42.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:42 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2420674587' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:07:43.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T01:07:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:43.420 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:43 smithi047 ceph-mon[30960]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:07:43.420 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:43 smithi047 ceph-mon[30960]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:07:43.420 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:43 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/2420674587' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:43.420 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:43 smithi047 ceph-mon[30960]: fsmap 12 up:standby 2024-09-21T01:07:43.746 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:43 smithi134 ceph-mon[34785]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:07:43.746 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:43 smithi134 ceph-mon[34785]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:07:43.746 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:43 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/2420674587' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:43.746 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:43 smithi134 ceph-mon[34785]: fsmap 12 up:standby 2024-09-21T01:07:43.811 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:43 smithi114 ceph-mon[34309]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:07:43.811 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:43 smithi114 ceph-mon[34309]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:07:43.811 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:43 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/2420674587' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:07:43.811 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:43 smithi114 ceph-mon[34309]: fsmap 12 up:standby 2024-09-21T01:07:43.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1302151873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 msgr2=0x7f3e14102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:43.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1302151873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 0x7f3e14102ef0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009900 tx=0x7f3e0402a410 comp rx=0 tx=0).stop 2024-09-21T01:07:43.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1302151873 shutdown_connections 2024-09-21T01:07:43.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1302151873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e14108d20 0x7f3e1410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1302151873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e141083d0 0x7f3e141087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1302151873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 0x7f3e14102ef0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1302151873 >> 172.21.15.47:0/1302151873 conn(0x7f3e140797b0 msgr2=0x7f3e14079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:43.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1302151873 shutdown_connections 2024-09-21T01:07:43.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.944+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1302151873 wait complete. 2024-09-21T01:07:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e1a5c4640 1 Processor -- start 2024-09-21T01:07:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e1a5c4640 1 -- start start 2024-09-21T01:07:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e1a5c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 0x7f3e1419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e1a5c4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e141083d0 0x7f3e1419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e1a5c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e14108d20 0x7f3e1419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:43.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e1a5c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141129e0 con 0x7f3e14102ae0 2024-09-21T01:07:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e1a5c4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14112860 con 0x7f3e141083d0 2024-09-21T01:07:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e1a5c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14112b60 con 0x7f3e14108d20 2024-09-21T01:07:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 0x7f3e1419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 0x7f3e1419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46440/0 (socket says 172.21.15.47:46440) 2024-09-21T01:07:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.945+0000 7f3e13fff640 1 -- 172.21.15.47:0/1874084069 learned_addr learned my addr 172.21.15.47:0/1874084069 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e137fe640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e141083d0 0x7f3e1419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e18b61640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e14108d20 0x7f3e1419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:43.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e13fff640 1 -- 172.21.15.47:0/1874084069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e14108d20 msgr2=0x7f3e1419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e13fff640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e14108d20 0x7f3e1419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e13fff640 1 -- 172.21.15.47:0/1874084069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e141083d0 msgr2=0x7f3e1419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e13fff640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e141083d0 0x7f3e1419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e13fff640 1 -- 172.21.15.47:0/1874084069 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e141a04b0 con 0x7f3e14102ae0 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e13fff640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 0x7f3e1419a540 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3e04005940 tx=0x7f3e04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e117fa640 1 -- 172.21.15.47:0/1874084069 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0403f030 con 0x7f3e14102ae0 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e141a0740 con 0x7f3e14102ae0 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e117fa640 1 -- 172.21.15.47:0/1874084069 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e04003aa0 con 0x7f3e14102ae0 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e117fa640 1 -- 172.21.15.47:0/1874084069 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04035070 con 0x7f3e14102ae0 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.946+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e141a6f00 con 0x7f3e14102ae0 2024-09-21T01:07:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.947+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e14103d10 con 0x7f3e14102ae0 2024-09-21T01:07:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.949+0000 7f3e117fa640 1 -- 172.21.15.47:0/1874084069 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3e04042030 con 0x7f3e14102ae0 2024-09-21T01:07:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.950+0000 7f3e117fa640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.950+0000 7f3e117fa640 1 -- 172.21.15.47:0/1874084069 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8239+0+0 (secure 0 0 0) 0x7f3e04107c00 con 0x7f3e14102ae0 2024-09-21T01:07:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.950+0000 7f3e137fe640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:43.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.950+0000 7f3e137fe640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3e1406c730 tx=0x7f3e08005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:43.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:43.953+0000 7f3e117fa640 1 -- 172.21.15.47:0/1874084069 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e040d2870 con 0x7f3e14102ae0 2024-09-21T01:07:44.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.142+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3e14102ef0 con 0x7f3e14102ae0 2024-09-21T01:07:44.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.423+0000 7f3e117fa640 1 -- 172.21.15.47:0/1874084069 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) ==== 181+0+0 (secure 0 0 0) 0x7f3e14102ef0 con 0x7f3e14102ae0 2024-09-21T01:07:44.426 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-09-21T01:07:44.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3dfc0b6510 msgr2=0x7f3dfc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:44.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3e1406c730 tx=0x7f3e08005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:44.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 msgr2=0x7f3e1419a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:44.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 0x7f3e1419a540 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3e04005940 tx=0x7f3e04004270 comp rx=0 tx=0).stop 2024-09-21T01:07:44.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 shutdown_connections 2024-09-21T01:07:44.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:44.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e14108d20 0x7f3e1419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:44.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e141083d0 0x7f3e1419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:44.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 --2- 172.21.15.47:0/1874084069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e14102ae0 0x7f3e1419a540 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:44.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 >> 172.21.15.47:0/1874084069 conn(0x7f3e140797b0 msgr2=0x7f3e14101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:44.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 shutdown_connections 2024-09-21T01:07:44.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:44.427+0000 7f3e1a5c4640 1 -- 172.21.15.47:0/1874084069 wait complete. 2024-09-21T01:07:44.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:44 smithi047 ceph-mon[30960]: pgmap v617: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 409 B/s wr, 8 op/s 2024-09-21T01:07:44.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:44 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1874084069' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:07:44.762 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:44 smithi134 ceph-mon[34785]: pgmap v617: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 409 B/s wr, 8 op/s 2024-09-21T01:07:44.762 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:44 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1874084069' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:07:44.827 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:44 smithi114 ceph-mon[34309]: pgmap v617: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 409 B/s wr, 8 op/s 2024-09-21T01:07:44.827 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:44 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1874084069' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:07:45.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 1256112e-77b3-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T01:07:45.346 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:45.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:45 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/1874084069' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:07:45.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:45 smithi047 ceph-mon[30960]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:07:45.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 -- 172.21.15.47:0/672711462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c104a20 msgr2=0x7f7f0c104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:45.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 --2- 172.21.15.47:0/672711462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c104a20 0x7f7f0c104e30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009ca0 tx=0x7f7efc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:45.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 -- 172.21.15.47:0/672711462 shutdown_connections 2024-09-21T01:07:45.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 --2- 172.21.15.47:0/672711462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c10de50 0x7f7f0c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:45.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 --2- 172.21.15.47:0/672711462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f0c105370 0x7f7f0c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 --2- 172.21.15.47:0/672711462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c104a20 0x7f7f0c104e30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 -- 172.21.15.47:0/672711462 >> 172.21.15.47:0/672711462 conn(0x7f7f0c0796d0 msgr2=0x7f7f0c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 -- 172.21.15.47:0/672711462 shutdown_connections 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.783+0000 7f7f120c4640 1 -- 172.21.15.47:0/672711462 wait complete. 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.784+0000 7f7f120c4640 1 Processor -- start 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.784+0000 7f7f120c4640 1 -- start start 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.784+0000 7f7f120c4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c104a20 0x7f7f0c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.784+0000 7f7f120c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c105370 0x7f7f0c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.784+0000 7f7f120c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f0c10de50 0x7f7f0c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.784+0000 7f7f120c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c113ab0 con 0x7f7f0c105370 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.784+0000 7f7f120c4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c113930 con 0x7f7f0c104a20 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.784+0000 7f7f120c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c113c30 con 0x7f7f0c10de50 2024-09-21T01:07:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c105370 0x7f7f0c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c104a20 0x7f7f0c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c105370 0x7f7f0c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46458/0 (socket says 172.21.15.47:46458) 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 -- 172.21.15.47:0/977469957 learned_addr learned my addr 172.21.15.47:0/977469957 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0bfff640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f0c10de50 0x7f7f0c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 -- 172.21.15.47:0/977469957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f0c10de50 msgr2=0x7f7f0c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f0c10de50 0x7f7f0c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 -- 172.21.15.47:0/977469957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c104a20 msgr2=0x7f7f0c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c104a20 0x7f7f0c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 -- 172.21.15.47:0/977469957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c1a03f0 con 0x7f7f0c105370 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0bfff640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f0c10de50 0x7f7f0c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0b7fe640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c104a20 0x7f7f0c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f0affd640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c105370 0x7f7f0c19aa20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e9c0 tx=0x7f7ef400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f08ff9640 1 -- 172.21.15.47:0/977469957 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400ccc0 con 0x7f7f0c105370 2024-09-21T01:07:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c1a06e0 con 0x7f7f0c105370 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f08ff9640 1 -- 172.21.15.47:0/977469957 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ef40054d0 con 0x7f7f0c105370 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.785+0000 7f7f08ff9640 1 -- 172.21.15.47:0/977469957 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4010430 con 0x7f7f0c105370 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.786+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c1a6e40 con 0x7f7f0c105370 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.786+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c06c1f0 con 0x7f7f0c105370 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.788+0000 7f7f08ff9640 1 -- 172.21.15.47:0/977469957 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7ef4005020 con 0x7f7f0c105370 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.789+0000 7f7f08ff9640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ef80b6510 0x7f7ef80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.789+0000 7f7f0b7fe640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ef80b6510 0x7f7ef80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.789+0000 7f7f08ff9640 1 -- 172.21.15.47:0/977469957 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7743+0+0 (secure 0 0 0) 0x7f7ef40e7660 con 0x7f7f0c105370 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.790+0000 7f7f0b7fe640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ef80b6510 0x7f7ef80b8a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7efc005e30 tx=0x7f7efc009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:45.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.792+0000 7f7f08ff9640 1 -- 172.21.15.47:0/977469957 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ef4056710 con 0x7f7f0c105370 2024-09-21T01:07:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:45 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/1874084069' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:07:45.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:45 smithi134 ceph-mon[34785]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:07:45.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:45 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/1874084069' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:07:45.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:45 smithi114 ceph-mon[34309]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:07:45.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:45.985+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f0c104e30 con 0x7f7f0c105370 2024-09-21T01:07:46.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.429+0000 7f7f08ff9640 1 -- 172.21.15.47:0/977469957 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) ==== 169+0+0 (secure 0 0 0) 0x7f7ef40ae090 con 0x7f7f0c105370 2024-09-21T01:07:46.432 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-09-21T01:07:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ef80b6510 msgr2=0x7f7ef80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ef80b6510 0x7f7ef80b8a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7efc005e30 tx=0x7f7efc009360 comp rx=0 tx=0).stop 2024-09-21T01:07:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c105370 msgr2=0x7f7f0c19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c105370 0x7f7f0c19aa20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e9c0 tx=0x7f7ef400ee80 comp rx=0 tx=0).stop 2024-09-21T01:07:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 shutdown_connections 2024-09-21T01:07:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:6800/2364161608,v1:172.21.15.47:6801/2364161608] conn(0x7f7ef80b6510 0x7f7ef80b8a20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f0c10de50 0x7f7f0c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:46.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f0c105370 0x7f7f0c19aa20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:46.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 --2- 172.21.15.47:0/977469957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c104a20 0x7f7f0c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:46.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 >> 172.21.15.47:0/977469957 conn(0x7f7f0c0796d0 msgr2=0x7f7f0c107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:46.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 shutdown_connections 2024-09-21T01:07:46.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-21T01:07:46.435+0000 7f7f120c4640 1 -- 172.21.15.47:0/977469957 wait complete. 2024-09-21T01:07:46.707 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:46 smithi047 ceph-mon[30960]: pgmap v619: 65 pgs: 65 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:07:46.708 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:46 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/977469957' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:07:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:46 smithi134 ceph-mon[34785]: pgmap v619: 65 pgs: 65 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:07:46.844 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:46 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/977469957' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:07:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:46 smithi114 ceph-mon[34309]: pgmap v619: 65 pgs: 65 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:07:46.910 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:46 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/977469957' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:07:47.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:07:47.158 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:07:47.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:07:47.227 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T01:07:47.228 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:07:47.252 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:07:47.279 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:07:47.302 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T01:07:47.302 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T01:07:47.302 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.a 2024-09-21T01:07:47.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:47 smithi134 ceph-mon[34785]: from='client.? 172.21.15.47:0/977469957' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:07:47.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:47 smithi134 ceph-mon[34785]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T01:07:47.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:47 smithi047 systemd[1]: Stopping Ceph mon.a for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:07:47.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:47 smithi047 ceph-mon[30960]: from='client.? 172.21.15.47:0/977469957' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:07:47.706 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:47 smithi047 ceph-mon[30960]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T01:07:47.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:47 smithi114 ceph-mon[34309]: from='client.? 172.21.15.47:0/977469957' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:07:47.909 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:47 smithi114 ceph-mon[34309]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T01:07:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a[30956]: 2024-09-21T01:07:47.877+0000 7f3ce8975640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a[30956]: 2024-09-21T01:07:47.877+0000 7f3ce8975640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T01:07:48.206 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:48 smithi047 podman[92826]: 2024-09-21 01:07:48.102544156 +0000 UTC m=+0.431621760 container died 8538b21c152b1ece3fd2e6c53f57fb4a31f2004b874028996975a70560875fb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T01:07:48.766 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:48 smithi047 podman[92826]: 2024-09-21 01:07:48.49796939 +0000 UTC m=+0.827046983 container cleanup 8538b21c152b1ece3fd2e6c53f57fb4a31f2004b874028996975a70560875fb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:07:48.766 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 21 01:07:48 smithi047 bash[92826]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-a 2024-09-21T01:07:48.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T01:07:49.020 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:49.020 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T01:07:49.020 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T01:07:49.020 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.b 2024-09-21T01:07:49.354 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:49 smithi114 systemd[1]: Stopping Ceph mon.b for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:07:49.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-b[34305]: 2024-09-21T01:07:49.353+0000 7f8142f9e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:49.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-b[34305]: 2024-09-21T01:07:49.353+0000 7f8142f9e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:07:49.659 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:49 smithi114 podman[65161]: 2024-09-21 01:07:49.577222788 +0000 UTC m=+0.362887134 container died 0753b23967edd954f998d3172ec2d15112877b1a46fb1de4b63eb5eed39aee6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:50.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:49 smithi114 podman[65161]: 2024-09-21 01:07:49.937003947 +0000 UTC m=+0.722668289 container cleanup 0753b23967edd954f998d3172ec2d15112877b1a46fb1de4b63eb5eed39aee6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:07:50.159 INFO:journalctl@ceph.mon.b.smithi114.stdout:Sep 21 01:07:49 smithi114 bash[65161]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-b 2024-09-21T01:07:50.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T01:07:50.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:50.478 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T01:07:50.478 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T01:07:50.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.c 2024-09-21T01:07:50.778 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:50 smithi134 systemd[1]: Stopping Ceph mon.c for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:07:51.051 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-c[34781]: 2024-09-21T01:07:50.776+0000 7f2e4abcf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:51.051 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-c[34781]: 2024-09-21T01:07:50.776+0000 7f2e4abcf640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:07:51.311 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:51 smithi134 podman[65628]: 2024-09-21 01:07:51.05121303 +0000 UTC m=+0.375784861 container died 12b713ce9ec33063d5651978d803d9d933e697d49767989a8718631b4b7c81c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T01:07:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:51 smithi134 podman[65628]: 2024-09-21 01:07:51.432683031 +0000 UTC m=+0.757254846 container cleanup 12b713ce9ec33063d5651978d803d9d933e697d49767989a8718631b4b7c81c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:07:51.594 INFO:journalctl@ceph.mon.c.smithi134.stdout:Sep 21 01:07:51 smithi134 bash[65628]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mon-c 2024-09-21T01:07:51.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T01:07:51.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:51.909 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T01:07:51.909 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T01:07:51.909 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.x 2024-09-21T01:07:52.205 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 01:07:51 smithi047 systemd[1]: Stopping Ceph mgr.x for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:07:52.706 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 01:07:52 smithi047 podman[92941]: 2024-09-21 01:07:52.310586512 +0000 UTC m=+0.165755869 container died ad3984ea913e7ce2139f33edb7edd8d0f01cbb7fdb0c8154b7e0299a2537129e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:07:53.046 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 01:07:52 smithi047 podman[92941]: 2024-09-21 01:07:52.85316488 +0000 UTC m=+0.708334223 container cleanup ad3984ea913e7ce2139f33edb7edd8d0f01cbb7fdb0c8154b7e0299a2537129e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T01:07:53.046 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 01:07:52 smithi047 bash[92941]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x 2024-09-21T01:07:53.335 INFO:journalctl@ceph.mgr.x.smithi047.stdout:Sep 21 01:07:53 smithi047 podman[92952]: 2024-09-21 01:07:53.046377704 +0000 UTC m=+0.728941707 container remove ad3984ea913e7ce2139f33edb7edd8d0f01cbb7fdb0c8154b7e0299a2537129e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T01:07:53.352 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T01:07:53.389 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:53.389 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T01:07:53.390 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T01:07:53.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.y 2024-09-21T01:07:53.713 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 01:07:53 smithi114 systemd[1]: Stopping Ceph mgr.y for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:07:54.001 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 01:07:53 smithi114 podman[65282]: 2024-09-21 01:07:53.712796078 +0000 UTC m=+0.140630304 container died 99048e0d70dce33867d25d947733e99429cf9ea240dba9a6dba00cbc74d0544c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:07:54.376 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 01:07:54 smithi114 podman[65282]: 2024-09-21 01:07:54.083608615 +0000 UTC m=+0.511442841 container cleanup 99048e0d70dce33867d25d947733e99429cf9ea240dba9a6dba00cbc74d0544c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T01:07:54.377 INFO:journalctl@ceph.mgr.y.smithi114.stdout:Sep 21 01:07:54 smithi114 bash[65282]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-y 2024-09-21T01:07:54.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T01:07:54.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:54.548 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T01:07:54.548 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T01:07:54.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.z 2024-09-21T01:07:54.844 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:54 smithi134 systemd[1]: Stopping Ceph mgr.z for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:07:55.134 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:54 smithi134 podman[65754]: 2024-09-21 01:07:54.878513067 +0000 UTC m=+0.145298675 container died b036b3909eaae89a60aa56ebe58f63aa1b657a245ce9e5bf502cd1f8f6af07c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:07:55.425 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:55 smithi134 podman[65754]: 2024-09-21 01:07:55.207238721 +0000 UTC m=+0.474024330 container cleanup b036b3909eaae89a60aa56ebe58f63aa1b657a245ce9e5bf502cd1f8f6af07c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-z, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:07:55.426 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:55 smithi134 bash[65754]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-z 2024-09-21T01:07:55.676 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:55 smithi134 podman[65765]: 2024-09-21 01:07:55.425328788 +0000 UTC m=+0.541953776 container remove b036b3909eaae89a60aa56ebe58f63aa1b657a245ce9e5bf502cd1f8f6af07c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T01:07:55.676 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:55 smithi134 systemd[1]: ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T01:07:55.676 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:55 smithi134 systemd[1]: ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.z.service: Failed with result 'exit-code'. 2024-09-21T01:07:55.676 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:55 smithi134 systemd[1]: Stopped Ceph mgr.z for 1256112e-77b3-11ef-baf5-efdc52797490. 2024-09-21T01:07:55.676 INFO:journalctl@ceph.mgr.z.smithi134.stdout:Sep 21 01:07:55 smithi134 systemd[1]: ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.z.service: Consumed 6.840s CPU time. 2024-09-21T01:07:55.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T01:07:55.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:07:55.712 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T01:07:55.712 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T01:07:55.712 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.0 2024-09-21T01:07:56.100 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:07:55 smithi047 systemd[1]: Stopping Ceph osd.0 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:07:56.456 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:07:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0[44322]: 2024-09-21T01:07:56.099+0000 7f866339f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:07:56.456 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:07:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0[44322]: 2024-09-21T01:07:56.099+0000 7f866339f640 -1 osd.0 80 *** Got signal Terminated *** 2024-09-21T01:07:56.456 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:07:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0[44322]: 2024-09-21T01:07:56.099+0000 7f866339f640 -1 osd.0 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:08:02.705 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:02 smithi047 podman[93062]: 2024-09-21 01:08:02.459494001 +0000 UTC m=+6.488099473 container died d14b418a09050e37219930bed6a7a813360621dc9fe89a789a40ea4d721459f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T01:08:03.202 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:02 smithi047 podman[93062]: 2024-09-21 01:08:02.933548179 +0000 UTC m=+6.962153688 container cleanup d14b418a09050e37219930bed6a7a813360621dc9fe89a789a40ea4d721459f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:08:03.202 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:02 smithi047 bash[93062]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0 2024-09-21T01:08:03.455 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:03 smithi047 podman[93083]: 2024-09-21 01:08:03.201928351 +0000 UTC m=+0.736250948 container remove d14b418a09050e37219930bed6a7a813360621dc9fe89a789a40ea4d721459f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:08:03.838 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:03 smithi047 podman[93171]: 2024-09-21 01:08:03.454863629 +0000 UTC m=+0.016705893 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:08:03.839 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:03 smithi047 podman[93171]: 2024-09-21 01:08:03.577750442 +0000 UTC m=+0.139592704 container create 0e561af7d0a9a22e2a0fd55dde84d6c2efb53355f2c45140c626f8ee0cceecc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:08:03.839 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:03 smithi047 podman[93171]: 2024-09-21 01:08:03.838596244 +0000 UTC m=+0.400438508 container init 0e561af7d0a9a22e2a0fd55dde84d6c2efb53355f2c45140c626f8ee0cceecc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:08:04.206 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:03 smithi047 podman[93171]: 2024-09-21 01:08:03.842148925 +0000 UTC m=+0.403991189 container start 0e561af7d0a9a22e2a0fd55dde84d6c2efb53355f2c45140c626f8ee0cceecc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T01:08:04.206 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:03 smithi047 podman[93171]: 2024-09-21 01:08:03.947086177 +0000 UTC m=+0.508928455 container attach 0e561af7d0a9a22e2a0fd55dde84d6c2efb53355f2c45140c626f8ee0cceecc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:08:04.206 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 21 01:08:04 smithi047 podman[93171]: 2024-09-21 01:08:04.043988665 +0000 UTC m=+0.605830933 container died 0e561af7d0a9a22e2a0fd55dde84d6c2efb53355f2c45140c626f8ee0cceecc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T01:08:04.687 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T01:08:04.735 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:04.735 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T01:08:04.735 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T01:08:04.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.1 2024-09-21T01:08:05.155 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:04 smithi114 systemd[1]: Stopping Ceph osd.1 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:08:05.409 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1[38249]: 2024-09-21T01:08:05.154+0000 7f213f623640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:05.409 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1[38249]: 2024-09-21T01:08:05.154+0000 7f213f623640 -1 osd.1 80 *** Got signal Terminated *** 2024-09-21T01:08:05.409 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1[38249]: 2024-09-21T01:08:05.154+0000 7f213f623640 -1 osd.1 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:08:35.409 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:35 smithi114 bash[65406]: time="2024-09-21T01:08:35Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1 in 30 seconds, resorting to SIGKILL" 2024-09-21T01:08:35.410 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:35 smithi114 podman[65406]: 2024-09-21 01:08:35.231638664 +0000 UTC m=+30.308619722 container died 114157088f9fa55880f028602888f857a909f22f8ed19c3718b3109ee8981127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T01:08:35.688 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:35 smithi114 podman[65406]: 2024-09-21 01:08:35.637131133 +0000 UTC m=+30.714112188 container cleanup 114157088f9fa55880f028602888f857a909f22f8ed19c3718b3109ee8981127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T01:08:35.688 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:35 smithi114 bash[65406]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1 2024-09-21T01:08:36.159 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:35 smithi114 podman[65421]: 2024-09-21 01:08:35.830126684 +0000 UTC m=+0.595631900 container remove 114157088f9fa55880f028602888f857a909f22f8ed19c3718b3109ee8981127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:08:36.159 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:35 smithi114 systemd[1]: ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.1.service: Main process exited, code=exited, status=137/n/a 2024-09-21T01:08:36.567 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:36 smithi114 podman[65519]: 2024-09-21 01:08:36.168183912 +0000 UTC m=+0.020413265 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:08:36.567 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:36 smithi114 podman[65519]: 2024-09-21 01:08:36.322939088 +0000 UTC m=+0.175168432 container create d25a3d3dc5057d3ad9eb43f1bf736fed5c4a91acce138c32335c1c859f942b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:08:36.910 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:36 smithi114 podman[65519]: 2024-09-21 01:08:36.566915595 +0000 UTC m=+0.419144934 container init d25a3d3dc5057d3ad9eb43f1bf736fed5c4a91acce138c32335c1c859f942b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T01:08:36.910 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:36 smithi114 podman[65519]: 2024-09-21 01:08:36.571249875 +0000 UTC m=+0.423479215 container start d25a3d3dc5057d3ad9eb43f1bf736fed5c4a91acce138c32335c1c859f942b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:08:36.910 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:36 smithi114 podman[65519]: 2024-09-21 01:08:36.675466668 +0000 UTC m=+0.527696019 container attach d25a3d3dc5057d3ad9eb43f1bf736fed5c4a91acce138c32335c1c859f942b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:08:36.910 INFO:journalctl@ceph.osd.1.smithi114.stdout:Sep 21 01:08:36 smithi114 podman[65519]: 2024-09-21 01:08:36.774075822 +0000 UTC m=+0.626305168 container died d25a3d3dc5057d3ad9eb43f1bf736fed5c4a91acce138c32335c1c859f942b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T01:08:37.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T01:08:37.386 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:08:37.386 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T01:08:37.386 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T01:08:37.386 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.2 2024-09-21T01:08:37.844 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:08:37 smithi134 systemd[1]: Stopping Ceph osd.2 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:08:38.344 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:08:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2[39152]: 2024-09-21T01:08:37.909+0000 7fd45eda3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:08:38.344 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:08:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2[39152]: 2024-09-21T01:08:37.909+0000 7fd45eda3640 -1 osd.2 80 *** Got signal Terminated *** 2024-09-21T01:08:38.344 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:08:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2[39152]: 2024-09-21T01:08:37.909+0000 7fd45eda3640 -1 osd.2 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:09:03.659 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:03.365+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:04.659 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:04.316+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:04.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:04 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:04.486+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:04.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:04 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:04.664+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:04.956 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:04 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:04.773+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:04.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:04 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:04.889+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:05.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:05.440+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:05.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:05.342+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:05.659 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:05.354+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:05.955 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:05.810+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:05.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:05.859+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:05.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:05.638+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:06.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:06.435+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:06.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:06.305+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:06.659 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:06.358+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:06.956 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:06 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:06.814+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:06.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:06 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:06.873+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:06.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:06 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:06.637+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:07.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:07.450+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:07.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:07.289+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:07.659 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:07 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:07.402+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:07.956 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:07 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:07.861+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:07.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:07 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:07.829+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:07.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:07 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:07.630+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:08.258 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:07 smithi134 bash[65877]: time="2024-09-21T01:09:07Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2 in 30 seconds, resorting to SIGKILL" 2024-09-21T01:09:08.259 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:07 smithi134 podman[65877]: 2024-09-21 01:09:07.992983099 +0000 UTC m=+30.417030260 container died 84d4db730545579d1ac823d21f156078afefba4f05993b55cdde73b610be5734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T01:09:08.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:08 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:08.449+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:08.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:08 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:08.278+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:08.594 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:08 smithi134 podman[65877]: 2024-09-21 01:09:08.349204791 +0000 UTC m=+30.773251938 container cleanup 84d4db730545579d1ac823d21f156078afefba4f05993b55cdde73b610be5734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T01:09:08.594 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:08 smithi134 bash[65877]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2 2024-09-21T01:09:08.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:08 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:08.417+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:08.955 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:08 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:08.870+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:08.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:08 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:08.632+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:08.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:08 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:08.863+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:09.010 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:08 smithi134 podman[65907]: 2024-09-21 01:09:08.651203938 +0000 UTC m=+0.653036926 container remove 84d4db730545579d1ac823d21f156078afefba4f05993b55cdde73b610be5734 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T01:09:09.010 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:08 smithi134 systemd[1]: ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.2.service: Main process exited, code=exited, status=137/n/a 2024-09-21T01:09:09.262 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:09 smithi134 podman[65995]: 2024-09-21 01:09:08.913230711 +0000 UTC m=+0.016603725 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:09:09.262 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:09 smithi134 podman[65995]: 2024-09-21 01:09:09.018754421 +0000 UTC m=+0.122127477 container create 9aa18f8ceaad9c8cf646eb14437655eccfe7ac8b95d2ab5c77e2e4fa8edf9f5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T01:09:09.263 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:09 smithi134 podman[65995]: 2024-09-21 01:09:09.229404915 +0000 UTC m=+0.332777932 container init 9aa18f8ceaad9c8cf646eb14437655eccfe7ac8b95d2ab5c77e2e4fa8edf9f5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:09:09.263 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:09 smithi134 podman[65995]: 2024-09-21 01:09:09.232594207 +0000 UTC m=+0.335967221 container start 9aa18f8ceaad9c8cf646eb14437655eccfe7ac8b95d2ab5c77e2e4fa8edf9f5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T01:09:09.594 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:09 smithi134 podman[65995]: 2024-09-21 01:09:09.337898735 +0000 UTC m=+0.441271761 container attach 9aa18f8ceaad9c8cf646eb14437655eccfe7ac8b95d2ab5c77e2e4fa8edf9f5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:09:09.594 INFO:journalctl@ceph.osd.2.smithi134.stdout:Sep 21 01:09:09 smithi134 podman[65995]: 2024-09-21 01:09:09.425391422 +0000 UTC m=+0.528764436 container died 9aa18f8ceaad9c8cf646eb14437655eccfe7ac8b95d2ab5c77e2e4fa8edf9f5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:09:09.595 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:09.435+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:09.595 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:09.261+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:09.908 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:09 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:09.827+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:09.908 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:09 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:09.642+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:09.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:09 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:09.438+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:09.985 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T01:09:10.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:09:10.025 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T01:09:10.026 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T01:09:10.026 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.3 2024-09-21T01:09:10.205 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:10 smithi047 systemd[1]: Stopping Ceph osd.3 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:09:10.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:09 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:09.907+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:10.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:10.409+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:10.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:10.305+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:10.667 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:10.358+0000 7f6b803bc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:09:10.668 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:10.358+0000 7f6b803bc640 -1 osd.3 80 *** Got signal Terminated *** 2024-09-21T01:09:10.668 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:10.358+0000 7f6b803bc640 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:09:10.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:10 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:10.449+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:10.955 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:10.818+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:10.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:10.667+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:10.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:10.914+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:11.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:11.343+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:11.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:11.425+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:11.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:11 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:11.410+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:11.916 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:11 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:11.816+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:11.916 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:11 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:11.647+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:12.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:11 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:11.915+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:12.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:12.461+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:12.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:12.302+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:12.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:12 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:12.442+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:12.916 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:12 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:12.782+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:12.917 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:12 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:12.658+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:13.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:12 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:12.916+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:13.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:13.468+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:13.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:13.324+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:13.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:13 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:13.440+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:13.931 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:13.802+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:13.932 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:13.652+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:14.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:13.931+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:14.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:14.289+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:14.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:14.478+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:14.887 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3[50864]: 2024-09-21T01:09:14.766+0000 7f6b7c9a7640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.330776+0000 front 2024-09-21T01:07:58.330888+0000 (oldest deadline 2024-09-21T01:09:04.230989+0000) 2024-09-21T01:09:14.887 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:14.604+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:14.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:14 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:14.415+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:15.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:14.886+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:15.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:15 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:15.448+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:15.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:15 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:15.289+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:15.882 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:15 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:15.584+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:15.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:15 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:15.454+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:16.151 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:15 smithi047 podman[93287]: 2024-09-21 01:09:15.882284726 +0000 UTC m=+5.647712655 container died 48422cd398c78516079eb46f40a34454e9bbbe723db35925afe3a5a6e3f5d966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T01:09:16.152 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:15 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:15.915+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:16.455 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:16 smithi047 podman[93287]: 2024-09-21 01:09:16.360587332 +0000 UTC m=+6.126015260 container cleanup 48422cd398c78516079eb46f40a34454e9bbbe723db35925afe3a5a6e3f5d966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T01:09:16.456 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:16 smithi047 bash[93287]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3 2024-09-21T01:09:16.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:16 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:16.456+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:16.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:16 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:16.272+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:16.892 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:16 smithi047 podman[93302]: 2024-09-21 01:09:16.769682214 +0000 UTC m=+0.881063388 container remove 48422cd398c78516079eb46f40a34454e9bbbe723db35925afe3a5a6e3f5d966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T01:09:16.893 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:16.578+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:16.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:16 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:16.488+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:17.162 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:17 smithi047 podman[93391]: 2024-09-21 01:09:17.041479014 +0000 UTC m=+0.016797035 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:09:17.163 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:16.892+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:17.449 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:17 smithi047 podman[93391]: 2024-09-21 01:09:17.162401854 +0000 UTC m=+0.137719904 container create 35a6fa2b73bb746fd5a714875f67b2afd358f6ed32912f6691b7ef4365b8f7ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T01:09:17.449 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:17 smithi047 podman[93391]: 2024-09-21 01:09:17.365284754 +0000 UTC m=+0.340602763 container init 35a6fa2b73bb746fd5a714875f67b2afd358f6ed32912f6691b7ef4365b8f7ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:09:17.449 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:17 smithi047 podman[93391]: 2024-09-21 01:09:17.368709648 +0000 UTC m=+0.344027657 container start 35a6fa2b73bb746fd5a714875f67b2afd358f6ed32912f6691b7ef4365b8f7ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T01:09:17.449 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:17 smithi047 podman[93391]: 2024-09-21 01:09:17.448246125 +0000 UTC m=+0.423564134 container attach 35a6fa2b73bb746fd5a714875f67b2afd358f6ed32912f6691b7ef4365b8f7ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T01:09:17.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:17 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:17.473+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:17.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:17 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:17.292+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:17.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:17.561+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:17.706 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 21 01:09:17 smithi047 podman[93391]: 2024-09-21 01:09:17.570274462 +0000 UTC m=+0.545592482 container died 35a6fa2b73bb746fd5a714875f67b2afd358f6ed32912f6691b7ef4365b8f7ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-21T01:09:17.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:17 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:17.441+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:18.119 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:17.862+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:18.141 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T01:09:18.182 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:09:18.182 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T01:09:18.183 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T01:09:18.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.4 2024-09-21T01:09:18.489 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:18.426+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:18.489 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:18 smithi114 systemd[1]: Stopping Ceph osd.4 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:09:18.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:18 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:18.279+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:18.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:18 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:18.431+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:18.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:18.517+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:18.909 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4[44689]: 2024-09-21T01:09:18.488+0000 7f401c176640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:09:18.909 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4[44689]: 2024-09-21T01:09:18.488+0000 7f401c176640 -1 osd.4 80 *** Got signal Terminated *** 2024-09-21T01:09:18.910 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4[44689]: 2024-09-21T01:09:18.488+0000 7f401c176640 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:09:19.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:18.816+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:19.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:19 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:19.388+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:19.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:19 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:19.236+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:19.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:19.554+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:19.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:19 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:19.472+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:20.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:19.779+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:20.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:20 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:20.366+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:20.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:20 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:20.248+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:20.786 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:20.533+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:20.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:20.485+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:21.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:20.786+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:21.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:21 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:21.402+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:21.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:21 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:21.207+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:21.809 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:21.515+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:21.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:21 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:21.528+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:22.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:21.808+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:22.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:22 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:22.196+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:22.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:22 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:22.433+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:22.842 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:22.512+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:22.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:22 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:22.542+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:23.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:22.841+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:23.469 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:23.198+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:23.807 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:23.542+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:23.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:23.467+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:23.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:23 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:23.518+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:24.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:23.807+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:24.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:24 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:24.235+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:24.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:24 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:24.423+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:24.791 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:24.517+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:24.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:24 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:24.492+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:25.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:24.790+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:25.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:25.448+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:25.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:25.254+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:25.757 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:25.495+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:25.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:25 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:25.487+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:26.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:25.756+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:26.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:26 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:26.445+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:26.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:26 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:26.290+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:26.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:26 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:26.502+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:26.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:26.741+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:26.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:26.518+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:27.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:27.340+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:27.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:27.414+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:27.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:27 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:27.533+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:27.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:27.783+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:27.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:27.552+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:28.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:28 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:28.385+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:28.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:28 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:28.366+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:28.898 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:28 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:28.736+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:28.899 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:28 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:28.514+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:28.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:28.536+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:29.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:29.334+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:29.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:29.380+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:29.746 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:29 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:29.538+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:29.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:29 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:29.550+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:30.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:29 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:29.745+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:30.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:30.378+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:30.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:30.420+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:30.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:30 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:30.569+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:30.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:30 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:30.705+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:30.955 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:30 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:30.583+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:31.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:31 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:31.391+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:31.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:31 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:31.466+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:31.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:31.596+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:31.955 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:31 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:31.613+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:31.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:31 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:31.719+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:32.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:32 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:32.436+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:32.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:32 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:32.478+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:32.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:32 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:32.606+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:32.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:32 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:32.719+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:32.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:32 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:32.629+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:33.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:33 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:33.439+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:33.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:33 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:33.502+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:33.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:33.630+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:33.955 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:33 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:33.593+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:33.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:33 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:33.720+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:34.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:34 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:34.399+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:34.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:34 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:34.471+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:34.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:34.626+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:34.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:34 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:34.745+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:34.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:34 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:34.639+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:35.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:35 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:35.354+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:35.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:35 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:35.502+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:35.880 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:35 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:35.629+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:35.881 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:35 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:35.759+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:35.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:35 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:35.652+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:36.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:36.536+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:36.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:36.382+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:36.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:36.382+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:36.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:36 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:36.794+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:36.955 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:36 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:36.624+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:37.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:36.680+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:37.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:36.889+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:37.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:37.515+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:37.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:37.395+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:37.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:37.395+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:37.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:37 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:37.644+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:37.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:37.754+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:37.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:37.754+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:37.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:37.598+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:37.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:37.598+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:38.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:37.861+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:38.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:38.518+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:38.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:38.518+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:38.844 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:38.361+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:38.845 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:38.361+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:38.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:38 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:38.656+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:38.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:38 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:38.778+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:38.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:38 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:38.778+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:38.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:38 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:38.633+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:38.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:38 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:38.633+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:39.324 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:38.861+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:39.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:39.507+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:39.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:39.507+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:39.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:39.323+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:39.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:39.323+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:39.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:39 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:39.651+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:39.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:39.746+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:39.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:39.746+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:39.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:39.665+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:39.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:39.665+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:40.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:39.832+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:40.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:40.312+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:40.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:40.312+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:40.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:40.549+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:40.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:40.549+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:40.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:40.627+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:41.037 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:40.627+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:41.038 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:40.749+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:41.038 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:40.749+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:41.038 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:40.655+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:41.039 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:40.655+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:41.293 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:40.870+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:41.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:41.292+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:41.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:41.292+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:41.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:41.541+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:41.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:41.541+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:41.625 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:41.204+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:41.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:41.624+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:41.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:41.624+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:41.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:41 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:41.704+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:41.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:41 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:41.704+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:41.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:41 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:41.649+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:41.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:41 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:41.649+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:42.261 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:41.874+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:42.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:42.260+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:42.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:42.260+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:42.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:42.509+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:42.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:42.509+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:42.650 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:42 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:42.169+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:42.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:42 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:42.649+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:42.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:42 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:42.649+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:42.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:42 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:42.752+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:42.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:42 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:42.752+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:42.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:42 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:42.642+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:42.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:42 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:42.642+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:43.240 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:42.906+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:43.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:43 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:43.122+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:43.496 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:43.239+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:43.496 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:43.239+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:43.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:43.495+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:43.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:43.495+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:43.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:43 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:43.752+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:43.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:43 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:43.752+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:43.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:43 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:43.674+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:43.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:43 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:43.674+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:44.129 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:43 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:43.682+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:44.129 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:43 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:43.682+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:44.215 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:43.869+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:44.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:44 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:44.128+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:44.478 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:44.214+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:44.478 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:44.214+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:44.725 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:44 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:44.722+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:44.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:44.477+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:44.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:44.477+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:44.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:44 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:44.640+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:44.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:44 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:44.640+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:45.182 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:44.909+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:45.205 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:44 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:44.722+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:45.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:44 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:44.801+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:45.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:44 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:44.801+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:45.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:45.181+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:45.594 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:45.181+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:45.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:45.427+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:45.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:45.427+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:45.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:45.164+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:45.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:45 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:45.826+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:45.957 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:45 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:45.826+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:45.958 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:45 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:45.677+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:45.958 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:45 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:45.677+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:46.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:45.678+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:46.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:45.678+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:46.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:45.917+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:46.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:46.159+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:46.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:46.159+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:46.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:46 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:46.181+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:46.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:46.410+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:46.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:46.410+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:46.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:46 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:46.860+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:46.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:46 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:46.860+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:46.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:46 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:46.656+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:46.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:46 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:46.656+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:47.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:46 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:46.723+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:47.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:46 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:46.723+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:47.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:46.939+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:47.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:47.140+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:47.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:47.140+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:47.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:47.161+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:47.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:47.408+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:47.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:47.408+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:47.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:47.834+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:47.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:47.834+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:47.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:47.617+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:47.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:47.617+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:48.150 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:47.756+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:48.150 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:47.756+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:48.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:47.932+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:48.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:48.126+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:48.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:48.126+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:48.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:48 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:48.149+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:48.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:48.392+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:48.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:48.392+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:48.909 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:48 smithi114 bash[65626]: time="2024-09-21T01:09:48Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4 in 30 seconds, resorting to SIGKILL" 2024-09-21T01:09:48.909 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:48 smithi114 podman[65626]: 2024-09-21 01:09:48.555536478 +0000 UTC m=+30.180321947 container died 1c428ab52f521a9aad51804c43e776481e9892b06c0451b1f4b8213a1aa53975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T01:09:48.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:48 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:48.721+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:48.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:48 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:48.722+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:48.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:48 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:48.787+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:48.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:48 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:48.787+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:48.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:48 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:48.590+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:48.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:48 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:48.590+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:49.321 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:49.138+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:49.322 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:49 smithi114 podman[65626]: 2024-09-21 01:09:49.087121692 +0000 UTC m=+30.711907150 container cleanup 1c428ab52f521a9aad51804c43e776481e9892b06c0451b1f4b8213a1aa53975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-21T01:09:49.322 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:49 smithi114 bash[65626]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4 2024-09-21T01:09:49.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:48.947+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:49.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:49.106+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:49.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:49.106+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:49.654 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:49 smithi114 podman[65642]: 2024-09-21 01:09:49.32173561 +0000 UTC m=+0.765410983 container remove 1c428ab52f521a9aad51804c43e776481e9892b06c0451b1f4b8213a1aa53975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T01:09:49.654 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:49 smithi114 systemd[1]: ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.4.service: Main process exited, code=exited, status=137/n/a 2024-09-21T01:09:49.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:49.371+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:49.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:49.371+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:49.908 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:49 smithi114 podman[65730]: 2024-09-21 01:09:49.55672816 +0000 UTC m=+0.016053820 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:09:49.908 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:49 smithi114 podman[65730]: 2024-09-21 01:09:49.672595647 +0000 UTC m=+0.131921304 container create 6eb3d28a1d7e1240fba435865b8dba3d2bf9911c79296e8cc3d13c4bd5576415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-21T01:09:49.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:49.733+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:49.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:49.733+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:49.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:49 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:49.810+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:49.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:49 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:49.810+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:49.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:49 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:49.602+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:49.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:49 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:49.602+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:50.160 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:50 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:50.131+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:50.160 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:49 smithi114 podman[65730]: 2024-09-21 01:09:49.90825659 +0000 UTC m=+0.367582244 container init 6eb3d28a1d7e1240fba435865b8dba3d2bf9911c79296e8cc3d13c4bd5576415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:09:50.160 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:49 smithi114 podman[65730]: 2024-09-21 01:09:49.911758772 +0000 UTC m=+0.371084435 container start 6eb3d28a1d7e1240fba435865b8dba3d2bf9911c79296e8cc3d13c4bd5576415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:09:50.160 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:50 smithi114 podman[65730]: 2024-09-21 01:09:50.016970127 +0000 UTC m=+0.476295791 container attach 6eb3d28a1d7e1240fba435865b8dba3d2bf9911c79296e8cc3d13c4bd5576415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T01:09:50.160 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 21 01:09:50 smithi114 podman[65730]: 2024-09-21 01:09:50.102017931 +0000 UTC m=+0.561343588 container died 6eb3d28a1d7e1240fba435865b8dba3d2bf9911c79296e8cc3d13c4bd5576415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:09:50.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:49.954+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:50.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:50.078+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:50.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:50.078+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:50.715 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T01:09:50.754 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:09:50.754 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T01:09:50.754 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T01:09:50.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.5 2024-09-21T01:09:50.777 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:50.394+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:50.777 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:50.394+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:50.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:50.779+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:50.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:50.779+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:50.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:50.639+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:50.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:50.639+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:51.061 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:50 smithi134 systemd[1]: Stopping Ceph osd.5 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:09:51.062 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:50.990+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:51.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:50 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:50.737+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:51.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:50 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:50.737+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:51.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:51.059+0000 7f084d86c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:09:51.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:51.059+0000 7f084d86c640 -1 osd.5 80 *** Got signal Terminated *** 2024-09-21T01:09:51.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:51.059+0000 7f084d86c640 -1 osd.5 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:09:51.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:51.086+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:51.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:51.086+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:51.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:51 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:51.179+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:51.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:51.443+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:51.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:51.443+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:51.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:51.774+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:51.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:51.774+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:51.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:51.595+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:51.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:51.595+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:52.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:51 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:51.746+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:52.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:51 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:51.746+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:52.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:52.049+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:52.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:52.049+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:52.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:51.967+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:52.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:52 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:52.229+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:52.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:52.418+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:52.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:52.418+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:52.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:52.805+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:52.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:52.805+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:52.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:52.625+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:52.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:52.625+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:53.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:52 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:52.782+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:53.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:52 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:52.782+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:53.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:52.934+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:53.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:53.035+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:53.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:53.035+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:53.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:53 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:53.230+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:53.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:53.465+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:53.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:53.465+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:53.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:53.820+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:53.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:53.820+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:53.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:53.579+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:53.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:53.579+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:54.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:53 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:53.793+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:54.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:53 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:53.793+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:54.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:53.911+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:54.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:54.002+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:54.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:54.002+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:54.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:54.188+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:54.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:54.424+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:54.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:54.424+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:54.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:54.800+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:54.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:54.800+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:54.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:54.575+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:54.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:54.575+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:55.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:54.768+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:55.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:54.768+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:55.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:54.864+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:55.345 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:55.002+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:55.345 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:55.002+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:55.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:55 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:55.165+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:55.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:55.451+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:55.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:55.451+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:55.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:55.775+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:55.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:55.775+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:55.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:55.565+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:55.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:55.565+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:56.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:55 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:55.809+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:56.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:55 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:55.809+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:56.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:55.904+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:56.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:56.032+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:58.206168+0000 front 2024-09-21T01:07:58.206155+0000 (oldest deadline 2024-09-21T01:09:04.006669+0000) 2024-09-21T01:09:56.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:09:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5[45451]: 2024-09-21T01:09:56.032+0000 7f0849e57640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:07.407914+0000 front 2024-09-21T01:08:07.407847+0000 (oldest deadline 2024-09-21T01:09:36.010405+0000) 2024-09-21T01:09:56.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:56 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:56.206+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:56.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:56.410+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:56.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:56.410+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:56.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:56.739+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:56.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:56.739+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:56.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:56.607+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:56.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:56.607+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:57.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:56 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:56.764+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:57.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:56 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:56.764+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:57.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:56.941+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:57.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:57 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:57.164+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:57.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:57 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:57.436+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:57.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:57 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:57.436+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:57.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:57.697+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:57.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:57.697+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:57.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:57.576+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:57.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:57.576+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:58.128 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:57 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:57.798+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:58.128 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:57 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:57.798+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:58.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:57 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:57.958+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:58.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:58 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:58.127+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:58.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:58.421+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:58.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:58.421+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:09:58.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:58.731+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:09:58.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:58.731+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:09:58.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:58.531+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:58.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:58.531+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:59.127 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:58 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:58.795+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:09:59.127 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:58 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:58.795+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:09:59.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:58.919+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:09:59.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:09:59 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:09:59.126+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:09:59.763 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:59 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:59.483+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:09:59.763 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:09:59 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:09:59.483+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:09:59.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:59 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:59.427+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:09:59.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:09:59 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:09:59.427+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:00.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:59 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:59.775+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:00.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:09:59 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:09:59.775+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:00.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:59 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:59.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:00.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:09:59 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:09:59.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:00.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:09:59 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:09:59.895+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:00.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:00 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:00.160+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:00.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:00.447+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:00.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:00.447+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:00.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:00.383+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:00.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:00.383+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:01.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:00 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:00.815+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:01.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:00 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:00.815+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:01.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:00.771+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:01.207 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:00 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:00.771+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:01.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:00.924+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:01.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:01.197+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:01.782 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:01 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:01.457+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:01.783 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:01 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:01.457+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:01.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:01 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:01.348+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:01.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:01 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:01.348+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:02.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:01.838+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:02.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:01.838+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:02.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:01 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:01.782+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:02.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:01 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:01.782+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:02.314 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:01 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:01.887+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:02.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:02 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:02.313+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:02.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:02 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:02.313+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:02.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:02 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:02.242+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:02.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:02 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:02.442+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:02.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:02 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:02.442+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:03.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:02 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:02.818+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:03.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:02 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:02.818+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:03.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:02 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:02.732+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:03.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:02 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:02.732+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:03.277 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:02 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:02.859+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:03.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:03 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:03.276+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:03.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:03 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:03.276+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:03.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:03.233+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:03.717 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:03.460+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:03.717 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:03.460+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:04.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:03.844+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:04.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:03.844+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:04.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:03.716+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:04.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:03 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:03.716+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:04.233 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:03 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:03.852+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:04.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:04 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:04.231+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:04.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:04 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:04.231+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:04.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:04.244+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:04.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:04 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:04.412+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:04.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:04 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:04.412+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:05.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:04.891+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:05.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:04.891+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:05.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:04 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:04.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:05.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:04 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:04.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:05.253 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:04 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:04.900+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:05.428 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:05.263+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:05.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:05.252+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:05.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:05.252+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:05.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:05.383+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:05.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:05.383+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:06.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:05.890+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:06.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:05.890+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:06.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:05.754+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:06.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:05 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:05.755+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:06.215 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:05.936+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:06.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:06.214+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:06.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:06.214+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:06.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:06.240+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:06.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:06 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:06.381+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:06.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:06 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:06.381+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:07.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:06.859+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:07.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:06.859+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:07.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:06 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:06.748+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:07.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:06 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:06.748+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:07.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:07.177+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:07.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:07.177+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:07.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:06.929+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:07.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:07 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:07.230+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:07.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:07 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:07.337+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:07.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:07 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:07.337+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:08.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:07 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:07.897+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:08.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:07 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:07.897+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:08.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:07 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:07.772+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:08.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:07 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:07.772+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:08.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:07.953+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:08.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:08 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:08.127+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:08.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:08 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:08.127+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:08.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:08 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:08.190+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:08.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:08 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:08.335+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:08.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:08 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:08.335+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:09.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:08 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:08.726+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:09.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:08 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:08.726+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:09.231 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:08 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:08.935+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:09.231 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:08 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:08.935+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:09.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:08.999+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:09.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:09.128+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:09.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:09.128+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:09.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:09 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:09.231+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:09.695 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:09 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:09.303+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:09.695 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:09 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:09.303+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:09.955 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:09 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:09.694+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:09.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:09 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:09.694+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:10.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:10.032+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:10.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:10.032+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:10.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:10.122+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:10.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:10.122+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:10.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:10 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:10.184+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:10.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:09 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:09.952+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:10.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:09 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:09.952+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:10.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:10.302+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:10.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:10.302+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:11.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:10.713+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:11.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:10 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:10.713+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:11.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:10.997+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:11.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:10.997+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:11.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:11.085+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:11.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:11.085+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:11.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:11.085+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:11.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:11 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:11.179+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:11.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:11 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:11.179+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:11.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:10 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:10.956+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:11.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:10 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:10.956+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:11.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:11 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:11.345+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:11.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:11 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:11.345+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:12.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:11 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:11.753+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:12.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:11 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:11.753+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:12.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:12.016+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:12.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:12.016+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:12.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:12.088+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:12.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:12.088+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:12.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:12.088+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:12.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:12 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:12.155+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:12.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:12 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:12.155+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:12.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:11 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:11.920+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:12.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:11 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:11.920+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:12.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:11 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:11.920+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:12.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:12 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:12.320+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:12.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:12 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:12.321+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:13.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:12 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:12.880+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:13.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:12 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:12.880+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:13.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:12 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:12.880+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:13.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:12 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:12.768+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:13.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:12 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:12.768+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:13.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:12 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:12.768+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:13.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:13.019+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:13.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:13.019+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:13.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:13.108+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:13.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:13.108+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:13.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:13.108+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:13.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:13 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:13.173+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:13.660 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:13 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:13.173+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:13.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:13.283+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:13.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:13.283+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:13.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:13.283+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:14.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:13 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:13.881+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:14.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:13 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:13.881+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:14.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:13 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:13.881+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:14.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:13.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:14.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:13.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:14.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:13 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:13.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:14.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:13.987+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:14.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:13.987+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:14.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:14.061+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:14.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:14.061+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:14.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:14.062+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:14.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:14 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:14.207+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:14.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:14 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:14.207+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:14.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:14.240+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:14.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:14.240+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:14.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:14.240+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:15.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:14 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:14.854+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:15.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:14 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:14.854+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:15.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:14 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:14.854+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:15.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:14.753+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:15.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:14.753+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:15.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:14 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:14.753+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:15.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:15 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:15.109+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:15.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:15 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:15.109+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:15.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:15 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:15.109+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:15.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:14.967+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:15.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:14 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:14.967+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:15.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:15 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:15.185+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:15.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:15 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:15.185+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:15.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:15 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:15.213+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:15.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:15 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:15.213+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:15.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:15 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:15.213+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:16.147 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:15 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:15.812+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:16.148 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:15 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:15.812+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:16.148 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:15 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:15.812+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:16.167 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:15 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:15.742+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:16.168 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:15 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:15.742+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:16.168 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:15 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:15.742+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:16.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:15 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:15.943+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:16.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:15 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:15.943+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:16.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:16 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:16.115+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:16.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:16 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:16.116+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:16.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:16 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:16.116+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:16.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:16 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:16.147+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:16.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:16 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:16.147+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:16.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:16 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:16.147+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:16.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:16.165+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:16.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:16.165+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:16.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:16.165+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:16.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:16.165+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:17.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:16 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:16.836+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:17.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:16 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:16.836+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:17.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:16 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:16.836+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:17.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:16.707+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:17.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:16.707+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:17.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:16.707+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:17.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:16 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:16.707+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:17.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:16 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:16.975+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:17.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:16 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:16.975+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:17.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:17 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:17.106+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:17.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:17 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:17.106+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:17.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:17 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:17.106+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:17.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:17 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:17.196+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:17.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:17 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:17.196+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:17.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:17 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:17.196+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:17.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:17.204+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:17.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:17.204+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:17.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:17.204+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:17.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:17.204+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:18.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:17 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:17.855+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:18.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:17 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:17.855+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:18.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:17 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:17.855+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:18.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:17.747+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:18.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:17.747+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:18.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:17.747+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:18.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:17.747+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:18.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:17 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:17.965+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:18.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:17 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:17.965+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:18.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:17 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:17.965+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:18.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:18 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:18.155+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:18.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:18 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:18.155+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:18.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:18 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:18.155+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:18.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:18.179+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:18.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:18.179+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:18.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:18.179+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:18.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:18.244+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:18.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:18.244+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:18.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:18.244+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:18.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:18.244+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:19.158 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:18.895+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:19.158 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:18.895+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:19.158 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:18 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:18.895+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:19.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:18.779+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:19.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:18.779+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:19.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:18.779+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:19.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:18 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:18.779+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:19.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:19 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:19.163+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:19.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:19 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:19.163+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:19.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:19 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:19.163+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:19.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:18 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:18.953+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:19.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:18 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:18.953+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:19.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:18 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:18.953+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:19.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:19 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:19.157+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:19.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:19 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:19.157+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:19.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:19 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:19.157+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:19.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:19.218+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:19.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:19.218+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:19.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:19.218+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:19.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:19.218+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:20.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:19 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:19.888+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:20.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:19 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:19.888+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:20.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:19 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:19.888+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:20.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:19.785+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:20.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:19.785+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:20.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:19.785+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:20.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:19 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:19.785+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:20.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:19 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:19.924+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:20.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:19 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:19.924+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:20.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:19 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:19.924+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:20.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:20 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:20.139+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:20.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:20 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:20.139+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:20.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:20 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:20.139+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:20.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:20.191+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:20.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:20.191+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:20.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:20.191+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:20.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:20.239+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:20.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:20.239+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:20.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:20.239+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:20.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:20.239+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:21.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:20.853+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:21.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:20.853+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:21.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:20 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:20.853+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:21.177 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:21 smithi134 bash[66111]: time="2024-09-21T01:10:21Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5 in 30 seconds, resorting to SIGKILL" 2024-09-21T01:10:21.177 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:21 smithi134 podman[66111]: 2024-09-21 01:10:21.1464304 +0000 UTC m=+30.209735608 container died 1961fc9720a7e26bd2a3d2ffaa61906aadf4fbfa2756f4909a622035add7866f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T01:10:21.177 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:20 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:20.911+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:21.177 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:20 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:20.911+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:21.177 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:20 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:20.911+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:21.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:20.781+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:21.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:20.781+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:21.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:20.781+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:21.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:20 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:20.781+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:21.492 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:21 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:21.175+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:21.492 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:21 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:21.175+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:21.492 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:21 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:21.175+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:21.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:21 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:21.211+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:21.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:21 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:21.211+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:21.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:21 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:21.211+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:21.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:21.235+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:21.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:21.235+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:21.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:21.235+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:21.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:21.235+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:21.777 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:21 smithi134 podman[66111]: 2024-09-21 01:10:21.491718198 +0000 UTC m=+30.555023393 container cleanup 1961fc9720a7e26bd2a3d2ffaa61906aadf4fbfa2756f4909a622035add7866f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:10:21.777 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:21 smithi134 bash[66111]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5 2024-09-21T01:10:22.094 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:21 smithi134 podman[66139]: 2024-09-21 01:10:21.776634529 +0000 UTC m=+0.632746759 container remove 1961fc9720a7e26bd2a3d2ffaa61906aadf4fbfa2756f4909a622035add7866f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T01:10:22.094 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:21 smithi134 systemd[1]: ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.5.service: Main process exited, code=exited, status=137/n/a 2024-09-21T01:10:22.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:21 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:21.956+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:22.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:21 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:21.956+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:22.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:21 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:21.956+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:22.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:21 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:21.850+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:22.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:21 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:21.850+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:22.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:21 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:21.850+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:22.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:21 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:21.850+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:22.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:21.760+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:22.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:21.760+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:22.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:21.760+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:22.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:21.760+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:22.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:22 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:22.195+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:22.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:22 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:22.195+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:22.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:22 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:22.195+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:22.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:22 smithi134 podman[66228]: 2024-09-21 01:10:22.094056958 +0000 UTC m=+0.105394931 container create b6a1e4a87918d2b345b00086ff60326da67b98958757e466cad503d292fc5fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T01:10:22.344 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:22 smithi134 podman[66228]: 2024-09-21 01:10:22.004885731 +0000 UTC m=+0.016223716 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:10:22.345 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:22 smithi134 podman[66228]: 2024-09-21 01:10:22.321548598 +0000 UTC m=+0.332886570 container init b6a1e4a87918d2b345b00086ff60326da67b98958757e466cad503d292fc5fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:10:22.345 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:22 smithi134 podman[66228]: 2024-09-21 01:10:22.324911619 +0000 UTC m=+0.336249601 container start b6a1e4a87918d2b345b00086ff60326da67b98958757e466cad503d292fc5fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:10:22.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:22 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:22.193+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:22.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:22 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:22.193+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:22.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:22 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:22.193+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:22.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:22.278+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:22.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:22.278+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:22.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:22.278+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:22.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:22.278+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:22.825 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:22 smithi134 podman[66228]: 2024-09-21 01:10:22.465772489 +0000 UTC m=+0.477110461 container attach b6a1e4a87918d2b345b00086ff60326da67b98958757e466cad503d292fc5fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:10:22.825 INFO:journalctl@ceph.osd.5.smithi134.stdout:Sep 21 01:10:22 smithi134 podman[66228]: 2024-09-21 01:10:22.518430597 +0000 UTC m=+0.529768580 container died b6a1e4a87918d2b345b00086ff60326da67b98958757e466cad503d292fc5fa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T01:10:23.092 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:22 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:22.963+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:23.092 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:22 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:22.963+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:23.093 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:22 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:22.963+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:23.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T01:10:23.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:22 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:22.835+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:23.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:22 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:22.835+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:23.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:22 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:22.835+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:23.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:22 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:22.835+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:23.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:10:23.198 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T01:10:23.198 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T01:10:23.198 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.6 2024-09-21T01:10:23.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:22.756+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:23.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:22.756+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:23.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:22.756+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:23.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:22 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:22.756+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:23.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:23.170+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:23.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:23.170+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:23.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:23.170+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:23.512 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:23 smithi047 systemd[1]: Stopping Ceph osd.6 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:10:23.512 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:23.282+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:23.513 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:23.282+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:23.513 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:23.282+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:23.513 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:23.282+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:23.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:23 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:23.202+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:23.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:23 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:23.202+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:23.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:23 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:23.202+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:23.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:23.510+0000 7f4066f4e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:10:23.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:23.510+0000 7f4066f4e640 -1 osd.6 80 *** Got signal Terminated *** 2024-09-21T01:10:23.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:23.510+0000 7f4066f4e640 -1 osd.6 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:10:23.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:23.734+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:23.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:23.734+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:23.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:23.734+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:23.956 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:23 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:23.734+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:24.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:23 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:23.797+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:24.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:23 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:23.797+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:24.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:23 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:23.797+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:24.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:23 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:23.797+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:24.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:24 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:24.159+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:24.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:24 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:24.159+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:24.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:24 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:24.159+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:24.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:23.945+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:24.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:23.945+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:24.345 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:23 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:23.945+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:24.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:24 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:24.240+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:24.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:24 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:24.240+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:24.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:24 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:24.240+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:24.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:24.314+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:24.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:24.314+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:24.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:24.314+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:24.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:24.314+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:25.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:24 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:24.760+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:25.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:24 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:24.760+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:25.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:24 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:24.760+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:25.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:24 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:24.760+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:25.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:24.780+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:25.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:24.780+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:25.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:24.780+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:25.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:24 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:24.780+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:25.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:24 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:24.995+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:25.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:24 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:24.995+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:25.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:24 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:24.995+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:25.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:25.191+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:25.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:25.191+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:25.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:25.191+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:25.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:25 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:25.241+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:25.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:25 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:25.241+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:25.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:25 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:25.241+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:25.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:25.286+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:25.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:25.286+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:25.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:25.286+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:25.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:25.286+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:26.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:25 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:25.746+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:26.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:25 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:25.746+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:26.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:25 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:25.746+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:26.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:25 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:25.746+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:26.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:25.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:26.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:25.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:26.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:25.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:26.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:25 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:25.762+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:26.224 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:25.946+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:26.224 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:25.946+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:26.224 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:25 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:25.946+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:26.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:26 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:26.223+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:26.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:26 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:26.223+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:26.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:26 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:26.223+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:26.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:26 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:26.194+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:26.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:26 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:26.194+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:26.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:26 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:26.194+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:26.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:26.314+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:26.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:26.314+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:26.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:26.314+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:26.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:26.314+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:27.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:26 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:26.779+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:27.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:26 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:26.779+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:27.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:26 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:26.779+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:27.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:26 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:26.779+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:27.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:26.792+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:27.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:26.792+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:27.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:26.792+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:27.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:26 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:26.792+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:27.253 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:26 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:26.976+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:27.253 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:26 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:26.976+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:27.253 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:26 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:26.976+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:27.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:27.252+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:27.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:27.252+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:27.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:27.252+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:27.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:27 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:27.243+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:27.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:27 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:27.243+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:27.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:27 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:27.243+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:27.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:27.321+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:27.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:27.321+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:27.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:27.321+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:27.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:27.321+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:28.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:27 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:27.794+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:28.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:27 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:27.794+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:28.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:27 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:27.794+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:28.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:27 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:27.794+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:28.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:27.840+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.814928+0000 front 2024-09-21T01:07:59.814754+0000 (oldest deadline 2024-09-21T01:09:04.415373+0000) 2024-09-21T01:10:28.205 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:27.840+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:04.416055+0000 front 2024-09-21T01:08:04.415898+0000 (oldest deadline 2024-09-21T01:09:37.720845+0000) 2024-09-21T01:10:28.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:27.840+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.723043+0000 front 2024-09-21T01:08:42.723009+0000 (oldest deadline 2024-09-21T01:10:12.427438+0000) 2024-09-21T01:10:28.206 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6[57133]: 2024-09-21T01:10:27.840+0000 7f405f531640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.028775+0000 front 2024-09-21T01:09:14.028906+0000 (oldest deadline 2024-09-21T01:10:16.328875+0000) 2024-09-21T01:10:28.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:27.993+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:28.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:27.993+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:28.345 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:27 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:27.993+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:28.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:28 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:28.212+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:28.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:28 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:28.212+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:28.345 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:28 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:28.212+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:28.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:28.269+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:28.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:28.269+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:28.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:28.269+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:28.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:28 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:28.311+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:28.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:28 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:28.311+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:28.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:28 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:28.311+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:28.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:28 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:28.311+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:29.139 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:28 smithi047 podman[93518]: 2024-09-21 01:10:28.876304376 +0000 UTC m=+5.459069470 container died 0c0e28ba6cb659dd592400b3d4560e7dee8625f111d0c7157e807be730f27bbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T01:10:29.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:28.801+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:29.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:28.801+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:29.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:28.801+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:29.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:28 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:28.801+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:29.245 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:28 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:28.980+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:29.245 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:28 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:28.980+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:29.245 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:28 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:28.980+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:29.458 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:29 smithi047 podman[93518]: 2024-09-21 01:10:29.312430687 +0000 UTC m=+5.895195826 container cleanup 0c0e28ba6cb659dd592400b3d4560e7dee8625f111d0c7157e807be730f27bbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:10:29.458 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:29 smithi047 bash[93518]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6 2024-09-21T01:10:29.458 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:29 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:29.263+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:29.458 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:29 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:29.263+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:29.458 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:29 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:29.263+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:29.459 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:29 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:29.263+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:29.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:29.244+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:29.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:29.244+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:29.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:29.244+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:29.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:29 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:29.253+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:29.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:29 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:29.253+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:29.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:29 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:29.253+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:29.923 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:29 smithi047 podman[93533]: 2024-09-21 01:10:29.497074935 +0000 UTC m=+0.616207847 container remove 0c0e28ba6cb659dd592400b3d4560e7dee8625f111d0c7157e807be730f27bbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:10:30.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:29 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:29.801+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:30.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:29 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:29.801+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:30.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:29 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:29.801+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:30.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:29 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:29.801+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:30.175 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:29 smithi047 podman[93624]: 2024-09-21 01:10:29.922931462 +0000 UTC m=+0.094060680 container create 753c4695da1152300944ba5d2fa1ce09a57ed065d1462aad8bbc6a6c63e3bbc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T01:10:30.175 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:29 smithi047 podman[93624]: 2024-09-21 01:10:29.845334354 +0000 UTC m=+0.016463537 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:10:30.268 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:29.949+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:30.268 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:29.949+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:30.268 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:29 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:29.949+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:30.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:30 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:30.233+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:30.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:30 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:30.233+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:30.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:30 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:30.233+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:30.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:30 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:30.233+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:30.456 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:30 smithi047 podman[93624]: 2024-09-21 01:10:30.175507823 +0000 UTC m=+0.346637007 container init 753c4695da1152300944ba5d2fa1ce09a57ed065d1462aad8bbc6a6c63e3bbc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T01:10:30.456 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:30 smithi047 podman[93624]: 2024-09-21 01:10:30.178942055 +0000 UTC m=+0.350071228 container start 753c4695da1152300944ba5d2fa1ce09a57ed065d1462aad8bbc6a6c63e3bbc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:10:30.456 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:30 smithi047 podman[93624]: 2024-09-21 01:10:30.267233492 +0000 UTC m=+0.438362663 container attach 753c4695da1152300944ba5d2fa1ce09a57ed065d1462aad8bbc6a6c63e3bbc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:10:30.456 INFO:journalctl@ceph.osd.6.smithi047.stdout:Sep 21 01:10:30 smithi047 podman[93624]: 2024-09-21 01:10:30.37055153 +0000 UTC m=+0.541680710 container died 753c4695da1152300944ba5d2fa1ce09a57ed065d1462aad8bbc6a6c63e3bbc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:10:30.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:30.267+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:30.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:30.267+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:30.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:30.267+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:30.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:30 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:30.294+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:30.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:30 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:30.294+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:30.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:30 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:30.294+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:31.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T01:10:31.103 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:10:31.103 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T01:10:31.103 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T01:10:31.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.7 2024-09-21T01:10:31.127 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:30 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:30.783+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:31.127 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:30 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:30.783+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:31.127 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:30 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:30.783+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:31.127 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:30 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:30.783+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:31.300 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:30.919+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:31.300 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:30.919+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:31.300 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:30 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:30.919+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:31.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:31 smithi114 systemd[1]: Stopping Ceph osd.7 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:10:31.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:31.305+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:31.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:31.305+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:31.409 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:31.305+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:31.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:31 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:31.299+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:31.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:31 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:31.299+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:31.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:31 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:31.299+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:31.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:31 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:31.252+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:31.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:31 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:31.252+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:31.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:31 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:31.252+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:31.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:31 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:31.252+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:31.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:31.614+0000 7f4e4dc1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:10:31.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:31.614+0000 7f4e4dc1b640 -1 osd.7 80 *** Got signal Terminated *** 2024-09-21T01:10:31.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:31.614+0000 7f4e4dc1b640 -1 osd.7 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:10:31.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:31.756+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:31.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:31.756+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:31.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:31.756+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:31.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:31 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:31.756+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:32.340 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:31 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:31.907+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:32.340 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:31 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:31.907+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:32.340 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:31 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:31.907+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:32.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:32 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:32.339+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:32.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:32 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:32.339+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:32.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:32 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:32.339+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:32.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:32 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:32.294+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:32.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:32 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:32.294+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:32.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:32 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:32.294+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:32.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:32 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:32.251+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:32.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:32 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:32.251+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:32.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:32 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:32.251+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:32.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:32 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:32.251+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:33.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:32 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:32.804+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:33.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:32 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:32.804+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:33.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:32 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:32.804+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:33.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:32 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:32.804+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:33.319 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:32 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:32.870+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:33.319 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:32 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:32.870+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:33.319 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:32 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:32.870+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:33.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:33 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:33.318+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:33.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:33 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:33.318+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:33.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:33 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:33.318+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:33.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:33.248+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:33.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:33.248+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:33.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:33.248+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:33.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:33 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:33.227+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:33.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:33 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:33.227+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:33.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:33 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:33.227+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:33.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:33 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:33.227+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:34.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:33 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:33.842+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:34.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:33 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:33.842+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:34.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:33 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:33.842+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:34.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:33.757+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:34.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:33.757+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:34.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:33.757+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:34.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:33 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:33.757+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:34.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:34 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:34.325+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:34.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:34 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:34.325+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:34.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:34 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:34.325+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:34.607 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:34 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:34.242+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:34.607 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:34 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:34.242+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:34.607 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:34 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:34.242+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:34.607 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:34 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:34.242+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:34.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:34.275+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:34.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:34.275+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:34.660 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:34.275+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:35.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:34.739+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:35.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:34.739+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:35.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:34.739+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:35.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:34 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:34.739+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:35.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:34 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:34.876+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:35.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:34 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:34.876+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:35.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:34 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:34.876+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:35.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:35 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:35.248+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:35.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:35 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:35.248+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:35.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:35 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:35.248+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:35.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:35 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:35.284+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:35.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:35 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:35.284+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:35.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:35 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:35.284+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:35.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:35 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:35.284+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:35.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:35 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:35.350+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:35.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:35 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:35.350+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:35.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:35 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:35.350+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:36.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:35 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:35.709+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:36.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:35 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:35.709+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:36.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:35 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:35.709+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:36.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:35 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:35.709+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:36.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:35 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:35.870+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:36.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:35 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:35.870+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:36.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:35 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:35.871+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:36.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:36.231+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.628249+0000 front 2024-09-21T01:08:09.628219+0000 (oldest deadline 2024-09-21T01:09:40.432363+0000) 2024-09-21T01:10:36.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:36.231+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.933234+0000 front 2024-09-21T01:08:40.933181+0000 (oldest deadline 2024-09-21T01:10:10.736375+0000) 2024-09-21T01:10:36.659 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7[51189]: 2024-09-21T01:10:36.231+0000 7f4e4a206640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:10.737038+0000 front 2024-09-21T01:09:10.736961+0000 (oldest deadline 2024-09-21T01:10:15.937271+0000) 2024-09-21T01:10:36.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:36 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:36.317+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:36.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:36 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:36.317+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:36.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:36 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:36.317+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:36.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:36 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:36.317+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:36.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:36.389+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:36.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:36.389+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:36.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:36.389+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:37.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:36.678+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:37.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:36.678+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:37.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:36.678+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:37.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:36.678+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:37.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:36.876+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:37.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:36.876+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:37.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:36 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:36.876+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:37.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:37.336+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:37.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:37.336+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:37.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:37.336+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:37.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:37 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:37.336+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:37.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:37.383+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:37.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:37.383+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:37.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:37.383+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:38.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:37 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:37.725+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:38.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:37 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:37.725+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:38.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:37 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:37.725+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:38.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:37 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:37.725+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:38.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:37.914+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:38.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:37.914+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:38.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:37 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:37.914+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:38.616 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:38.367+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:38.616 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:38.367+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:38.616 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:38.367+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:38.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:38 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:38.372+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:38.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:38 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:38.372+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:38.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:38 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:38.372+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:38.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:38 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:38.372+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:39.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:38 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:38.771+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:39.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:38 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:38.771+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:39.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:38 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:38.771+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:39.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:38 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:38.771+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:39.321 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:38.910+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:39.321 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:38.910+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:39.322 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:38 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:38.910+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:39.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:39.320+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:39.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:39.320+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:39.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:39.320+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:39.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:39.331+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:39.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:39.331+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:39.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:39.331+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:39.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:39 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:39.331+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:40.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:39 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:39.727+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:40.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:39 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:39.728+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:40.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:39 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:39.728+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:40.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:39 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:39.728+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:40.339 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:39.885+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:40.339 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:39.885+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:40.339 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:39 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:39.885+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:40.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:40.337+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:40.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:40.337+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:40.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:40.337+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:40.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:40.300+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:40.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:40.300+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:40.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:40.300+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:40.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:40 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:40.300+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:41.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:40.701+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:41.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:40.701+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:41.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:40.701+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:41.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:40 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:40.701+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:41.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:40.922+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:41.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:40.922+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:41.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:40 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:40.922+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:41.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:41 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:41.323+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:41.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:41 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:41.323+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:41.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:41 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:41.323+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:41.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:41 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:41.323+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:41.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:41.383+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:41.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:41.383+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:41.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:41.383+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:42.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:41.751+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:42.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:41.751+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:42.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:41.751+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:42.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:41.751+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:42.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:41.885+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:42.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:41.885+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:42.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:41 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:41.885+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:42.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:42 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:42.303+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:42.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:42 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:42.303+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:42.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:42 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:42.303+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:42.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:42 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:42.303+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:42.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:42.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:42.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:42.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:42.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:42.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:43.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:42 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:42.755+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:43.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:42 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:42.755+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:43.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:42 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:42.755+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:43.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:42 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:42.755+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:43.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:42.895+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:43.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:42.895+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:43.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:42 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:42.895+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:43.597 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:43 smithi114 podman[65858]: 2024-09-21 01:10:43.333145227 +0000 UTC m=+12.043044844 container died 5acf10fa10829d56ee1c779684398044059cb2458bedc390e7c307a70186c12e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:10:43.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:43 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:43.264+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:43.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:43 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:43.264+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:43.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:43 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:43.264+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:43.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:43 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:43.264+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:43.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:43.386+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:43.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:43.386+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:43.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:43.386+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:43.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:43 smithi114 podman[65858]: 2024-09-21 01:10:43.697089017 +0000 UTC m=+12.406988631 container cleanup 5acf10fa10829d56ee1c779684398044059cb2458bedc390e7c307a70186c12e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:10:43.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:43 smithi114 bash[65858]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7 2024-09-21T01:10:43.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:43 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:43.779+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:43.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:43 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:43.779+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:43.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:43 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:43.779+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:43.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:43 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:43.779+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:44.303 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:43 smithi114 podman[65873]: 2024-09-21 01:10:43.96510542 +0000 UTC m=+0.633185378 container remove 5acf10fa10829d56ee1c779684398044059cb2458bedc390e7c307a70186c12e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-21T01:10:44.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:43.892+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:44.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:43.892+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:44.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:43 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:43.892+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:44.576 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:44 smithi114 podman[65965]: 2024-09-21 01:10:44.205581311 +0000 UTC m=+0.015873003 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:10:44.576 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:44 smithi114 podman[65965]: 2024-09-21 01:10:44.307414268 +0000 UTC m=+0.117705963 container create 021760d4fb303f3277ece485d75b4b78a38dc3f6a6b6106742d45590f351d81d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T01:10:44.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:44 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:44.220+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:44.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:44 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:44.220+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:44.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:44 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:44.220+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:44.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:44 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:44.220+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:44.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:44.420+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:44.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:44.420+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:44.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:44.420+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:44.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:44 smithi114 podman[65965]: 2024-09-21 01:10:44.57642964 +0000 UTC m=+0.386721336 container init 021760d4fb303f3277ece485d75b4b78a38dc3f6a6b6106742d45590f351d81d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:10:44.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:44 smithi114 podman[65965]: 2024-09-21 01:10:44.579941065 +0000 UTC m=+0.390232768 container start 021760d4fb303f3277ece485d75b4b78a38dc3f6a6b6106742d45590f351d81d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T01:10:44.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:44 smithi114 podman[65965]: 2024-09-21 01:10:44.651554945 +0000 UTC m=+0.461846651 container attach 021760d4fb303f3277ece485d75b4b78a38dc3f6a6b6106742d45590f351d81d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T01:10:44.909 INFO:journalctl@ceph.osd.7.smithi114.stdout:Sep 21 01:10:44 smithi114 podman[65965]: 2024-09-21 01:10:44.772993854 +0000 UTC m=+0.583285549 container died 021760d4fb303f3277ece485d75b4b78a38dc3f6a6b6106742d45590f351d81d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T01:10:44.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:44 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:44.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:44.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:44 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:44.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:44.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:44 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:44.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:44.910 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:44 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:44.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:45.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:44.917+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:45.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:44.917+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:45.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:44 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:44.917+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:45.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T01:10:45.429 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:10:45.429 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T01:10:45.429 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T01:10:45.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.8 2024-09-21T01:10:45.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:45 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:45.263+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:45.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:45 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:45.263+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:45.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:45 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:45.263+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:45.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:45 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:45.263+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:45.745 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:45 smithi134 systemd[1]: Stopping Ceph osd.8 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:10:45.745 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:45.460+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:45.745 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:45.460+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:45.745 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:45.460+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:46.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:45.743+0000 7f772e998640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:10:46.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:45.744+0000 7f772e998640 -1 osd.8 80 *** Got signal Terminated *** 2024-09-21T01:10:46.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:45.744+0000 7f772e998640 -1 osd.8 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:10:46.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:45.935+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:46.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:45.935+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:46.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:45 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:45.935+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:46.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:45.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:46.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:45.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:46.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:45.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:46.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:45.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:46.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:46 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:46.234+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:46.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:46 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:46.234+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:46.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:46 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:46.234+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:46.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:46 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:46.234+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:46.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:46.441+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:46.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:46.441+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:46.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:46.441+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:47.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:46 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:46.749+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:47.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:46 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:46.749+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:47.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:46 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:46.749+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:47.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:46 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:46.749+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:47.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:46.935+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:47.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:46.935+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:47.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:46 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:46.935+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:47.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:47.236+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:47.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:47.236+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:47.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:47.236+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:47.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:47 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:47.236+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:47.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:47.393+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:47.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:47.393+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:47.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:47.393+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:48.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:47.742+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:48.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:47.742+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:48.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:47.742+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:48.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:47 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:47.742+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:48.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:47.901+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:48.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:47.901+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:48.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:47 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:47.901+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:48.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:48 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:48.213+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:48.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:48 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:48.213+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:48.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:48 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:48.213+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:48.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:48 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:48.213+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:48.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:48.422+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:48.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:48.422+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:48.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:48.422+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:49.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:48 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:48.758+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:49.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:48 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:48.758+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:49.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:48 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:48.758+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:49.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:48 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:48.758+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:49.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:48.934+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:49.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:48.934+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:49.344 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:48 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:48.934+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:49.699 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:49.431+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:49.699 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:49.431+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:49.699 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:49.431+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:49.705 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:49 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:49.237+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:49.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:49 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:49.237+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:49.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:49 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:49.237+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:49.706 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:49 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:49.237+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:50.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:49.929+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:06.787732+0000 front 2024-09-21T01:08:06.787792+0000 (oldest deadline 2024-09-21T01:09:36.591446+0000) 2024-09-21T01:10:50.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:49.929+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:37.692203+0000 front 2024-09-21T01:08:37.692125+0000 (oldest deadline 2024-09-21T01:10:09.596736+0000) 2024-09-21T01:10:50.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:49.929+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:14.798391+0000 front 2024-09-21T01:09:14.798285+0000 (oldest deadline 2024-09-21T01:10:17.698100+0000) 2024-09-21T01:10:50.094 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:49 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8[51618]: 2024-09-21T01:10:49.929+0000 7f7726f7b640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:21.699291+0000 front 2024-09-21T01:09:21.699352+0000 (oldest deadline 2024-09-21T01:10:49.702228+0000) 2024-09-21T01:10:50.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:49.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:50.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:49.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:50.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:49.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:50.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:49.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:50.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:49.770+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:50.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:50.194+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:50.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:50.194+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:50.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:50.194+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:50.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:50.194+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:50.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:50 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:50.194+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:50.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:50.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:50.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:50.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:50.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:50.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:50.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:50 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:50.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:51.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:50 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:50.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:51.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:50 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:50.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:51.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:50 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:50.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:51.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:50 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:50.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:51.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:50 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:50.805+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:51.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:51.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:51.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:51.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:51.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:51.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:51.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:51.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:51.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:51 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:51.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:51.504 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:51 smithi134 podman[66342]: 2024-09-21 01:10:51.23415553 +0000 UTC m=+5.616778096 container died bbe6e7a9393ab6883342eb6a1324b490b3c726749157b6c5aee60c3c3da39c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:10:51.504 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:51.443+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:51.504 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:51.443+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:51.504 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:51.443+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:51.504 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:51 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:51.443+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:51.844 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:51 smithi134 podman[66342]: 2024-09-21 01:10:51.594747569 +0000 UTC m=+5.977370172 container cleanup bbe6e7a9393ab6883342eb6a1324b490b3c726749157b6c5aee60c3c3da39c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T01:10:51.844 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:51 smithi134 bash[66342]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8 2024-09-21T01:10:52.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:51 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:51.822+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:52.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:51 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:51.822+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:52.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:51 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:51.822+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:52.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:51 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:51.822+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:52.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:51 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:51.822+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:52.197 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:51 smithi134 podman[66358]: 2024-09-21 01:10:51.870808458 +0000 UTC m=+0.633942771 container remove bbe6e7a9393ab6883342eb6a1324b490b3c726749157b6c5aee60c3c3da39c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:10:52.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:52.150+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:52.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:52.150+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:52.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:52.150+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:52.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:52.150+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:52.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:52 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:52.150+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:52.464 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:52 smithi134 podman[66445]: 2024-09-21 01:10:52.099578239 +0000 UTC m=+0.015620578 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:10:52.464 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:52 smithi134 podman[66445]: 2024-09-21 01:10:52.238520854 +0000 UTC m=+0.154563186 container create 8ed5da526ff20bd9b0b94ca3f4e685b41351f2df5f91a1fac27eac979bf5f37f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T01:10:52.845 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:52 smithi134 podman[66445]: 2024-09-21 01:10:52.465960611 +0000 UTC m=+0.382002954 container init 8ed5da526ff20bd9b0b94ca3f4e685b41351f2df5f91a1fac27eac979bf5f37f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T01:10:52.845 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:52 smithi134 podman[66445]: 2024-09-21 01:10:52.469249364 +0000 UTC m=+0.385291697 container start 8ed5da526ff20bd9b0b94ca3f4e685b41351f2df5f91a1fac27eac979bf5f37f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T01:10:52.845 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:52 smithi134 podman[66445]: 2024-09-21 01:10:52.599436812 +0000 UTC m=+0.515479145 container attach 8ed5da526ff20bd9b0b94ca3f4e685b41351f2df5f91a1fac27eac979bf5f37f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T01:10:52.845 INFO:journalctl@ceph.osd.8.smithi134.stdout:Sep 21 01:10:52 smithi134 podman[66445]: 2024-09-21 01:10:52.660598797 +0000 UTC m=+0.576641134 container died 8ed5da526ff20bd9b0b94ca3f4e685b41351f2df5f91a1fac27eac979bf5f37f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T01:10:52.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:52.462+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:52.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:52.462+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:52.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:52.462+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:52.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:52.462+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:53.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:52 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:52.800+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:53.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:52 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:52.800+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:53.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:52 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:52.800+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:53.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:52 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:52.800+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:53.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:52 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:52.800+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:53.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T01:10:53.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:10:53.301 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T01:10:53.301 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T01:10:53.301 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.9 2024-09-21T01:10:53.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:53.129+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:53.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:53.129+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:53.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:53.129+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:53.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:53.129+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:53.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:53.129+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:53.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 systemd[1]: Stopping Ceph osd.9 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:10:53.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:53.458+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:53.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:53.458+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:53.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:53.458+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:53.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:53 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:53.458+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:53.955 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:53.614+0000 7f987ca91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:10:53.955 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:53.614+0000 7f987ca91640 -1 osd.9 80 *** Got signal Terminated *** 2024-09-21T01:10:53.956 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:53 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:53.614+0000 7f987ca91640 -1 osd.9 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:10:54.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:53 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:53.843+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:54.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:53 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:53.843+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:54.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:53 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:53.843+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:54.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:53 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:53.843+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:54.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:53 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:53.843+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:54.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:54.101+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:54.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:54.101+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:54.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:54.101+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:54.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:54.101+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:54.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:54 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:54.101+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:54.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:54.459+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:54.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:54.459+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:54.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:54.459+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:54.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:54 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:54.459+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:55.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:54.871+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:55.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:54.871+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:55.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:54.871+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:55.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:54.871+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:55.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:54 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:54.871+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:55.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:55.135+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:55.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:55.135+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:55.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:55.135+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:55.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:55.135+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:55.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:55 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:55.135+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:55.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:55.444+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:55.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:55.444+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:55.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:55.444+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:55.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:55 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:55.444+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:56.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:55 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:55.875+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:56.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:55 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:55.875+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:56.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:55 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:55.875+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:56.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:55 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:55.875+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:56.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:55 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:55.875+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:56.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:56.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:56.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:56.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:56.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:56.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:56.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:56.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:56.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:56 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:56.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:56.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:56.428+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:56.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:56.428+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:56.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:56.428+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:56.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:56 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:56.428+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:57.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:56 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:56.903+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:57.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:56 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:56.903+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:57.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:56 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:56.903+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:57.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:56 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:56.903+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:57.160 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:56 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:56.903+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:57.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:57.104+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:57.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:57.104+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:57.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:57.104+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:57.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:57.104+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:57.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:57 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:57.104+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:57.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:57 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:57.393+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:57.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:57 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:57.393+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:57.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:57 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:57.393+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:57.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:57 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:57.393+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:58.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:57 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:57.901+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:58.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:57 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:57.901+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:58.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:57 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:57.901+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:58.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:57 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:57.901+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:58.159 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:57 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:57.901+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:58.455 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:58.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:59.633374+0000 front 2024-09-21T01:07:59.633481+0000 (oldest deadline 2024-09-21T01:09:03.733504+0000) 2024-09-21T01:10:58.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:58.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:09.034294+0000 front 2024-09-21T01:08:09.034240+0000 (oldest deadline 2024-09-21T01:09:36.938956+0000) 2024-09-21T01:10:58.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:58.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:42.839732+0000 front 2024-09-21T01:08:42.839762+0000 (oldest deadline 2024-09-21T01:10:12.445057+0000) 2024-09-21T01:10:58.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:58.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:12.445774+0000 front 2024-09-21T01:09:12.445636+0000 (oldest deadline 2024-09-21T01:10:15.945725+0000) 2024-09-21T01:10:58.456 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:58 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9[63448]: 2024-09-21T01:10:58.151+0000 7f9875074640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:23.447730+0000 front 2024-09-21T01:09:23.447699+0000 (oldest deadline 2024-09-21T01:10:49.551915+0000) 2024-09-21T01:10:58.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:58.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:58.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:58.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:58.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:58.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:58.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:58.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:59.275 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:58 smithi047 podman[93738]: 2024-09-21 01:10:58.991163961 +0000 UTC m=+5.476277234 container died bc50b9e463105e0e8aecb156b1b670ff47dbdc9b4d9089717ba143ae6a68c343 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:10:59.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:58 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:58.932+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:10:59.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:58 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:58.932+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:10:59.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:58 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:58.932+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:10:59.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:58 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:58.932+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:10:59.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:58 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:58.932+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:10:59.624 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:59 smithi047 podman[93738]: 2024-09-21 01:10:59.373188128 +0000 UTC m=+5.858301361 container cleanup bc50b9e463105e0e8aecb156b1b670ff47dbdc9b4d9089717ba143ae6a68c343 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T01:10:59.624 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:59 smithi047 bash[93738]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9 2024-09-21T01:10:59.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:59 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:59.403+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:10:59.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:59 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:59.403+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:10:59.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:59 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:59.403+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:10:59.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:10:59 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:10:59.403+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:10:59.950 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:59 smithi047 podman[93753]: 2024-09-21 01:10:59.624326585 +0000 UTC m=+0.631461084 container remove bc50b9e463105e0e8aecb156b1b670ff47dbdc9b4d9089717ba143ae6a68c343 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:11:00.206 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:59 smithi047 podman[93846]: 2024-09-21 01:10:59.852675914 +0000 UTC m=+0.016292390 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:00.206 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:10:59 smithi047 podman[93846]: 2024-09-21 01:10:59.966905866 +0000 UTC m=+0.130522311 container create 41f8c81ecf756867a5118ef87e8e76e8fc3377533e7b1e2e0a2cc97b400a807f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:11:00.206 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:11:00 smithi047 podman[93846]: 2024-09-21 01:11:00.177720687 +0000 UTC m=+0.341337133 container init 41f8c81ecf756867a5118ef87e8e76e8fc3377533e7b1e2e0a2cc97b400a807f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T01:11:00.206 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:11:00 smithi047 podman[93846]: 2024-09-21 01:11:00.18103603 +0000 UTC m=+0.344652475 container start 41f8c81ecf756867a5118ef87e8e76e8fc3377533e7b1e2e0a2cc97b400a807f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:11:00.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:59 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:59.939+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:11:00.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:59 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:59.939+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:11:00.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:59 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:59.939+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:11:00.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:59 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:59.939+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:11:00.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:10:59 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:10:59.939+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:11:00.665 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:11:00 smithi047 podman[93846]: 2024-09-21 01:11:00.261058637 +0000 UTC m=+0.424675093 container attach 41f8c81ecf756867a5118ef87e8e76e8fc3377533e7b1e2e0a2cc97b400a807f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T01:11:00.665 INFO:journalctl@ceph.osd.9.smithi047.stdout:Sep 21 01:11:00 smithi047 podman[93846]: 2024-09-21 01:11:00.370248955 +0000 UTC m=+0.533865412 container died 41f8c81ecf756867a5118ef87e8e76e8fc3377533e7b1e2e0a2cc97b400a807f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T01:11:00.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:00.413+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:00.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:00.413+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:00.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:00.413+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:00.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:00.413+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:01.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T01:11:01.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:01.137 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T01:11:01.137 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T01:11:01.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.10 2024-09-21T01:11:01.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:00 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:00.988+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:11:01.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:00 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:00.988+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:11:01.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:00 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:00.988+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:11:01.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:00 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:00.988+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:11:01.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:00 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:00.988+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:11:01.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 systemd[1]: Stopping Ceph osd.10 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:01.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:01 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:01.404+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:01.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:01 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:01.404+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:01.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:01 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:01.404+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:01.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:01 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:01.404+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:01.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:01.432+0000 7fa75b0a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:01.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:01.432+0000 7fa75b0a9640 -1 osd.10 80 *** Got signal Terminated *** 2024-09-21T01:11:01.909 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:01.432+0000 7fa75b0a9640 -1 osd.10 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:11:02.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:01.986+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:11:02.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:01.986+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:11:02.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:01.986+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:11:02.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:01.986+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:11:02.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:01 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:01.986+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:11:02.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:02 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:02.358+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:02.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:02 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:02.358+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:02.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:02 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:02.358+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:02.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:02 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:02.358+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:03.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:03.032+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:11:03.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:03.032+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:11:03.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:03.032+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:11:03.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:03.032+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:11:03.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:03 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:03.032+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:11:03.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:03 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:03.388+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:03.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:03 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:03.388+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:03.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:03 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:03.388+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:03.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:03 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:03.388+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:04.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:04.027+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:11:04.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:04.027+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:11:04.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:04.027+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:11:04.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:04.027+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:11:04.410 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:04 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:04.027+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:11:04.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:04 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:04.418+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:04.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:04 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:04.418+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:04.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:04 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:04.418+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:04.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:04 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:04.418+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:05.311 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:05.012+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:11:05.311 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:05.012+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:11:05.311 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:05.012+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:11:05.311 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:05.012+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:11:05.311 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:05 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:05.012+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:11:05.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:05.441+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:05.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:05.441+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:05.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:05.441+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:05.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:05.441+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:06.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:06.053+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:57.854192+0000 front 2024-09-21T01:07:57.854176+0000 (oldest deadline 2024-09-21T01:09:02.554302+0000) 2024-09-21T01:11:06.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:06.053+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.156063+0000 front 2024-09-21T01:08:08.156041+0000 (oldest deadline 2024-09-21T01:09:40.359181+0000) 2024-09-21T01:11:06.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:06.053+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:40.359808+0000 front 2024-09-21T01:08:40.359918+0000 (oldest deadline 2024-09-21T01:10:11.862920+0000) 2024-09-21T01:11:06.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:06.053+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.47:6814 osd.3 since back 2024-09-21T01:09:15.264310+0000 front 2024-09-21T01:09:15.264203+0000 (oldest deadline 2024-09-21T01:10:21.164152+0000) 2024-09-21T01:11:06.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:06 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10[57556]: 2024-09-21T01:11:06.053+0000 7fa757694640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:22.865043+0000 front 2024-09-21T01:09:22.865018+0000 (oldest deadline 2024-09-21T01:10:48.869104+0000) 2024-09-21T01:11:06.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:06.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:06.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:06.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:06.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:06.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:06.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:06 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:06.411+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:07.108 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:06 smithi114 podman[66067]: 2024-09-21 01:11:06.850377062 +0000 UTC m=+5.523705605 container died 795f56cf12104a385fffe618f91bc4058d4aa2bd97006d4be70aacb082409839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T01:11:07.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:07 smithi114 podman[66067]: 2024-09-21 01:11:07.224037273 +0000 UTC m=+5.897365803 container cleanup 795f56cf12104a385fffe618f91bc4058d4aa2bd97006d4be70aacb082409839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T01:11:07.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:07 smithi114 bash[66067]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10 2024-09-21T01:11:07.745 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:07.398+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:07.745 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:07.398+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:07.746 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:07.398+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:07.746 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:07 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:07.398+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:07.829 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:07 smithi114 podman[66094]: 2024-09-21 01:11:07.492002175 +0000 UTC m=+0.637363698 container remove 795f56cf12104a385fffe618f91bc4058d4aa2bd97006d4be70aacb082409839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T01:11:08.128 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:07 smithi114 podman[66186]: 2024-09-21 01:11:07.732539744 +0000 UTC m=+0.015641335 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:08.129 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:07 smithi114 podman[66186]: 2024-09-21 01:11:07.834412356 +0000 UTC m=+0.117513986 container create ccbdf254eef7fca0ebe6ab380a3c257dc11c7653203c9a0030af3912d3c9d22c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:11:08.129 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:08 smithi114 podman[66186]: 2024-09-21 01:11:08.045392529 +0000 UTC m=+0.328494122 container init ccbdf254eef7fca0ebe6ab380a3c257dc11c7653203c9a0030af3912d3c9d22c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T01:11:08.129 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:08 smithi114 podman[66186]: 2024-09-21 01:11:08.049147035 +0000 UTC m=+0.332248622 container start ccbdf254eef7fca0ebe6ab380a3c257dc11c7653203c9a0030af3912d3c9d22c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T01:11:08.129 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:08 smithi114 podman[66186]: 2024-09-21 01:11:08.128252941 +0000 UTC m=+0.411354549 container attach ccbdf254eef7fca0ebe6ab380a3c257dc11c7653203c9a0030af3912d3c9d22c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:11:08.409 INFO:journalctl@ceph.osd.10.smithi114.stdout:Sep 21 01:11:08 smithi114 podman[66186]: 2024-09-21 01:11:08.240911335 +0000 UTC m=+0.524012920 container died ccbdf254eef7fca0ebe6ab380a3c257dc11c7653203c9a0030af3912d3c9d22c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T01:11:08.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T01:11:08.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:08 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:08.372+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:08.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:08 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:08.372+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:08.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:08 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:08.372+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:08.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:08 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:08.372+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:08.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:08.871 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T01:11:08.872 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T01:11:08.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.11 2024-09-21T01:11:09.189 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:08 smithi134 systemd[1]: Stopping Ceph osd.11 for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:09.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:09.188+0000 7f47ea386640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:09.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:09.188+0000 7f47ea386640 -1 osd.11 80 *** Got signal Terminated *** 2024-09-21T01:11:09.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:09.188+0000 7f47ea386640 -1 osd.11 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:11:09.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:09.404+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:09.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:09.404+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:09.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:09.404+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:09.595 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:09 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:09.404+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:10.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:10.449+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:10.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:10.449+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:10.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:10.449+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:10.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:10 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:10.449+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:11.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:11.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:11.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:11.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:11.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:11.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:11.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:11 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:11.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:12.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:12.424+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:12.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:12.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:12.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:12.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:12.845 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:12 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:12.425+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:13.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:13.433+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.47:6806 osd.0 since back 2024-09-21T01:07:56.357265+0000 front 2024-09-21T01:07:56.357291+0000 (oldest deadline 2024-09-21T01:09:04.458089+0000) 2024-09-21T01:11:13.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:13.433+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6804 osd.1 since back 2024-09-21T01:08:08.459422+0000 front 2024-09-21T01:08:08.459490+0000 (oldest deadline 2024-09-21T01:09:38.361826+0000) 2024-09-21T01:11:13.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:13.433+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.134:6804 osd.2 since back 2024-09-21T01:08:41.862613+0000 front 2024-09-21T01:08:41.862782+0000 (oldest deadline 2024-09-21T01:10:10.266211+0000) 2024-09-21T01:11:13.844 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:13 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11[57858]: 2024-09-21T01:11:13.433+0000 7f47e6971640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.114:6812 osd.4 since back 2024-09-21T01:09:20.867465+0000 front 2024-09-21T01:09:20.867481+0000 (oldest deadline 2024-09-21T01:10:49.569750+0000) 2024-09-21T01:11:14.955 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:14 smithi134 podman[66547]: 2024-09-21 01:11:14.703635669 +0000 UTC m=+5.635867401 container died 1e6011c03211bf16c6d468b754e09ecec5f2ae3d7a48ae0283cdbf242ad24271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T01:11:15.231 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:15 smithi134 podman[66547]: 2024-09-21 01:11:15.03769163 +0000 UTC m=+5.969923361 container cleanup 1e6011c03211bf16c6d468b754e09ecec5f2ae3d7a48ae0283cdbf242ad24271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T01:11:15.231 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:15 smithi134 bash[66547]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11 2024-09-21T01:11:15.594 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:15 smithi134 podman[66562]: 2024-09-21 01:11:15.230570987 +0000 UTC m=+0.519772821 container remove 1e6011c03211bf16c6d468b754e09ecec5f2ae3d7a48ae0283cdbf242ad24271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T01:11:15.942 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:15 smithi134 podman[66650]: 2024-09-21 01:11:15.548657141 +0000 UTC m=+0.015503797 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:11:15.942 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:15 smithi134 podman[66650]: 2024-09-21 01:11:15.679081552 +0000 UTC m=+0.145928215 container create d6a42b0f44ffd8b84ec465cc07bebf94405e2924897253173fdc2c15ff707cc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T01:11:15.943 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:15 smithi134 podman[66650]: 2024-09-21 01:11:15.868203597 +0000 UTC m=+0.335050257 container init d6a42b0f44ffd8b84ec465cc07bebf94405e2924897253173fdc2c15ff707cc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T01:11:15.943 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:15 smithi134 podman[66650]: 2024-09-21 01:11:15.871501347 +0000 UTC m=+0.338348006 container start d6a42b0f44ffd8b84ec465cc07bebf94405e2924897253173fdc2c15ff707cc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:11:15.943 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:15 smithi134 podman[66650]: 2024-09-21 01:11:15.942228491 +0000 UTC m=+0.409075171 container attach d6a42b0f44ffd8b84ec465cc07bebf94405e2924897253173fdc2c15ff707cc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:11:16.344 INFO:journalctl@ceph.osd.11.smithi134.stdout:Sep 21 01:11:16 smithi134 podman[66650]: 2024-09-21 01:11:16.057322159 +0000 UTC m=+0.524168822 container died d6a42b0f44ffd8b84ec465cc07bebf94405e2924897253173fdc2c15ff707cc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T01:11:16.652 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T01:11:16.690 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:16.690 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T01:11:16.691 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T01:11:16.691 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.a 2024-09-21T01:11:17.002 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 01:11:16 smithi047 systemd[1]: Stopping Ceph mds.a for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:17.455 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 01:11:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a[70210]: 2024-09-21T01:11:17.000+0000 7fcaa9f0c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:17.456 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 01:11:17 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a[70210]: 2024-09-21T01:11:17.000+0000 7fcaa9f0c640 -1 mds.a *** got signal Terminated *** 2024-09-21T01:11:21.109 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 01:11:20 smithi047 podman[93960]: 2024-09-21 01:11:20.830535147 +0000 UTC m=+3.932706273 container died 2ed37a86bd1b08f8e4e4d6260a6dacab7ac6a315d670c2203ce0c01219738361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T01:11:21.451 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 01:11:21 smithi047 podman[93960]: 2024-09-21 01:11:21.183538971 +0000 UTC m=+4.285710098 container cleanup 2ed37a86bd1b08f8e4e4d6260a6dacab7ac6a315d670c2203ce0c01219738361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T01:11:21.451 INFO:journalctl@ceph.mds.a.smithi047.stdout:Sep 21 01:11:21 smithi047 bash[93960]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-a 2024-09-21T01:11:21.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T01:11:21.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:21.658 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T01:11:21.658 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T01:11:21.658 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.d 2024-09-21T01:11:21.971 INFO:journalctl@ceph.mds.d.smithi047.stdout:Sep 21 01:11:21 smithi047 systemd[1]: Stopping Ceph mds.d for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:22.456 INFO:journalctl@ceph.mds.d.smithi047.stdout:Sep 21 01:11:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-d[69172]: 2024-09-21T01:11:21.970+0000 7efe91e4b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:22.456 INFO:journalctl@ceph.mds.d.smithi047.stdout:Sep 21 01:11:21 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-d[69172]: 2024-09-21T01:11:21.970+0000 7efe91e4b640 -1 mds.d *** got signal Terminated *** 2024-09-21T01:11:26.255 INFO:journalctl@ceph.mds.d.smithi047.stdout:Sep 21 01:11:25 smithi047 podman[94084]: 2024-09-21 01:11:25.981765946 +0000 UTC m=+4.101024412 container died c48ba9d4ee182d28d661037e6af6182d380b85d3b924e833bea151cbf2fc05f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:11:26.510 INFO:journalctl@ceph.mds.d.smithi047.stdout:Sep 21 01:11:26 smithi047 podman[94084]: 2024-09-21 01:11:26.49566207 +0000 UTC m=+4.614920536 container cleanup c48ba9d4ee182d28d661037e6af6182d380b85d3b924e833bea151cbf2fc05f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:11:26.510 INFO:journalctl@ceph.mds.d.smithi047.stdout:Sep 21 01:11:26 smithi047 bash[94084]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-d 2024-09-21T01:11:26.859 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T01:11:26.892 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:26.893 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T01:11:26.893 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T01:11:26.893 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.g 2024-09-21T01:11:27.455 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 01:11:26 smithi047 systemd[1]: Stopping Ceph mds.g for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:27.456 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 01:11:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g[69909]: 2024-09-21T01:11:27.224+0000 7f2291759640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:27.456 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 01:11:27 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g[69909]: 2024-09-21T01:11:27.224+0000 7f2291759640 -1 mds.g *** got signal Terminated *** 2024-09-21T01:11:30.455 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 01:11:30 smithi047 podman[94202]: 2024-09-21 01:11:30.171205917 +0000 UTC m=+3.050656895 container died bba7e9b5d4a529d90ede39f27ff991bcfda6a8b7774dca3a0275a6c26da9e968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:11:30.919 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 01:11:30 smithi047 podman[94202]: 2024-09-21 01:11:30.499356517 +0000 UTC m=+3.378807493 container cleanup bba7e9b5d4a529d90ede39f27ff991bcfda6a8b7774dca3a0275a6c26da9e968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T01:11:30.919 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 01:11:30 smithi047 bash[94202]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g 2024-09-21T01:11:30.920 INFO:journalctl@ceph.mds.g.smithi047.stdout:Sep 21 01:11:30 smithi047 podman[94213]: 2024-09-21 01:11:30.700603306 +0000 UTC m=+0.522470380 container remove bba7e9b5d4a529d90ede39f27ff991bcfda6a8b7774dca3a0275a6c26da9e968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:11:30.934 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T01:11:30.967 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:30.967 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T01:11:30.968 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T01:11:30.968 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.j 2024-09-21T01:11:31.205 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 01:11:31 smithi047 systemd[1]: Stopping Ceph mds.j for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:31.705 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 01:11:31 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j[68794]: 2024-09-21T01:11:31.294+0000 7fd076543640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:31.705 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 01:11:31 smithi047 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j[68794]: 2024-09-21T01:11:31.294+0000 7fd076543640 -1 mds.j *** got signal Terminated *** 2024-09-21T01:11:35.120 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 01:11:34 smithi047 podman[94320]: 2024-09-21 01:11:34.858561564 +0000 UTC m=+3.666037622 container died 89d58e110204a2b6b7145d7279efafa72c2b3dee725f7b6a2e238b0a20803980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:11:35.420 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 01:11:35 smithi047 podman[94320]: 2024-09-21 01:11:35.42014749 +0000 UTC m=+4.227623548 container cleanup 89d58e110204a2b6b7145d7279efafa72c2b3dee725f7b6a2e238b0a20803980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:11:35.687 INFO:journalctl@ceph.mds.j.smithi047.stdout:Sep 21 01:11:35 smithi047 bash[94320]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-j 2024-09-21T01:11:35.842 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T01:11:35.875 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:35.875 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T01:11:35.875 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T01:11:35.875 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.b 2024-09-21T01:11:36.159 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:11:35 smithi114 systemd[1]: Stopping Ceph mds.b for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:36.421 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:11:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b[62424]: 2024-09-21T01:11:36.299+0000 7f8b5a350640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:36.421 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:11:36 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b[62424]: 2024-09-21T01:11:36.299+0000 7f8b5a350640 -1 mds.b *** got signal Terminated *** 2024-09-21T01:11:40.591 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:11:40 smithi114 podman[66291]: 2024-09-21 01:11:40.31791247 +0000 UTC m=+4.243416939 container died 51291ae2298c4491d6b23019c4882c93e4140336244a495a6ffe4a35efb9b231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T01:11:40.909 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:11:40 smithi114 podman[66291]: 2024-09-21 01:11:40.674189687 +0000 UTC m=+4.599694153 container cleanup 51291ae2298c4491d6b23019c4882c93e4140336244a495a6ffe4a35efb9b231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:11:40.909 INFO:journalctl@ceph.mds.b.smithi114.stdout:Sep 21 01:11:40 smithi114 bash[66291]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-b 2024-09-21T01:11:41.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T01:11:41.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:41.138 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T01:11:41.139 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T01:11:41.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.e 2024-09-21T01:11:41.479 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 01:11:41 smithi114 systemd[1]: Stopping Ceph mds.e for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:41.909 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 01:11:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e[61884]: 2024-09-21T01:11:41.477+0000 7ff721a7c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:41.910 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 01:11:41 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e[61884]: 2024-09-21T01:11:41.477+0000 7ff721a7c640 -1 mds.e *** got signal Terminated *** 2024-09-21T01:11:45.020 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 01:11:44 smithi114 podman[66428]: 2024-09-21 01:11:44.758091577 +0000 UTC m=+3.394074121 container died a65e57a02ed447b0a533ef18b23874dcbf9e6db8dfde28439b98af409a8d2799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:11:45.395 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 01:11:45 smithi114 podman[66428]: 2024-09-21 01:11:45.119217792 +0000 UTC m=+3.755200333 container cleanup a65e57a02ed447b0a533ef18b23874dcbf9e6db8dfde28439b98af409a8d2799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:11:45.396 INFO:journalctl@ceph.mds.e.smithi114.stdout:Sep 21 01:11:45 smithi114 bash[66428]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-e 2024-09-21T01:11:45.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T01:11:45.590 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:45.591 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T01:11:45.591 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T01:11:45.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.h 2024-09-21T01:11:45.909 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 01:11:45 smithi114 systemd[1]: Stopping Ceph mds.h for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:46.409 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 01:11:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h[62155]: 2024-09-21T01:11:45.914+0000 7ff8ac4fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:46.409 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 01:11:45 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h[62155]: 2024-09-21T01:11:45.914+0000 7ff8ac4fc640 -1 mds.h *** got signal Terminated *** 2024-09-21T01:11:48.557 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 01:11:48 smithi114 podman[66552]: 2024-09-21 01:11:48.226115311 +0000 UTC m=+2.414349496 container died f95e835f9f1afe8f5cd17b342ecc079ade5231583f89f570cf6acd32762e92af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:11:48.557 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 01:11:48 smithi114 podman[66552]: 2024-09-21 01:11:48.55682014 +0000 UTC m=+2.745054313 container cleanup f95e835f9f1afe8f5cd17b342ecc079ade5231583f89f570cf6acd32762e92af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:11:48.909 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 01:11:48 smithi114 bash[66552]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h 2024-09-21T01:11:48.909 INFO:journalctl@ceph.mds.h.smithi114.stdout:Sep 21 01:11:48 smithi114 podman[66565]: 2024-09-21 01:11:48.774595802 +0000 UTC m=+0.547060002 container remove f95e835f9f1afe8f5cd17b342ecc079ade5231583f89f570cf6acd32762e92af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T01:11:49.032 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T01:11:49.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:49.065 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T01:11:49.065 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T01:11:49.065 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.k 2024-09-21T01:11:49.377 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 01:11:49 smithi114 systemd[1]: Stopping Ceph mds.k for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:49.659 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 01:11:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k[61602]: 2024-09-21T01:11:49.376+0000 7f4276cb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:49.659 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 01:11:49 smithi114 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k[61602]: 2024-09-21T01:11:49.376+0000 7f4276cb4640 -1 mds.k *** got signal Terminated *** 2024-09-21T01:11:52.020 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 01:11:51 smithi114 podman[66674]: 2024-09-21 01:11:51.734194456 +0000 UTC m=+2.444815795 container died 446099b5f6b6d060cf3ee54329b1866ae4fe10a7167fa7eb256865d26fff4b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T01:11:52.361 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 01:11:52 smithi114 podman[66674]: 2024-09-21 01:11:52.093565233 +0000 UTC m=+2.804186562 container cleanup 446099b5f6b6d060cf3ee54329b1866ae4fe10a7167fa7eb256865d26fff4b2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T01:11:52.362 INFO:journalctl@ceph.mds.k.smithi114.stdout:Sep 21 01:11:52 smithi114 bash[66674]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-k 2024-09-21T01:11:52.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T01:11:52.553 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:52.553 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T01:11:52.553 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T01:11:52.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.c 2024-09-21T01:11:52.844 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 01:11:52 smithi134 systemd[1]: Stopping Ceph mds.c for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:53.103 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 01:11:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c[62526]: 2024-09-21T01:11:52.852+0000 7f6c1d810640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:53.103 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 01:11:52 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c[62526]: 2024-09-21T01:11:52.852+0000 7f6c1d810640 -1 mds.c *** got signal Terminated *** 2024-09-21T01:11:57.154 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 01:11:56 smithi134 podman[66753]: 2024-09-21 01:11:56.867471136 +0000 UTC m=+4.119018817 container died 04bbdf9ee27f3b689539aa1992701b7dabe28a0393b13e8930a9b19b76edac17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T01:11:57.504 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 01:11:57 smithi134 podman[66753]: 2024-09-21 01:11:57.227699394 +0000 UTC m=+4.479247076 container cleanup 04bbdf9ee27f3b689539aa1992701b7dabe28a0393b13e8930a9b19b76edac17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T01:11:57.504 INFO:journalctl@ceph.mds.c.smithi134.stdout:Sep 21 01:11:57 smithi134 bash[66753]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-c 2024-09-21T01:11:57.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T01:11:57.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:11:57.672 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T01:11:57.672 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T01:11:57.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.f 2024-09-21T01:11:58.033 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 01:11:57 smithi134 systemd[1]: Stopping Ceph mds.f for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:11:58.344 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 01:11:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f[62254]: 2024-09-21T01:11:58.031+0000 7fb1bb165640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:11:58.344 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 01:11:58 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f[62254]: 2024-09-21T01:11:58.031+0000 7fb1bb165640 -1 mds.f *** got signal Terminated *** 2024-09-21T01:11:59.525 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 01:11:59 smithi134 podman[66886]: 2024-09-21 01:11:59.240895299 +0000 UTC m=+1.347126547 container died ac84252df8880e7c1f05ce05d189f2aab479fdf3302c5eeee8d4fc4ebf8be87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T01:11:59.844 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 01:11:59 smithi134 podman[66886]: 2024-09-21 01:11:59.598845085 +0000 UTC m=+1.705076335 container cleanup ac84252df8880e7c1f05ce05d189f2aab479fdf3302c5eeee8d4fc4ebf8be87f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T01:11:59.844 INFO:journalctl@ceph.mds.f.smithi134.stdout:Sep 21 01:11:59 smithi134 bash[66886]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-f 2024-09-21T01:12:00.022 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T01:12:00.055 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:12:00.055 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T01:12:00.055 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T01:12:00.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.i 2024-09-21T01:12:00.594 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:12:00 smithi134 systemd[1]: Stopping Ceph mds.i for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:12:00.594 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:12:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i[62797]: 2024-09-21T01:12:00.360+0000 7ffa9a344640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:12:00.594 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:12:00 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i[62797]: 2024-09-21T01:12:00.360+0000 7ffa9a344640 -1 mds.i *** got signal Terminated *** 2024-09-21T01:12:04.594 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:12:04 smithi134 podman[67006]: 2024-09-21 01:12:04.373882839 +0000 UTC m=+4.102786858 container died 1f2f9abe957450da5a2faa898d401afb6b6824e3e82385ce271896da14320901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:12:05.094 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:12:04 smithi134 podman[67006]: 2024-09-21 01:12:04.710619862 +0000 UTC m=+4.439523881 container cleanup 1f2f9abe957450da5a2faa898d401afb6b6824e3e82385ce271896da14320901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T01:12:05.094 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:12:04 smithi134 bash[67006]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i 2024-09-21T01:12:05.094 INFO:journalctl@ceph.mds.i.smithi134.stdout:Sep 21 01:12:04 smithi134 podman[67020]: 2024-09-21 01:12:04.878251353 +0000 UTC m=+0.497270264 container remove 1f2f9abe957450da5a2faa898d401afb6b6824e3e82385ce271896da14320901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:12:05.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T01:12:05.170 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:12:05.171 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T01:12:05.171 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T01:12:05.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.l 2024-09-21T01:12:05.489 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 01:12:05 smithi134 systemd[1]: Stopping Ceph mds.l for 1256112e-77b3-11ef-baf5-efdc52797490... 2024-09-21T01:12:05.844 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 01:12:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l[61985]: 2024-09-21T01:12:05.488+0000 7fadae1d9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:12:05.844 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 01:12:05 smithi134 ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l[61985]: 2024-09-21T01:12:05.488+0000 7fadae1d9640 -1 mds.l *** got signal Terminated *** 2024-09-21T01:12:09.594 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 01:12:09 smithi134 podman[67128]: 2024-09-21 01:12:09.277393908 +0000 UTC m=+3.892596246 container died f760e2e48020c3efe0a10f541cf290ae5f7251dfe45f2dc77a6b4c46dab98f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:12:10.070 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 01:12:09 smithi134 podman[67128]: 2024-09-21 01:12:09.713463797 +0000 UTC m=+4.328666127 container cleanup f760e2e48020c3efe0a10f541cf290ae5f7251dfe45f2dc77a6b4c46dab98f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:12:10.070 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 01:12:09 smithi134 bash[67128]: ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l 2024-09-21T01:12:10.070 INFO:journalctl@ceph.mds.l.smithi134.stdout:Sep 21 01:12:09 smithi134 podman[67140]: 2024-09-21 01:12:09.872949485 +0000 UTC m=+0.593219126 container remove f760e2e48020c3efe0a10f541cf290ae5f7251dfe45f2dc77a6b4c46dab98f22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-1256112e-77b3-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T01:12:10.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1256112e-77b3-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T01:12:10.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:12:10.120 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T01:12:10.120 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1256112e-77b3-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:12:10.337 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T01:12:12.880 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1256112e-77b3-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:12:13.081 INFO:teuthology.orchestra.run.smithi114.stdout:Deleting cluster with fsid: 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T01:12:15.641 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1256112e-77b3-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:12:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T01:12:18.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:12:18.317 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:12:18.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:12:18.377 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T01:12:18.379 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi047/crash 2024-09-21T01:12:18.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:12:18.423 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:12:18.423 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:12:18.425 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi114/crash 2024-09-21T01:12:18.425 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:12:18.506 INFO:teuthology.orchestra.run.smithi114.stderr:tar: /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:12:18.506 INFO:teuthology.orchestra.run.smithi114.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:12:18.508 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi134/crash 2024-09-21T01:12:18.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:12:18.546 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/1256112e-77b3-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:12:18.546 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:12:18.547 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T01:12:18.547 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T01:12:18.592 INFO:teuthology.orchestra.run.smithi047.stdout:2024-09-21T01:00:43.819721+0000 mon.a (mon.0) 1145 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:12:18.593 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-21T01:12:18.593 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[SEC\]' /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T01:12:18.634 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]' /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T01:12:18.714 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[WRN\]' /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T01:12:18.791 INFO:teuthology.orchestra.run.smithi047.stdout:2024-09-21T01:00:43.819721+0000 mon.a (mon.0) 1145 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T01:12:18.792 INFO:tasks.cephadm:Compressing logs... 2024-09-21T01:12:18.792 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:12:18.835 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:12:18.837 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:12:18.858 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-09-21T01:12:18.858 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:12:18.858 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T01:12:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T01:12:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:12:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:12:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T01:12:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:12:18.863 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T01:12:18.863 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T01:12:18.864 INFO:teuthology.orchestra.run.smithi047.stderr: 82.7% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:12:18.864 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T01:12:18.864 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.2% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:12:18.864 INFO:teuthology.orchestra.run.smithi047.stderr: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:12:18.868 INFO:teuthology.orchestra.run.smithi114.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T01:12:18.869 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:12:18.872 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:12:18.873 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:12:18.873 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T01:12:18.873 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log: 82.9% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:12:18.873 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:12:18.875 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:12:18.875 INFO:teuthology.orchestra.run.smithi134.stderr:: No such file or directory 2024-09-21T01:12:18.875 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:12:18.875 INFO:teuthology.orchestra.run.smithi134.stderr:gzip/var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:12:18.875 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T01:12:18.875 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T01:12:18.875 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.i.log: /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- 92.2% /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr: 82.8% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.5.log: 90.4% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.audit.log.gzgzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log: 87.0% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T01:12:18.876 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T01:12:18.878 INFO:teuthology.orchestra.run.smithi047.stderr: 95.4% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T01:12:18.878 INFO:teuthology.orchestra.run.smithi047.stderr: 95.4% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T01:12:18.878 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:12:18.878 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T01:12:18.878 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T01:12:18.878 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T01:12:18.878 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.x.log: 87.0% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:12:18.879 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T01:12:18.879 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.j.log: 90.8% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:12:18.879 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.3.log: 95.4% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T01:12:18.880 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.y.log: 95.2% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T01:12:18.880 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T01:12:18.880 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log: 87.0% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:12:18.880 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T01:12:18.881 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.8.log: /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.l.log: 95.3% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T01:12:18.882 INFO:teuthology.orchestra.run.smithi134.stderr: 90.9% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:12:18.882 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T01:12:18.882 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T01:12:18.882 INFO:teuthology.orchestra.run.smithi047.stderr: 95.4% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T01:12:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.h.log: 92.3% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T01:12:18.883 INFO:teuthology.orchestra.run.smithi114.stderr: 91.0% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:12:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T01:12:18.884 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.c.log: 92.4% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T01:12:18.885 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.f.log: 95.3% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T01:12:18.886 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.b.log: /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.e.log: 95.3% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T01:12:18.888 INFO:teuthology.orchestra.run.smithi114.stderr: 95.1% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T01:12:18.892 INFO:teuthology.orchestra.run.smithi134.stderr: 95.3% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T01:12:19.138 INFO:teuthology.orchestra.run.smithi047.stderr: 90.4% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T01:12:19.262 INFO:teuthology.orchestra.run.smithi134.stderr: 91.8% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T01:12:19.277 INFO:teuthology.orchestra.run.smithi114.stderr: 91.8% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T01:12:19.873 INFO:teuthology.orchestra.run.smithi134.stderr: 96.3% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T01:12:19.969 INFO:teuthology.orchestra.run.smithi047.stderr: 90.4% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T01:12:23.163 INFO:teuthology.orchestra.run.smithi047.stderr: 93.3% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T01:12:24.386 INFO:teuthology.orchestra.run.smithi134.stderr: 93.1% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T01:12:24.837 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T01:12:25.662 INFO:teuthology.orchestra.run.smithi134.stderr: 93.0% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T01:12:26.041 INFO:teuthology.orchestra.run.smithi047.stderr: 93.0% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T01:12:26.128 INFO:teuthology.orchestra.run.smithi134.stderr: 93.1% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T01:12:26.712 INFO:teuthology.orchestra.run.smithi114.stderr: 93.1% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T01:12:27.331 INFO:teuthology.orchestra.run.smithi114.stderr: 92.7% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T01:12:27.505 INFO:teuthology.orchestra.run.smithi114.stderr: 93.0% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T01:12:27.512 INFO:teuthology.orchestra.run.smithi134.stderr: 93.0% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T01:12:27.513 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-21T01:12:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m8.661s 2024-09-21T01:12:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m28.629s 2024-09-21T01:12:27.514 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m1.024s 2024-09-21T01:12:28.511 INFO:teuthology.orchestra.run.smithi047.stderr: 92.9% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T01:12:28.829 INFO:teuthology.orchestra.run.smithi047.stderr: 92.9% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T01:12:28.831 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-21T01:12:28.831 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m9.984s 2024-09-21T01:12:28.831 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m31.356s 2024-09-21T01:12:28.831 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m1.011s 2024-09-21T01:12:30.553 INFO:teuthology.orchestra.run.smithi114.stderr: 95.1% -- replaced with /var/log/ceph/1256112e-77b3-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T01:12:30.555 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-21T01:12:30.555 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m11.703s 2024-09-21T01:12:30.556 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m41.552s 2024-09-21T01:12:30.556 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m1.453s 2024-09-21T01:12:30.556 INFO:tasks.cephadm:Archiving logs... 2024-09-21T01:12:30.556 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi047/log 2024-09-21T01:12:30.557 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:12:34.922 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi114/log 2024-09-21T01:12:34.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:12:40.123 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi134/log 2024-09-21T01:12:40.124 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:12:44.151 INFO:tasks.cephadm:Removing cluster... 2024-09-21T01:12:44.151 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1256112e-77b3-11ef-baf5-efdc52797490 --force 2024-09-21T01:12:44.371 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T01:12:44.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1256112e-77b3-11ef-baf5-efdc52797490 --force 2024-09-21T01:12:44.901 INFO:teuthology.orchestra.run.smithi114.stdout:Deleting cluster with fsid: 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T01:12:45.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1256112e-77b3-11ef-baf5-efdc52797490 --force 2024-09-21T01:12:45.471 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 1256112e-77b3-11ef-baf5-efdc52797490 2024-09-21T01:12:45.808 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T01:12:45.809 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:12:45.826 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:12:45.841 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:12:45.857 INFO:tasks.cephadm:Teardown complete 2024-09-21T01:12:45.857 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T01:12:45.866 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T01:12:45.866 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:12:45.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:12:45.884 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:12:45.985 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T01:12:45.994 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T01:12:45.995 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:12:45.998 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:12:46.000 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:12:46.010 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:12:46.012 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:12:46.014 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:12:46.015 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:12:46.015 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-21T01:12:46.015 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +482us[ +522us] +/- 49ms 2024-09-21T01:12:46.015 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -1088us[-1088us] +/- 58ms 2024-09-21T01:12:46.015 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +666us[ +666us] +/- 63ms 2024-09-21T01:12:46.015 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:12:46.016 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:12:46.016 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-09-21T01:12:46.016 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +470us[ +486us] +/- 50ms 2024-09-21T01:12:46.016 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -1094us[-1094us] +/- 58ms 2024-09-21T01:12:46.016 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +673us[ +673us] +/- 63ms 2024-09-21T01:12:46.016 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:12:46.018 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:12:46.018 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-21T01:12:46.018 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +473us[ +496us] +/- 49ms 2024-09-21T01:12:46.018 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -1093us[-1093us] +/- 58ms 2024-09-21T01:12:46.018 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +655us[ +655us] +/- 63ms 2024-09-21T01:12:46.018 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:12:46.019 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T01:12:46.029 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T01:12:46.029 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T01:12:46.038 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:12:46.134 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:12:46.198 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:12:46.263 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:12:46.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:12:46.293 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:12:46.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:12:46.320 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:12:46.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:12:46.347 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T01:12:46.357 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T01:12:46.413 INFO:teuthology.task.internal:Duration was 1870.952354 seconds 2024-09-21T01:12:46.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T01:12:46.428 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T01:12:46.429 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:12:46.431 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:12:46.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:12:46.470 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:12:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:12:46.472 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:12:46.952 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T01:12:46.952 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-09-21T01:12:46.952 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:12:46.973 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-09-21T01:12:46.974 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:12:47.020 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T01:12:47.021 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:12:47.062 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T01:12:47.062 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:12:47.065 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:12:47.067 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:12:47.130 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T01:12:47.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:12:47.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:12:47.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:12:47.816 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T01:12:47.833 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T01:12:47.833 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:12:47.859 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:12:47.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:12:47.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T01:12:47.922 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:12:47.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:12:47.928 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:12:47.946 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-09-21T01:12:47.949 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-09-21T01:12:47.977 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-21T01:12:47.995 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:12:48.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:12:48.015 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:12:48.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:12:48.044 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:12:48.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:12:48.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T01:12:48.070 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T01:12:48.071 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi047 2024-09-21T01:12:48.071 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:12:48.118 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi114 2024-09-21T01:12:48.118 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:12:48.153 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913346/remote/smithi134 2024-09-21T01:12:48.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:12:48.190 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T01:12:48.190 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:12:48.192 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:12:48.195 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:12:48.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T01:12:48.253 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T01:12:48.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T01:12:48.265 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T01:12:48.265 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:12:48.268 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:12:48.270 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:12:48.281 INFO:teuthology.orchestra.run.smithi047.stdout: 265628 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:12 /home/ubuntu/cephtest 2024-09-21T01:12:48.283 INFO:teuthology.orchestra.run.smithi114.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:12 /home/ubuntu/cephtest 2024-09-21T01:12:48.294 INFO:teuthology.orchestra.run.smithi134.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:12 /home/ubuntu/cephtest 2024-09-21T01:12:48.295 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T01:12:48.306 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T01:12:48.336 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} duration: 1870.9523541927338 failure_reason: '"2024-09-21T01:00:43.819721+0000 mon.a (mon.0) 1145 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2024-09-21T01:12:48.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T01:12:48.413 INFO:teuthology.run:FAIL